00000001:02000400:0.0F:1789117399.136983:0:3299:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_hostid 00000001:02000400:0.0:1789117420.610122:0:3520:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1789117422.798947:0:3580:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 503 MB/s 00000001:01000000:2.0F:1789117423.052007:0:3580:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 664 MB/s 00000001:01000000:3.0:1789117423.301166:0:3580:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3555 MB/s 00000020:02000000:1.0F:1789117424.064292:0:3612:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_140_g76d5844 00000400:02000000:3.0:1789117425.082278:0:3628:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.130@tcp [8/256/0/180] 00008000:02000000:2.0:1789117429.081540:0:3777:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1789117496.871403:0:5746:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789117511.485956:0:6496:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789117511.485964:0:6496:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1789117511.485965:0:6496:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789117511.486813:0:6496:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000f70f831c 00000080:02000400:1.0:1789117511.486826:0:6496:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1789117511.495685:0:6496:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1789117511.495700:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789117511.495738:0:6496:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000dec0f296) 00000020:00000080:1.0:1789117511.495759:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789117511.579347:0:6496:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1789117511.579436:0:6496:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1789117511.626105:0:6496:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789117511.626327:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1789117511.626336:0:6496:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789117511.626348:0:6496:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa253ed19be1f425 00000020:01000004:0.0:1789117511.626354:0:6496:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1789117511.626359:0:6496:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789117511.626363:0:6496:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f70f831c from MGS 00000020:01000004:0.0:1789117511.626368:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789117511.626390:0:6496:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000383f6ac9) 00000020:00000080:0.0:1789117511.626401:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1789117511.626495:0:6496:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f70f831c from MGS, refs=2 00080000:01000000:0.0:1789117511.626500:0:6496:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789117511.626506:0:6496:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa253ed19be1f433 00000100:00100000:0.0:1789117511.626735:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1789117511.626940:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1789117511.626947:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789117511.631172:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789117511.631189:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789117511.633420:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789117511.633953:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789117511.633961:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789117511.635035:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789117511.635047:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789117511.635977:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789117511.635985:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789117511.644451:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117511.644459:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117511.644461:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117511.644864:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117511.644867:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117511.644869:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117511.647533:0:6496:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789117511.659710:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789117511.897188:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2235 MB/s 00000001:01000000:1.0:1789117512.147118:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2439 MB/s 00000001:01000000:3.0:1789117512.399444:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 428 MB/s 00000001:01000000:2.0:1789117512.653711:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 732 MB/s 00080000:10000000:2.0:1789117512.666796:0:6496:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:3.0:1789117512.681230:0:6496:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 00010000:00010000:0.0:1789117512.687486:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789117512.691994:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789117512.692122:0:6496:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789117512.692192:0:6496:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1789117512.692481:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789117512.692504:0:6496:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789117512.692812:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789117512.693959:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789117512.693967:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789117512.695793:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789117512.695803:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789117512.696672:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789117512.696680:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789117512.697313:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789117512.697339:0:6496:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.130@tcp' 00000020:01000004:1.0:1789117512.697341:0:6496:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789117512.697397:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.130@tcp (typ=mgc) 00000020:00000080:1.0:1789117512.697410:0:6496:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.130@tcp (0000000031de3104) 00000020:00000080:1.0:1789117512.697426:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789117512.697524:0:6496:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000dc92f367@MGC192.168.204.130@tcp: add connection 192.168.204.130@tcp at head 00010000:00010000:1.0:1789117512.697695:0:6496:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.130@tcp-0 is initialized 00000040:01000000:1.0:1789117512.697701:0:6496:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 1 is initialized 00000100:00080000:2.0:1789117512.700374:0:6515:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1789117512.702193:0:6517:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789117512.702246:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.130@tcp (uuid 7945443b-b7e4-4157-aee9-c9b2172613e6) 00000020:00000080:3.0:1789117512.702268:0:6496:0:(genops.c:1385:class_connect()) connect: client 7945443b-b7e4-4157-aee9-c9b2172613e6, cookie 0xaa253ed19be1f441 00000100:00080000:3.0:1789117512.702280:0:6496:0:(import.c:510:import_select_connection()) MGC192.168.204.130@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789117512.702285:0:6496:0:(import.c:624:import_select_connection()) MGC192.168.204.130@tcp: import 00000000dc92f367 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789117512.702316:0:6496:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000487bd32d x1876025593036928/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789117512.702342:0:6496:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7945443b-b7e4-4157-aee9-c9b2172613e6->MGS 00000020:01000004:3.0:1789117512.702358:0:6496:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789117512.702363:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789117512.702383:0:6496:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000cc4a381b) 00000020:00000080:3.0:1789117512.702397:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789117512.703997:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000487bd32d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7945443b-b7e4-4157-aee9-c9b2172613e6:3643:1876025593036928:0@lo:250: 00000100:00100000:0.0:1789117512.704133:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117512.707941:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593036928 00000100:00100000:2.0:1789117512.707955:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593036928 00000100:00100000:2.0:1789117512.707999:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789117512.708006:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d64040d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1876025593036928:12345-0@lo:250: 00010000:00080000:2.0:1789117512.708032:0:6512:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 7945443b-b7e4-4157-aee9-c9b2172613e6@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:2.0:1789117512.708092:0:6512:0:(genops.c:1385:class_connect()) connect: client 7945443b-b7e4-4157-aee9-c9b2172613e6, cookie 0xaa253ed19be1f44f 00000100:00080000:2.0:1789117512.708227:0:6512:0:(import.c:65:import_set_state_nolock()) 00000000bc1a9ec5 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789117512.708291:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d64040d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+5:3643:x1876025593036928:12345-0@lo:250: Request processed in 283us (4157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117512.708298:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789117512.711845:0:3643:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.130@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789117512.711861:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.130@tcp: connect to target with instance 0 00000100:00080000:1.0:1789117512.711869:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789117512.711873:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789117512.711878:0:3643:0:(import.c:65:import_set_state_nolock()) 00000000dc92f367 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789117512.711882:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789117512.711895:0:3643:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789117512.711902:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000487bd32d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7945443b-b7e4-4157-aee9-c9b2172613e6:3643:1876025593036928:0@lo:250: 00000100:00100000:3.0:1789117512.723516:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789117512.726503:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789117512.726510:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789117512.745875:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789117512.745977:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789117512.746426:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789117512.746433:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789117512.747290:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789117512.747466:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789117512.747471:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789117512.748712:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789117512.748724:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789117512.832632:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789117512.833003:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789117512.833010:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789117512.834380:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789117512.834391:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789117512.839183:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789117512.839467:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789117512.839476:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789117512.840369:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789117512.840377:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789117512.841290:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789117512.841502:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789117512.841508:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789117512.842254:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789117512.842263:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789117512.842816:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789117512.843700:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789117512.843705:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789117512.844730:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789117512.844741:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789117512.875828:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789117512.876083:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789117512.876092:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789117512.885306:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789117512.885322:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789117512.887440:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789117512.887455:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789117512.889544:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789117512.889575:0:6496:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1789117512.889581:0:6496:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789117512.889760:0:6496:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789117512.889797:0:6496:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.130@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1789117512.889801:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789117512.889802:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789117512.889803:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117512.889805:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789117512.889806:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117512.889807:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117512.889808:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789117512.889809:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789117512.889811:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789117512.889812:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789117512.889814:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117512.889815:0:6496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789117512.889884:0:6496:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1789117512.889887:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789117512.889888:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789117512.889890:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117512.889891:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789117512.889892:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117512.889893:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117512.889894:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789117512.889895:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789117512.889896:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789117512.889896:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789117512.889897:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117512.889898:0:6496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789117512.889986:0:6496:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789117512.890005:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593037056:0@lo:253: 00000100:00100000:0.0:1789117512.890506:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117512.890597:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 000000007637dda5 going to sleep for 11 seconds 00000100:00100000:2.0:1789117512.890701:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593037056 00000100:00100000:2.0:1789117512.890708:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593037056 00000100:00100000:2.0:1789117512.890786:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117512.890795:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c08a9f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+5:6496:x1876025593037056:12345-0@lo:253: 20000000:01000000:2.0:1789117512.890913:0:6514:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789117512.890916:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1789117512.891716:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789117512.891776:0:6514:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1789117512.892340:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789117512.894025:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1789117512.894996:0:6514:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789117512.895001:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1789117512.895007:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1789117512.895010:0:6514:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1789117512.895023:0:6514:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1789117512.895453:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789117512.895696:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1789117512.895713:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789117512.895730:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1789117512.895745:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1789117512.895758:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1789117512.895814:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1789117512.895900:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1789117512.895916:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1789117512.895995:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1789117512.896020:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1789117512.896026:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1789117512.896037:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1789117512.896189:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1789117512.896219:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789117512.896224:0:6514:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1789117512.896231:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789117512.896323:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1789117512.896331:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789117512.896343:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1789117512.896356:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1789117512.896369:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1789117512.896376:0:6514:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1789117512.896397:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1789117512.896403:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789117512.896414:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1789117512.896425:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1789117512.896437:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1789117512.896444:0:6514:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1789117512.896463:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1789117512.896469:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1789117512.896478:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1789117512.896489:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1789117512.896532:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1789117512.896550:0:6514:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789117512.896556:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1789117512.897461:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1789117512.897759:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1789117512.897782:0:6514:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.130@tcp for mdt 20000000:01000000:2.0:1789117512.897784:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.130@tcp (null) (null) (null) 00000040:00080000:2.0:1789117512.897800:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1789117512.897805:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789117512.897892:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1789117512.897907:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.130@tcp (null) (null) 00000040:00080000:2.0:1789117512.897991:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1789117512.898001:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789117512.898017:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1789117512.898034:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1789117512.898204:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789117512.898208:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789117512.898212:0:6514:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789117512.898273:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789117512.898276:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789117512.898704:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1789117512.899035:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1789117512.899203:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1789117512.899220:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1789117512.899230:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789117512.899231:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789117512.899489:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1789117512.899689:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1789117512.899704:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1789117512.899715:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1789117512.899723:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789117512.899725:0:6514:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1789117512.899729:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789117512.899731:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789117512.899735:0:6514:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789117512.899741:0:6514:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789117512.900372:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1789117512.900489:0:6514:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789117512.916441:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1789117512.916481:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1789117512.916499:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1789117512.916521:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789117512.916772:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bb8e4426/0xaa253ed19be1f456 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117512.916801:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bb8e4426/0xaa253ed19be1f456 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117512.916811:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bb8e4426/0xaa253ed19be1f456 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117512.916816:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bb8e4426/0xaa253ed19be1f456 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117512.916899:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bb8e4426/0xaa253ed19be1f456 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117512.916905:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bb8e4426/0xaa253ed19be1f456 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117512.916911:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bb8e4426 already unused, calling callback (00000000ed6530dd) 00010000:00010000:2.0:1789117512.916914:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bb8e4426/0xaa253ed19be1f456 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117512.916997:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bb8e4426/0xaa253ed19be1f456 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117512.917011:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bb8e4426/0xaa253ed19be1f456 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117512.917019:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bb8e4426/0xaa253ed19be1f456 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117512.917024:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bb8e4426/0xaa253ed19be1f456 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789117512.917224:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789117512.925688:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c08a9f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+5:6496:x1876025593037056:12345-0@lo:253: Request processed in 34887us (35176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117512.925704:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789117512.925785:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593037056:0@lo:253: 10000000:01000000:0.0:1789117512.925801:0:6496:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789117512.925804:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789117512.925806:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789117512.925807:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117512.925809:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1789117512.925810:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117512.925811:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117512.925812:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789117512.925813:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789117512.925815:0:6496:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789117512.925816:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117512.925817:0:6496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789117512.925839:0:6496:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f70f831c from lustre-MDT0000 10000000:01000000:0.0:1789117512.925871:0:6496:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789117512.925874:0:6496:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789117512.925878:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff962b88028000 10000000:01000000:0.0:1789117512.925882:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789117512.925889:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff962b88028000 from 1 10000000:01000000:0.0:1789117512.925892:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789117512.925925:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 00000000c19a966a/0xaa253ed19be1f45d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117512.925935:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 00000000c19a966a/0xaa253ed19be1f45d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117512.925943:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 00000000c19a966a/0xaa253ed19be1f45d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117512.925958:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593037184:0@lo:101: 00000100:00100000:0.0:1789117512.925991:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117512.926118:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ee3219c3 going to sleep for 11 seconds 00000100:00100000:2.0:1789117512.926337:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593037184 00000100:00100000:2.0:1789117512.926344:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593037184 00000100:00100000:2.0:1789117512.926420:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117512.926428:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d9df30b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+5:6496:x1876025593037184:12345-0@lo:101: 00010000:00010000:2.0:1789117512.926440:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117512.926452:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000764ac3bc/0xaa253ed19be1f464 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f45d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117512.926473:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000764ac3bc/0xaa253ed19be1f464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f45d expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117512.926482:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000764ac3bc/0xaa253ed19be1f464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f45d expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117512.926490:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000764ac3bc, rc 0) 00000100:00100000:2.0:1789117512.926535:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d9df30b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+6:6496:x1876025593037184:12345-0@lo:101: Request processed in 101us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117512.926541:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789117512.926597:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593037184:0@lo:101: 00010000:00010000:0.0:1789117512.926610:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 00000000c19a966a/0xaa253ed19be1f45d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f464 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117512.926618:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 00000000c19a966a/0xaa253ed19be1f45d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f464 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117512.926666:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593037312:0@lo:501: 00000100:00100000:0.0:1789117512.926692:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117512.926883:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ee3219c3 going to sleep for 11 seconds 00000100:00100000:1.0:1789117512.926928:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593037312 00000100:00100000:1.0:1789117512.926933:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593037312 00000100:00100000:2.0:1789117512.926973:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789117512.926979:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071459598 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+6:6496:x1876025593037312:12345-0@lo:501: 00000100:00100000:2.0:1789117512.927078:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071459598 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+6:6496:x1876025593037312:12345-0@lo:501: Request processed in 100us (386us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789117512.927086:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789117512.927176:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593037312:0@lo:501: 10000000:01000000:0.0:1789117512.927203:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789117512.927216:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 00000000c19a966a/0xaa253ed19be1f45d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f464 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117512.927223:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: 00000000c19a966a/0xaa253ed19be1f45d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f464 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117512.927231:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff962b9832f800 10000000:01000000:0.0:1789117512.927234:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789117512.927238:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff962b9832f800 10000000:01000000:0.0:1789117512.927240:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789117512.927242:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff962b9832f800 from 1 10000000:01000000:0.0:1789117512.927244:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789117512.927260:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 00000000d93b3bd9/0xaa253ed19be1f46b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117512.927267:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 00000000d93b3bd9/0xaa253ed19be1f46b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117512.927280:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 00000000d93b3bd9/0xaa253ed19be1f46b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117512.927293:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593037440:0@lo:101: 00000100:00100000:0.0:1789117512.927318:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117512.927536:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ee3219c3 going to sleep for 11 seconds 00000100:00100000:3.0:1789117512.927638:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593037440 00000100:00100000:3.0:1789117512.927643:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593037440 00000100:00100000:3.0:1789117512.927685:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789117512.927691:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032b32747 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+6:6496:x1876025593037440:12345-0@lo:101: 00010000:00010000:3.0:1789117512.927699:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117512.927709:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004e5777fb/0xaa253ed19be1f472 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f46b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117512.927750:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004e5777fb/0xaa253ed19be1f472 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f46b expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117512.927758:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004e5777fb/0xaa253ed19be1f472 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f46b expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117512.927766:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004e5777fb, rc 0) 00000100:00100000:3.0:1789117512.927807:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032b32747 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+7:6496:x1876025593037440:12345-0@lo:101: Request processed in 116us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117512.927812:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789117512.927890:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593037440:0@lo:101: 00010000:00010000:0.0:1789117512.927900:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 00000000d93b3bd9/0xaa253ed19be1f46b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f472 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117512.927907:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 00000000d93b3bd9/0xaa253ed19be1f46b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f472 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117512.927918:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789117512.927921:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 00000000d93b3bd9/0xaa253ed19be1f46b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f472 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117512.927926:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: 00000000d93b3bd9/0xaa253ed19be1f46b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f472 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117512.927933:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789117512.927936:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789117512.927940:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff962b9832f800 10000000:01000000:0.0:1789117512.927943:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789117512.927946:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789117512.927947:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789117512.927961:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 00000000f5cb8eec/0xaa253ed19be1f479 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117512.927973:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 00000000f5cb8eec/0xaa253ed19be1f479 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117512.927979:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 00000000f5cb8eec/0xaa253ed19be1f479 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117512.927990:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593037568:0@lo:101: 00000100:00100000:0.0:1789117512.928013:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117512.928034:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ee3219c3 going to sleep for 11 seconds 00000100:00100000:3.0:1789117512.928128:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593037568 00000100:00100000:3.0:1789117512.928132:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593037568 00000100:00100000:3.0:1789117512.928150:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789117512.928155:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e48350f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+7:6496:x1876025593037568:12345-0@lo:101: 00010000:00010000:3.0:1789117512.928162:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117512.928239:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f6c3c90d/0xaa253ed19be1f480 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f479 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117512.928254:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f6c3c90d/0xaa253ed19be1f480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f479 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117512.928260:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f6c3c90d/0xaa253ed19be1f480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f479 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117512.928266:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f6c3c90d, rc 0) 00000100:00100000:3.0:1789117512.928298:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e48350f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+8:6496:x1876025593037568:12345-0@lo:101: Request processed in 144us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117512.928304:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789117512.928373:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593037568:0@lo:101: 00010000:00010000:0.0:1789117512.928381:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 00000000f5cb8eec/0xaa253ed19be1f479 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f480 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117512.928388:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 00000000f5cb8eec/0xaa253ed19be1f479 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f480 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117512.928432:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593037696:0@lo:501: 00000100:00100000:0.0:1789117512.928455:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117512.928478:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ee3219c3 going to sleep for 11 seconds 00000100:00100000:3.0:1789117512.928673:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593037696 00000100:00100000:3.0:1789117512.928678:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593037696 00000100:00100000:3.0:1789117512.928695:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789117512.928700:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007aaebcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+8:6496:x1876025593037696:12345-0@lo:501: 00000100:00100000:3.0:1789117512.928810:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007aaebcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+9:6496:x1876025593037696:12345-0@lo:501: Request processed in 109us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117512.928817:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789117512.928881:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593037696:0@lo:501: 00000100:00100000:0.0:1789117512.928909:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593037824:0@lo:503: 00000100:00100000:0.0:1789117512.928946:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117512.928965:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ee3219c3 going to sleep for 11 seconds 00000100:00100000:3.0:1789117512.929009:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593037824 00000100:00100000:3.0:1789117512.929014:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593037824 00000100:00100000:3.0:1789117512.929030:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789117512.929035:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae7347ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+9:6496:x1876025593037824:12345-0@lo:503: 00000100:00100000:3.0:1789117512.929144:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae7347ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+9:6496:x1876025593037824:12345-0@lo:503: Request processed in 109us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117512.929150:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789117512.929323:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593037824:0@lo:503: 00000100:00100000:0.0:1789117512.929901:0:6541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:6541:1876025593037952:0@lo:502: 00000100:00100000:0.0:1789117512.929945:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117512.929974:0:6541:0:(client.c:2715:ptlrpc_set_wait()) set 000000005c5c7be7 going to sleep for 11 seconds 00000100:00100000:3.0:1789117512.930018:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593037952 00000100:00100000:3.0:1789117512.930022:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593037952 00000100:00100000:3.0:1789117512.930271:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789117512.930280:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d6bb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+9:6541:x1876025593037952:12345-0@lo:502: 00000100:00100000:3.0:1789117512.930374:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d6bb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+9:6541:x1876025593037952:12345-0@lo:502: Request processed in 96us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117512.930381:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789117512.930446:0:6541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:6541:1876025593037952:0@lo:502: 00000020:01000000:0.0:1789117512.930469:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117512.930480:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117512.930482:0:6541:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789117512.930488:0:6541:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789117512.930491:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789117512.930505:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000006c165b47) 00000020:00000080:0.0:1789117512.930522:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789117512.930536:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789117512.930627:0:6541:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789117512.930633:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa253ed19be1f48e 00000020:00000080:0.0:1789117512.930865:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789117512.930870:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117512.930873:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117512.930875:0:6541:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789117512.930877:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117512.930880:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117512.930882:0:6541:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789117512.930885:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789117512.930893:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000cbdb8db6) 00000020:00000080:0.0:1789117512.930902:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789117512.930905:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789117512.930907:0:6541:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789117512.930910:0:6541:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789117512.930930:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789117512.930978:0:6541:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f70f831c from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789117512.930991:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000080b022c0) 00000020:00000080:0.0:1789117512.930998:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789117512.931101:0:6541:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789117512.931110:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa253ed19be1f4a3 00000020:00000080:0.0:1789117512.931337:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789117512.931343:0:6541:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789117512.931347:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xaa253ed19be1f4aa 00080000:01000000:0.0:1789117512.931352:0:6541:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789117512.931356:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa253ed19be1f4b1 00080000:10000000:0.0:1789117512.931765:0:6541:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1789117512.931905:0:6541:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1789117512.936889:0:6541:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789117513.050711:0:6541:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789117513.052006:0:6541:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1789117513.058629:0:6541:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789117513.059797:0:6541:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789117513.063937:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000a6877e8d) 00000020:00000080:2.0:1789117513.068096:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789117513.068242:0:6541:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789117513.068249:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa253ed19be1f4bf 00000020:00000080:3.0:1789117513.069903:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789117513.070778:0:6541:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1789117513.081989:0:6541:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1789117513.084923:0:6541:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1789117513.087017:0:6541:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1789117513.089291:0:6541:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1789117513.091378:0:6541:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1789117513.094872:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xaa253ed19be1f4c6 00000020:00000080:1.0:1789117513.095425:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789117513.095437:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117513.095449:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117513.095451:0:6541:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789117513.095454:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789117513.095459:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117513.095460:0:6541:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789117513.095463:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789117513.095465:0:6541:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789117513.095467:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117513.095469:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117513.095470:0:6541:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789117513.095472:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789117513.095476:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117513.095477:0:6541:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789117513.095480:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789117513.095519:0:6541:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1789117513.095585:0:6541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa5bfbf4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:6541:1876025593038080:0@lo:502: 00000100:00100000:1.0:1789117513.096295:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117513.096380:0:6541:0:(client.c:2715:ptlrpc_set_wait()) set 00000000175c57b6 going to sleep for 11 seconds 00000100:00100000:3.0:1789117513.096627:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593038080 00000100:00100000:3.0:1789117513.096635:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593038080 00000100:00100000:3.0:1789117513.096710:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789117513.096718:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d20b4370 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+9:6541:x1876025593038080:12345-0@lo:502: 00000100:00100000:3.0:1789117513.096843:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d20b4370 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+9:6541:x1876025593038080:12345-0@lo:502: Request processed in 127us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117513.096857:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789117513.096929:0:6541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa5bfbf4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:6541:1876025593038080:0@lo:502: 00000020:01000000:1.0:1789117513.096955:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117513.096960:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117513.096962:0:6541:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1789117513.096966:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1789117513.097333:0:6496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1789117513.097352:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789117513.097371:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 00000000f5cb8eec/0xaa253ed19be1f479 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f480 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117513.097381:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: 00000000f5cb8eec/0xaa253ed19be1f479 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f480 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117513.097389:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962b9832f800 from 1 10000000:01000000:0.0:1789117513.097391:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789117513.097420:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 00000000c6655538/0xaa253ed19be1f4cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117513.097427:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 00000000c6655538/0xaa253ed19be1f4cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117513.097435:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 00000000c6655538/0xaa253ed19be1f4cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117513.097451:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593038208:0@lo:101: 00000100:00100000:0.0:1789117513.097488:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117513.097802:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 000000004a4b7c2c going to sleep for 11 seconds 00000100:00100000:2.0:1789117513.097900:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593038208 00000100:00100000:2.0:1789117513.097908:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593038208 00000100:00100000:2.0:1789117513.097938:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789117513.097946:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a1385a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+9:6496:x1876025593038208:12345-0@lo:101: 00010000:00010000:2.0:1789117513.097955:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117513.097969:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bb8e4426/0xaa253ed19be1f4d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f4cd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117513.097989:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bb8e4426/0xaa253ed19be1f4d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f4cd expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117513.097999:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bb8e4426/0xaa253ed19be1f4d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f4cd expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117513.098007:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bb8e4426, rc 0) 00000100:00100000:2.0:1789117513.098070:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a1385a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+10:6496:x1876025593038208:12345-0@lo:101: Request processed in 99us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117513.098077:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789117513.098151:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593038208:0@lo:101: 00010000:00010000:0.0:1789117513.098175:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 00000000c6655538/0xaa253ed19be1f4cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f4d4 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117513.098183:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 00000000c6655538/0xaa253ed19be1f4cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f4d4 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117513.098897:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593038336:0@lo:256: 00000100:00100000:0.0:1789117513.098954:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117513.098990:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 000000004a4b7c2c going to sleep for 11 seconds 00000100:00100000:2.0:1789117513.099423:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593038336 00000100:00100000:2.0:1789117513.099429:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593038336 00000100:00100000:2.0:1789117513.099459:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789117513.099466:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f5d5c0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+10:6496:x1876025593038336:12345-0@lo:256: 20000000:01000000:2.0:1789117513.099495:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789117513.099501:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789117513.099590:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f5d5c0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+10:6496:x1876025593038336:12345-0@lo:256: Request processed in 124us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117513.099597:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789117513.099714:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593038336:0@lo:256: 10000000:01000000:0.0:1789117513.100447:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789117513.100466:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 00000000c6655538/0xaa253ed19be1f4cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f4d4 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117513.100476:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: 00000000c6655538/0xaa253ed19be1f4cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f4d4 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117513.100483:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962b9832f800 from 1 10000000:01000000:0.0:1789117513.100487:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789117513.100515:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 00000000846df2e1/0xaa253ed19be1f4db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117513.100521:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 00000000846df2e1/0xaa253ed19be1f4db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117513.100587:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 00000000846df2e1/0xaa253ed19be1f4db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117513.100615:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593038464:0@lo:101: 00000100:00100000:0.0:1789117513.100657:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117513.100681:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 000000004a4b7c2c going to sleep for 11 seconds 00000100:00100000:2.0:1789117513.100763:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593038464 00000100:00100000:2.0:1789117513.100768:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593038464 00000100:00100000:2.0:1789117513.100798:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789117513.100805:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008045be32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+10:6496:x1876025593038464:12345-0@lo:101: 00010000:00010000:2.0:1789117513.100816:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117513.100829:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001f86278f/0xaa253ed19be1f4e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f4db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117513.100847:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001f86278f/0xaa253ed19be1f4e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f4db expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117513.100856:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001f86278f/0xaa253ed19be1f4e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f4db expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117513.100863:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001f86278f, rc 0) 00000100:00100000:2.0:1789117513.100898:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008045be32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+11:6496:x1876025593038464:12345-0@lo:101: Request processed in 94us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117513.100903:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789117513.100964:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593038464:0@lo:101: 00010000:00010000:0.0:1789117513.100975:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 00000000846df2e1/0xaa253ed19be1f4db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f4e2 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117513.100982:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 00000000846df2e1/0xaa253ed19be1f4db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f4e2 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117513.101030:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593038592:0@lo:501: 00000100:00100000:0.0:1789117513.101082:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117513.101103:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 000000004a4b7c2c going to sleep for 11 seconds 00000100:00100000:2.0:1789117513.101154:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593038592 00000100:00100000:2.0:1789117513.101159:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593038592 00000100:00100000:2.0:1789117513.101245:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789117513.101251:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c856a111 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+11:6496:x1876025593038592:12345-0@lo:501: 00000100:00100000:2.0:1789117513.101693:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c856a111 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+11:6496:x1876025593038592:12345-0@lo:501: Request processed in 441us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117513.101706:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789117513.101868:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593038592:0@lo:501: 00000100:00100000:0.0:1789117513.101901:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593038720:0@lo:503: 00000100:00100000:0.0:1789117513.101942:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117513.102003:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 000000004a4b7c2c going to sleep for 11 seconds 00000100:00100000:3.0:1789117513.102037:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593038720 00000100:00100000:3.0:1789117513.102042:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593038720 00000100:00100000:3.0:1789117513.102648:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789117513.102657:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7b542fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+11:6496:x1876025593038720:12345-0@lo:503: 00000040:00080000:3.0:1789117513.102694:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789117513.102749:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7b542fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+11:6496:x1876025593038720:12345-0@lo:503: Request processed in 94us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117513.102757:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789117513.102822:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9cdafb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593038720:0@lo:503: 00000040:00080000:0.0:1789117513.103787:0:6545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1789117513.103989:0:6496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789117513.104008:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789117513.104028:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 00000000846df2e1/0xaa253ed19be1f4db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f4e2 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117513.104038:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: 00000000846df2e1/0xaa253ed19be1f4db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f4e2 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117513.104127:0:6496:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789117513.104130:0:6496:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff962b9832f800 10000000:01000000:1.0:1789117513.104133:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff962b9832f800 10000000:01000000:1.0:1789117513.104136:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789117513.104141:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962b9832f800 from 1 10000000:01000000:1.0:1789117513.104143:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789117513.104183:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 000000000ba23cf8/0xaa253ed19be1f4e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117513.104189:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 000000000ba23cf8/0xaa253ed19be1f4e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117513.104197:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 000000000ba23cf8/0xaa253ed19be1f4e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117513.104213:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa5bfbf4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593038848:0@lo:101: 00000100:00100000:1.0:1789117513.104256:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117513.104701:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 00000000de468d4c going to sleep for 11 seconds 00000100:00100000:2.0:1789117513.104775:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593038848 00000100:00100000:2.0:1789117513.104782:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593038848 00000100:00100000:2.0:1789117513.104818:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789117513.104824:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000531e1508 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+11:6496:x1876025593038848:12345-0@lo:101: 00010000:00010000:2.0:1789117513.104836:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117513.104848:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b58be210/0xaa253ed19be1f4f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f4e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117513.104869:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b58be210/0xaa253ed19be1f4f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f4e9 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117513.104877:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b58be210/0xaa253ed19be1f4f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f4e9 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117513.104885:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b58be210, rc 0) 00000100:00100000:2.0:1789117513.104932:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000531e1508 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+12:6496:x1876025593038848:12345-0@lo:101: Request processed in 108us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117513.104938:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789117513.105013:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa5bfbf4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593038848:0@lo:101: 00010000:00010000:1.0:1789117513.105025:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 000000000ba23cf8/0xaa253ed19be1f4e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f4f0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117513.105032:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 000000000ba23cf8/0xaa253ed19be1f4e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f4f0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117513.105123:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa5bfbf4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593038976:0@lo:501: 00000100:00100000:1.0:1789117513.105150:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117513.105192:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 00000000de468d4c going to sleep for 11 seconds 00000100:00100000:2.0:1789117513.105396:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593038976 00000100:00100000:2.0:1789117513.105400:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593038976 00000100:00100000:2.0:1789117513.105418:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789117513.105423:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7f4f249 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+12:6496:x1876025593038976:12345-0@lo:501: 00000100:00100000:2.0:1789117513.105549:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7f4f249 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+12:6496:x1876025593038976:12345-0@lo:501: Request processed in 126us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117513.105557:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789117513.105726:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa5bfbf4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593038976:0@lo:501: 00000100:00100000:1.0:1789117513.105754:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa5bfbf4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593039104:0@lo:503: 00000100:00100000:1.0:1789117513.105791:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117513.105818:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 00000000de468d4c going to sleep for 11 seconds 00000100:00100000:2.0:1789117513.105864:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593039104 00000100:00100000:2.0:1789117513.105869:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593039104 00000100:00100000:2.0:1789117513.105891:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789117513.105896:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfa1f512 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+12:6496:x1876025593039104:12345-0@lo:503: 00000100:00100000:2.0:1789117513.105996:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfa1f512 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+12:6496:x1876025593039104:12345-0@lo:503: Request processed in 99us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117513.106001:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789117513.106093:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa5bfbf4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593039104:0@lo:503: 00000100:00100000:1.0:1789117513.106869:0:6546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa5bfbf4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:6546:1876025593039232:0@lo:502: 00000100:00100000:1.0:1789117513.106923:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117513.106984:0:6546:0:(client.c:2715:ptlrpc_set_wait()) set 0000000025743a0c going to sleep for 11 seconds 00000100:00100000:2.0:1789117513.107016:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593039232 00000100:00100000:2.0:1789117513.107022:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593039232 00000100:00100000:2.0:1789117513.107252:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789117513.107261:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ca6b196 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+12:6546:x1876025593039232:12345-0@lo:502: 00000100:00100000:2.0:1789117513.107474:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ca6b196 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+12:6546:x1876025593039232:12345-0@lo:502: Request processed in 214us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117513.107482:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789117513.107634:0:6546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa5bfbf4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:6546:1876025593039232:0@lo:502: 00000020:01000004:1.0:1789117513.107694:0:6546:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789117513.107711:0:6546:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000b9ee79c4) 00000020:00000080:1.0:1789117513.107732:0:6546:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1789117513.107830:0:6546:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f70f831c from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789117513.107834:0:6546:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f70f831c from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789117513.107837:0:6546:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000f70f831c 4 00010000:00080000:1.0:1789117513.107871:0:6546:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000df43c8ff@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.130@tcp at head 00010000:00010000:1.0:1789117513.110844:0:6546:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1789117513.111267:0:6546:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789117513.111308:0:6546:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789117513.111402:0:6546:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xaa253ed19be1f4fe 00000100:00080000:1.0:1789117513.111415:0:6546:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789117513.111420:0:6546:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000df43c8ff using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789117513.111454:0:6546:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fa5bfbf4 x1876025593039360/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789117513.111477:0:6546:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789117513.111714:0:6546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a05aff13 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:6546:1876025593039488:0@lo:502: 00000100:00100000:0.0:1789117513.111836:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa5bfbf4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876025593039360:0@lo:38: 00000100:00100000:1.0:1789117513.111945:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117513.111990:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117513.112082:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593039488 00000100:00100000:0.0:1789117513.112088:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593039488 00000100:00100000:0.0:1789117513.112129:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789117513.112137:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072aee392 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+12:6546:x1876025593039488:12345-0@lo:502: 00000100:00100000:0.0:1789117513.112262:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072aee392 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+12:6546:x1876025593039488:12345-0@lo:502: Request processed in 126us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117513.112270:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789117513.116398:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593039360 00000100:00100000:3.0:1789117513.116416:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593039360 00000100:00100000:3.0:1789117513.116462:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789117513.116469:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9cdafb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876025593039360:12345-0@lo:38: 00000100:00100000:3.0:1789117513.117398:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9cdafb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876025593039360:12345-0@lo:38: Request processed in 925us (5404us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789117513.117408:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789117513.117483:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789117513.117491:0:3643:0:(import.c:65:import_set_state_nolock()) 00000000df43c8ff lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789117513.117495:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789117513.117498:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa5bfbf4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876025593039360:0@lo:38: 00000100:00100000:1.0:1789117513.117836:0:6546:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c909f901 going to sleep for 11 seconds 00000100:00100000:1.0:1789117513.117851:0:6546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a05aff13 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:6546:1876025593039488:0@lo:502: 00000040:00080000:1.0:1789117513.117885:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1789117513.120809:0:6496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1789117513.120849:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789117513.120868:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 000000000ba23cf8/0xaa253ed19be1f4e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f4f0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117513.120880:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: 000000000ba23cf8/0xaa253ed19be1f4e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f4f0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789117513.120935:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789117513.120937:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789117513.120938:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789117513.120940:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789117513.120941:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789117513.120943:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789117513.120944:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789117513.120945:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789117513.120946:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789117513.120948:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789117513.120949:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789117513.120955:0:6496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789117513.120959:0:6496:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1789117513.120961:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789117513.120962:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789117513.120963:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789117513.120964:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789117513.120965:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789117513.120966:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789117513.120966:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789117513.120967:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789117513.120968:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789117513.120969:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789117513.120969:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789117513.120970:0:6496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789117513.120998:0:6496:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789117513.121018:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000025d18f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593039616:0@lo:253: 00000100:00100000:2.0:1789117513.123839:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117513.123900:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ca9e01b9 going to sleep for 11 seconds 00000100:00100000:3.0:1789117513.124100:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593039616 00000100:00100000:3.0:1789117513.124109:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593039616 00000100:00100000:3.0:1789117513.124158:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789117513.124233:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c10f6a6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+12:6496:x1876025593039616:12345-0@lo:253: 20000000:01000000:3.0:1789117513.124268:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789117513.124282:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789117513.133964:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789117513.134022:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789117513.134338:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789117513.134342:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789117513.134361:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001d5b0706/0xaa253ed19be1f505 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117513.134379:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bb8e4426/0xaa253ed19be1f4d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f4cd expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117513.134387:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001d5b0706/0xaa253ed19be1f505 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117513.134420:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bb8e4426/0xaa253ed19be1f4d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f4cd expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117513.134432:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bb8e4426/0xaa253ed19be1f4d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f4cd expref: 12 pid: 6514 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117513.134445:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000046678824 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876025593039744:0@lo:104: 00000100:00100000:0.0:1789117513.134502:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117513.134582:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b03de24c going to sleep for 11 seconds 00000100:00100000:3.0:1789117513.135461:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c10f6a6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+12:6496:x1876025593039616:12345-0@lo:253: Request processed in 11227us (11628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117513.135475:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789117513.135618:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000025d18f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:6496:1876025593039616:0@lo:253: 10000000:01000000:2.0:1789117513.135631:0:6496:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789117513.135634:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789117513.135635:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789117513.135637:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789117513.135638:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789117513.135639:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789117513.135640:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789117513.135641:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789117513.135642:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789117513.135643:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789117513.135644:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789117513.135645:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789117513.135647:0:6496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789117513.135659:0:6496:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789117513.137099:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593039744 00000100:00100000:1.0:1789117513.137112:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593039744 00000100:00100000:1.0:1789117513.137197:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789117513.137205:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042b0570e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+3:6535:x1876025593039744:12345-0@lo:104: 00010000:00010000:1.0:1789117513.137220:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: 00000000c6655538/0xaa253ed19be1f4cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f4d4 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117513.137304:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789117513.137308:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042b0570e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+3:6535:x1876025593039744:12345-0@lo:104: Request processed in 106us (2807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117513.137316:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789117513.137443:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117513.137448:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: 00000000c6655538/0xaa253ed19be1f4cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f4d4 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117513.137457:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c6655538 already unused, calling callback (00000000f070af84) 10000000:00010000:1.0:1789117513.137460:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: 00000000c6655538/0xaa253ed19be1f4cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f4d4 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117513.137469:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: 00000000c6655538/0xaa253ed19be1f4cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f4d4 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117513.137476:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: 00000000c6655538/0xaa253ed19be1f4cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f4d4 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117513.137494:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789117513.137533:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: 00000000c6655538/0xaa253ed19be1f4cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f4d4 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117513.137539:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789117513.137663:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a05aff13 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593039872:0@lo:103: 00000100:00100000:3.0:1789117513.137698:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117513.137747:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593039872 00000100:00100000:0.0:1789117513.137752:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593039872 00010000:00010000:0.0:1789117513.137771:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bb8e4426/0xaa253ed19be1f4d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f4cd expref: 12 pid: 6514 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117513.137799:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789117513.137805:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0fbe821 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+12:3645:x1876025593039872:12345-0@lo:103: 00010000:00010000:1.0:1789117513.137816:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: 00000000c6655538/0xaa253ed19be1f4cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f4d4 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117513.137824:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117513.137825:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: 00000000c6655538/0xaa253ed19be1f4cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f4d4 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117513.137831:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bb8e4426/0xaa253ed19be1f4d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f4cd expref: 12 pid: 6514 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117513.137843:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117513.137846:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117513.137848:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117513.137859:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bb8e4426/0xaa253ed19be1f4d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f4cd expref: 12 pid: 6514 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117513.137881:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001d5b0706/0xaa253ed19be1f505 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117513.137882:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bb8e4426/0xaa253ed19be1f4d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f4cd expref: 12 pid: 6514 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117513.137901:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001d5b0706/0xaa253ed19be1f505 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117513.137906:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000046678824 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876025593039744:0@lo:104: 20000000:01000000:0.0:1789117513.137922:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003579606s 00010000:00010000:1.0:1789117513.137927:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001d5b0706/0xaa253ed19be1f505 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117513.137928:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001d5b0706/0xaa253ed19be1f505 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117513.137947:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001d5b0706/0xaa253ed19be1f505 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117513.137948:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: 000000001d5b0706/0xaa253ed19be1f505 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117513.137962:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001d5b0706/0xaa253ed19be1f505 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117513.137964:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001d5b0706/0xaa253ed19be1f505 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117513.137979:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001d5b0706/0xaa253ed19be1f505 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117513.137986:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001d5b0706 already unused, calling callback (00000000ed6530dd) 00010000:00010000:0.0:1789117513.137989:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001d5b0706/0xaa253ed19be1f505 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117513.137995:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001d5b0706/0xaa253ed19be1f505 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117513.138013:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001d5b0706/0xaa253ed19be1f505 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117513.138019:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001d5b0706/0xaa253ed19be1f505 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117513.138031:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117513.138101:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0fbe821 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+11:3645:x1876025593039872:12345-0@lo:103: Request processed in 297us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117513.138108:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789117513.138141:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a05aff13 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593039872:0@lo:103: 00080000:10000000:2.0:1789117513.143516:0:6496:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1789117513.143856:0:6496:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789117513.144466:0:6496:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1789117513.144773:0:6496:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789117513.145116:0:6496:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1789117513.145354:0:6496:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1789117513.150943:0:6496:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1789117513.151165:0:6496:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1789117513.152167:0:6496:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1789117513.152515:0:6496:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1789117513.155000:0:6496:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1789117513.155418:0:6496:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1789117513.161279:0:6496:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1789117513.177350:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1789117513.177716:0:6551:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1789117513.177721:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789117513.177895:0:6552:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789117513.181831:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789117513.181948:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789117513.183623:0:6496:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789117513.183777:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789117513.183981:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789117513.184983:0:6496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789117513.185518:0:6496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789117513.185555:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789117513.185749:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789117513.185976:0:6496:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:3.0:1789117513.192410:0:6552:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:1.0:1789117513.194323:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789117513.194509:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789117513.194891:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789117513.195021:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789117513.195796:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789117513.198860:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789117513.199095:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789117513.199422:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789117513.199553:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789117513.199695:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789117513.199855:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789117513.199979:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789117513.204985:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789117513.205681:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789117513.205854:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789117513.205991:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000040:00080000:3.0:1789117513.207525:0:6552:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789117513.207751:0:6552:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789117513.207757:0:6552:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:1.0:1789117513.208415:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789117513.208821:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789117513.208976:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789117513.209813:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789117513.209992:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789117513.210694:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789117513.210845:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789117513.216818:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789117513.217762:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789117513.218321:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789117513.218480:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789117513.219985:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789117513.220758:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789117513.220917:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789117513.221679:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789117513.221839:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789117513.222472:0:6496:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1789117513.233788:0:6496:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789117513.233836:0:6496:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc5cc1be7988 00100000:10000000:3.0:1789117513.233844:0:6496:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789117513.234728:0:6496:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789117513.234743:0:6496:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789117513.234762:0:6496:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789117513.234778:0:6496:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1789117513.240463:0:6496:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789117513.242433:0:6496:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1789117513.702971:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117514.729674:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117515.749254:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117516.773566:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117517.797681:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789117518.186004:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789117518.186019:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789117518.186022:0:38:0:(import.c:65:import_set_state_nolock()) 00000000df43c8ff lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789117518.186038:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000df43c8ff using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789117518.186091:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000054315abb x1876025593040128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789117518.186187:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9ee6289 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593040000:0@lo:400: 00000100:00100000:2.0:1789117518.186267:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117518.186367:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054315abb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876025593040128:0@lo:38: 00000100:00100000:2.0:1789117518.186399:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117518.186450:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593040000 00000100:00100000:2.0:1789117518.186466:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593040000 00000100:00100000:2.0:1789117518.186506:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789117518.186512:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a67fa4dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+11:3646:x1876025593040000:12345-0@lo:400: 00000100:00100000:2.0:1789117518.186569:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a67fa4dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+11:3646:x1876025593040000:12345-0@lo:400: Request processed in 57us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117518.186576:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789117518.186609:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593040128 00000100:00100000:2.0:1789117518.186612:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593040128 00000100:00100000:2.0:1789117518.186630:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117518.186634:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f30721b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876025593040128:12345-0@lo:38: 00010000:00080000:2.0:1789117518.186654:0:6521:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:2.0:1789117518.186698:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xaa253ed19be1f50c 00000004:00100000:2.0:1789117518.186742:0:6521:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789117518.187012:0:6521:0:(import.c:65:import_set_state_nolock()) 000000004dac600b : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789117518.187091:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f30721b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876025593040128:12345-0@lo:38: Request processed in 456us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117518.187098:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789117518.187140:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000054315abb x1876025593040128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789117528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789117518.187154:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789117518.187161:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789117518.187166:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789117518.187168:0:3643:0:(import.c:65:import_set_state_nolock()) 00000000df43c8ff lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789117518.187172:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054315abb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876025593040128:0@lo:38: 00000100:00100000:2.0:1789117518.187201:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9ee6289 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593040000:0@lo:400: 00000001:02000400:3.0:1789117518.254535:0:6797:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:0.0:1789117518.694317:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789117518.694343:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962b9832f800 from 3 10000000:01000000:0.0:1789117518.694349:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789117518.694422:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 0000000029d06da3/0xaa253ed19be1f513 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117518.694437:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 0000000029d06da3/0xaa253ed19be1f513 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117518.694449:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 0000000029d06da3/0xaa253ed19be1f513 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117518.694479:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000385b95e4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593040256:0@lo:101: 00000100:00100000:0.0:1789117518.694575:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117518.694633:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 00000000456e9a7c going to sleep for 11 seconds 00000100:00100000:2.0:1789117518.694889:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593040256 00000100:00100000:2.0:1789117518.694906:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593040256 00000100:00100000:2.0:1789117518.694969:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789117518.694978:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081537741 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+11:6517:x1876025593040256:12345-0@lo:101: 00010000:00010000:2.0:1789117518.694993:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117518.695006:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008c025e39/0xaa253ed19be1f51a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f513 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117518.695031:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008c025e39/0xaa253ed19be1f51a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f513 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117518.695040:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008c025e39/0xaa253ed19be1f51a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f513 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117518.695049:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008c025e39, rc 0) 00000100:00100000:2.0:1789117518.695118:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081537741 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+12:6517:x1876025593040256:12345-0@lo:101: Request processed in 141us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117518.695124:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789117518.695220:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000385b95e4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593040256:0@lo:101: 00010000:00010000:1.0:1789117518.695237:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 0000000029d06da3/0xaa253ed19be1f513 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f51a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117518.695245:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 0000000029d06da3/0xaa253ed19be1f513 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f51a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117518.695297:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dae5b10b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593040384:0@lo:256: 00000100:00100000:1.0:1789117518.695329:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117518.695359:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c674331 going to sleep for 11 seconds 00000100:00100000:2.0:1789117518.695365:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593040384 00000100:00100000:2.0:1789117518.695370:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593040384 00000100:00100000:2.0:1789117518.695394:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789117518.695400:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040f4678b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+12:6517:x1876025593040384:12345-0@lo:256: 20000000:01000000:2.0:1789117518.695413:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789117518.695429:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789117518.695433:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1789117518.695520:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040f4678b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+12:6517:x1876025593040384:12345-0@lo:256: Request processed in 121us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117518.695528:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789117518.696918:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dae5b10b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593040384:0@lo:256: 10000000:01000000:1.0:1789117518.696991:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789117518.696998:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 0000000029d06da3/0xaa253ed19be1f513 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f51a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117518.697008:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: 0000000029d06da3/0xaa253ed19be1f513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f51a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117518.822096:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789117519.404854:0:6849:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789117519.405210:0:6849:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789117519.847530:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117520.869760:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117521.893643:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789117522.903035:0:6950:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789117522.903285:0:6950:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789117522.927629:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117523.302202:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117523.302248:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a72bc7ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593040512:0@lo:400: 00000100:00100000:3.0:1789117523.302408:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117523.302520:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789117523.302533:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000385b95e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593040640:0@lo:400: 00000100:00100000:3.0:1789117523.302574:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117523.302983:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593040512 00000100:00100000:0.0:1789117523.303009:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593040512 00000100:00100000:0.0:1789117523.303136:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789117523.303149:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009688d650 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+12:3646:x1876025593040512:12345-0@lo:400: 00000100:00100000:0.0:1789117523.303255:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009688d650 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+12:3646:x1876025593040512:12345-0@lo:400: Request processed in 109us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117523.303265:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789117523.303666:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a72bc7ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593040512:0@lo:400: 00000100:00100000:2.0:1789117523.310208:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593040640 00000100:00100000:2.0:1789117523.310226:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593040640 00000100:00100000:2.0:1789117523.310293:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789117523.310300:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009aad972d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593040640:12345-0@lo:400: 00000100:00100000:2.0:1789117523.310406:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009aad972d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593040640:12345-0@lo:400: Request processed in 107us (7832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117523.310414:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789117523.312263:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000385b95e4 x1876025593040640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117523.312291:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000385b95e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593040640:0@lo:400: 00010000:00010000:3.0:1789117523.941304:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117524.972458:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117525.990475:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117527.018681:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117528.037340:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117528.424489:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789117528.424523:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9b98c01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593040768:0@lo:400: 00000100:00100000:1.0:1789117528.424605:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117528.424680:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dae5b10b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593040896:0@lo:400: 00000100:00100000:1.0:1789117528.424740:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117528.426649:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593040768 00000100:00100000:2.0:1789117528.426669:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593040768 00000100:00100000:2.0:1789117528.426768:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789117528.426778:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cef951de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+12:3644:x1876025593040768:12345-0@lo:400: 00000100:00100000:2.0:1789117528.427219:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cef951de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+12:3644:x1876025593040768:12345-0@lo:400: Request processed in 442us (2614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117528.427228:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789117528.427273:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593040896 00000100:00100000:2.0:1789117528.427277:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593040896 00000100:00100000:2.0:1789117528.427317:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117528.427324:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a05aff13 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593040896:12345-0@lo:400: 00000100:00100000:2.0:1789117528.427365:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a05aff13 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593040896:12345-0@lo:400: Request processed in 42us (2626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117528.427372:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117528.427415:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9b98c01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593040768:0@lo:400: 00010000:00080000:2.0:1789117528.427451:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000dae5b10b x1876025593040896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117528.427463:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dae5b10b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593040896:0@lo:400: 00010000:00010000:1.0:1789117529.064548:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117530.092593:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117531.109434:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117532.136616:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117533.160713:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117533.541753:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117533.541789:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e375919b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593041024:0@lo:400: 00000100:00100000:3.0:1789117533.541901:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117533.541973:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f31d84ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593041152:0@lo:400: 00000100:00100000:3.0:1789117533.542005:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117533.542162:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593041152 00000100:00100000:0.0:1789117533.542174:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593041152 00000100:00100000:0.0:1789117533.542257:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789117533.542267:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bea964a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593041152:12345-0@lo:400: 00000100:00100000:0.0:1789117533.542366:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bea964a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593041152:12345-0@lo:400: Request processed in 101us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117533.542376:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789117533.542428:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f31d84ae x1876025593041152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117533.542445:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f31d84ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593041152:0@lo:400: 00000100:00100000:1.0:1789117533.543411:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593041024 00000100:00100000:1.0:1789117533.543425:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593041024 00000100:00100000:1.0:1789117533.543486:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789117533.543494:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e778aad1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+12:3646:x1876025593041024:12345-0@lo:400: 00000100:00100000:1.0:1789117533.543581:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e778aad1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+12:3646:x1876025593041024:12345-0@lo:400: Request processed in 88us (1681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117533.543588:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789117533.543676:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e375919b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593041024:0@lo:400: 00010000:00010000:3.0:1789117534.181336:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789117534.786029:0:7449:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789117534.786036:0:7449:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1789117534.786037:0:7449:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789117534.786449:0:7449:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000006b858339 00000020:01000004:2.0:1789117534.786478:0:7449:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1789117534.786492:0:7449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789117534.786509:0:7449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000003ac5e9f5) 00000020:00000080:2.0:1789117534.786527:0:7449:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789117534.895114:0:7449:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1789117534.896759:0:7449:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1789117534.947384:0:7449:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789117534.948450:0:7449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789117534.948465:0:7449:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789117534.948478:0:7449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xaa253ed19be1f528 00000020:01000004:3.0:1789117534.948487:0:7449:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789117534.948511:0:7449:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.130@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789117534.948515:0:7449:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789117534.948523:0:7449:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789117534.948558:0:7449:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789117534.948562:0:7449:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.130@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789117535.011431:0:7449:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789117535.011491:0:7449:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.130@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1789117535.011497:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789117535.011499:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789117535.011500:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117535.011502:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789117535.011503:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117535.011504:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117535.011505:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789117535.011507:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789117535.011508:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789117535.011510:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117535.011511:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789117535.011515:0:7449:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1789117535.011519:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789117535.011520:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789117535.011521:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117535.011522:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789117535.011523:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117535.011525:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117535.011526:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789117535.011611:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789117535.011612:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789117535.011613:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117535.011615:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789117535.011673:0:7449:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789117535.011697:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000045eceb89 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593041280:0@lo:253: 00000100:00100000:0.0:1789117535.013782:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117535.013984:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 0000000018cd9cfb going to sleep for 11 seconds 00000100:00100000:2.0:1789117535.015823:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593041280 00000100:00100000:2.0:1789117535.015845:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593041280 00000100:00100000:1.0:1789117535.016270:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789117535.016282:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095fd82e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+12:7449:x1876025593041280:12345-0@lo:253: 20000000:01000000:1.0:1789117535.016334:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789117535.016340:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1789117535.016345:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1789117535.016348:0:6514:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1789117535.016398:0:6514:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1789117535.016717:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789117535.016870:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1789117535.016884:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789117535.016901:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1789117535.016920:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1789117535.016948:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1789117535.017023:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1789117535.017032:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1789117535.017047:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1789117535.017096:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1789117535.017113:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1789117535.017118:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1789117535.017132:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1789117535.017147:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1789117535.017248:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1789117535.017257:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.130@tcp (null) (null) (null) 00000040:00080000:1.0:1789117535.017271:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1789117535.017277:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789117535.017291:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1789117535.017296:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.204.130@tcp (null) (null) 00000040:00080000:1.0:1789117535.017309:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1789117535.017313:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789117535.017324:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1789117535.017336:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1789117535.017346:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1789117535.017430:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1789117535.017438:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1789117535.017448:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1789117535.017461:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1789117535.017475:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1789117535.017480:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1789117535.017491:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1789117535.017508:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1789117535.017512:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:1.0:1789117535.017530:0:6514:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789117535.017537:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1789117535.019900:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1789117535.020652:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789117535.020690:0:6514:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.130@tcp for mdt 20000000:01000000:0.0:1789117535.020693:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.130@tcp (null) (null) (null) 00000040:00080000:0.0:1789117535.020714:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789117535.020722:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789117535.020736:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789117535.020742:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.204.130@tcp (null) (null) 00000040:00080000:0.0:1789117535.020777:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789117535.020868:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1789117535.020888:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1789117535.020907:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1789117535.021505:0:6514:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1789117535.021517:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1789117535.021990:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1789117535.023549:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1789117535.023584:0:6514:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.204.130@tcp for mdt 20000000:01000000:3.0:1789117535.023586:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.130@tcp (null) (null) (null) 00000040:00080000:3.0:1789117535.023603:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1789117535.023617:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789117535.023645:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1789117535.023651:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.204.130@tcp (null) (null) 00000040:00080000:3.0:1789117535.023663:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1789117535.023671:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1789117535.023684:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1789117535.023697:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1789117535.023718:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789117535.023721:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789117535.023725:0:6514:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789117535.024131:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789117535.024137:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789117535.024753:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1789117535.024780:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1789117535.024805:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789117535.025267:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1789117535.025295:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1789117535.025309:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1789117535.025320:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789117535.025322:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789117535.027444:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1789117535.027493:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1789117535.027507:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1789117535.027778:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1789117535.027813:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1789117535.027828:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1789117535.027839:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789117535.027842:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789117535.028705:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1789117535.028738:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1789117535.028754:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1789117535.029775:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1789117535.029889:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1789117535.029918:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1789117535.030001:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789117535.030005:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789117535.030333:0:6514:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789117535.030342:0:6514:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789117535.030871:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1789117535.031701:0:6514:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789117535.043028:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789117535.045866:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f52f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.045889:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000764ac3bc/0xaa253ed19be1f464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f45d expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.045897:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f6c3c90d/0xaa253ed19be1f480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f479 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.045902:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b58be210/0xaa253ed19be1f4f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f4e9 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.045927:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f52f lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.045987:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b58be210/0xaa253ed19be1f4f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f4e9 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.046003:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b58be210/0xaa253ed19be1f4f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f4e9 expref: 12 pid: 6514 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117535.046032:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000034a78b59 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593041408:0@lo:104: 00000100:00100000:0.0:1789117535.046130:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789117535.046204:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f6c3c90d/0xaa253ed19be1f480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f479 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.046212:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f6c3c90d/0xaa253ed19be1f480 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f479 expref: 12 pid: 6514 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117535.046220:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f24ae51c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593041536:0@lo:104: 00000100:00100000:0.0:1789117535.046242:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789117535.046271:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000764ac3bc/0xaa253ed19be1f464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f45d expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.046279:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000764ac3bc/0xaa253ed19be1f464 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f45d expref: 12 pid: 6513 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117535.046286:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d089ea5a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593041664:0@lo:104: 00000100:00100000:0.0:1789117535.046307:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117535.046317:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000003516e8 going to sleep for 11 seconds 00000100:00100000:2.0:1789117535.046451:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593041408 00000100:00100000:2.0:1789117535.046459:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593041408 00000100:00100000:2.0:1789117535.046504:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593041536 00000100:00100000:2.0:1789117535.046506:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593041536 00000100:00100000:2.0:1789117535.046515:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593041664 00000100:00100000:2.0:1789117535.046517:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593041664 00000100:00100000:2.0:1789117535.046528:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117535.046535:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c01177a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+5:6514:x1876025593041408:12345-0@lo:104: 00010000:00010000:2.0:1789117535.046550:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: 000000000ba23cf8/0xaa253ed19be1f4e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f4f0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.046622:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789117535.046639:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c01177a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+5:6514:x1876025593041408:12345-0@lo:104: Request processed in 93us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117535.046646:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117535.046665:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117535.046671:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b61c4b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+4:6514:x1876025593041536:12345-0@lo:104: 00010000:00010000:2.0:1789117535.046679:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: 00000000f5cb8eec/0xaa253ed19be1f479 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f480 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.046716:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789117535.046731:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b61c4b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+4:6514:x1876025593041536:12345-0@lo:104: Request processed in 61us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117535.046737:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117535.046750:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789117535.046755:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069260699 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+3:6514:x1876025593041664:12345-0@lo:104: 00010000:00010000:2.0:1789117535.046761:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: 00000000c19a966a/0xaa253ed19be1f45d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f464 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.046785:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789117535.046789:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069260699 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+3:6514:x1876025593041664:12345-0@lo:104: Request processed in 35us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117535.046794:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789117535.046810:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789117535.046814:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: 000000000ba23cf8/0xaa253ed19be1f4e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f4f0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.046821:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000ba23cf8 already unused, calling callback (00000000f070af84) 10000000:00010000:2.0:1789117535.046825:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: 000000000ba23cf8/0xaa253ed19be1f4e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f4f0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.046831:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: 000000000ba23cf8/0xaa253ed19be1f4e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f4f0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117535.046838:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: 000000000ba23cf8/0xaa253ed19be1f4e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f4f0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117535.046843:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789117535.046872:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: 000000000ba23cf8/0xaa253ed19be1f4e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f4f0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.046903:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789117535.046922:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: 000000000ba23cf8/0xaa253ed19be1f4e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f4f0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.046928:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: 000000000ba23cf8/0xaa253ed19be1f4e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f4f0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.046953:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789117535.046955:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: 00000000f5cb8eec/0xaa253ed19be1f479 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f480 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.046960:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f5cb8eec already unused, calling callback (00000000f070af84) 10000000:00010000:2.0:1789117535.046963:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: 00000000f5cb8eec/0xaa253ed19be1f479 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f480 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.046969:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: 00000000f5cb8eec/0xaa253ed19be1f479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f480 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117535.046974:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: 00000000f5cb8eec/0xaa253ed19be1f479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f480 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117535.046979:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789117535.046991:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: 00000000f5cb8eec/0xaa253ed19be1f479 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f480 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.046996:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789117535.047017:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: 00000000f5cb8eec/0xaa253ed19be1f479 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f480 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.047023:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: 00000000f5cb8eec/0xaa253ed19be1f479 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f480 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.047039:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117535.047041:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: 00000000c19a966a/0xaa253ed19be1f45d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f464 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.047047:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c19a966a already unused, calling callback (00000000f070af84) 10000000:00010000:2.0:1789117535.047049:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: 00000000c19a966a/0xaa253ed19be1f45d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f464 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.047083:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: 00000000c19a966a/0xaa253ed19be1f45d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f464 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117535.047088:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: 00000000c19a966a/0xaa253ed19be1f45d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f464 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117535.047093:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789117535.047115:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: 00000000c19a966a/0xaa253ed19be1f45d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f464 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.047121:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789117535.047127:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: 00000000c19a966a/0xaa253ed19be1f45d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f464 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.047133:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: 00000000c19a966a/0xaa253ed19be1f45d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f464 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.047149:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117535.047151:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117535.047152:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117535.047160:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117535.047201:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e26a6d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593041792:0@lo:103: 00000100:00100000:2.0:1789117535.047581:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117535.047656:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054315abb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593042048:0@lo:103: 00000100:00100000:2.0:1789117535.047683:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117535.047706:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789117535.047711:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000869c0fb0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593041920:0@lo:103: 00000100:00100000:2.0:1789117535.047732:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117535.047759:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593041792 00000100:00100000:2.0:1789117535.047765:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593041792 00010000:00010000:2.0:1789117535.047786:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b58be210/0xaa253ed19be1f4f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f4e9 expref: 13 pid: 6514 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117535.047803:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593042048 00000100:00100000:2.0:1789117535.047806:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593042048 00010000:00010000:2.0:1789117535.047814:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000764ac3bc/0xaa253ed19be1f464 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f45d expref: 14 pid: 6513 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117535.047824:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593041920 00000100:00100000:2.0:1789117535.047826:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593041920 00010000:00010000:2.0:1789117535.047836:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f6c3c90d/0xaa253ed19be1f480 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f479 expref: 15 pid: 6514 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117535.047847:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117535.047853:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9ee6289 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+15:3645:x1876025593041792:12345-0@lo:103: 00010000:00010000:2.0:1789117535.047863:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117535.047867:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b58be210/0xaa253ed19be1f4f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f4e9 expref: 15 pid: 6514 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.047876:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b58be210/0xaa253ed19be1f4f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f4e9 expref: 15 pid: 6514 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.048526:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117535.048701:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b58be210/0xaa253ed19be1f4f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f4e9 expref: 15 pid: 6514 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117535.048727:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000034a78b59 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593041408:0@lo:104: 00000100:00100000:0.0:1789117535.048743:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f24ae51c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593041536:0@lo:104: 00000100:00100000:0.0:1789117535.048751:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d089ea5a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593041664:0@lo:104: 00010000:00010000:0.0:1789117535.048776:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f52f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117535.048849:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9ee6289 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+14:3645:x1876025593041792:12345-0@lo:103: Request processed in 996us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117535.048857:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117535.048886:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117535.048905:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000025d18f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+13:3647:x1876025593042048:12345-0@lo:103: 00010000:00010000:2.0:1789117535.048917:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117535.048922:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000764ac3bc/0xaa253ed19be1f464 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f45d expref: 13 pid: 6513 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.048938:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000764ac3bc/0xaa253ed19be1f464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f45d expref: 13 pid: 6513 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.048948:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000764ac3bc/0xaa253ed19be1f464 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f45d expref: 13 pid: 6513 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.048958:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117535.048993:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000025d18f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+12:3647:x1876025593042048:12345-0@lo:103: Request processed in 101us (1309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117535.048999:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117535.049010:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789117535.049016:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b292ccd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+11:3647:x1876025593041920:12345-0@lo:103: 00010000:00010000:2.0:1789117535.049023:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117535.049027:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f6c3c90d/0xaa253ed19be1f480 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f479 expref: 11 pid: 6514 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.049034:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f6c3c90d/0xaa253ed19be1f480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f479 expref: 11 pid: 6514 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.049050:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f6c3c90d/0xaa253ed19be1f480 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f479 expref: 11 pid: 6514 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.049096:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f52f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.049355:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f52f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.049377:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f52f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.049385:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f52f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.049390:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f52f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.049397:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f52f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.049403:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ff3b8b90 already unused, calling callback (00000000ed6530dd) 00010000:00010000:2.0:1789117535.049406:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f52f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.049415:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f52f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.049426:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f52f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.049445:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117535.049470:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b292ccd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+10:3647:x1876025593041920:12345-0@lo:103: Request processed in 454us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117535.049476:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789117535.049585:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000869c0fb0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593041920:0@lo:103: 00000100:00100000:0.0:1789117535.049595:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054315abb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593042048:0@lo:103: 00010000:00010000:0.0:1789117535.049622:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f52f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.049639:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f52f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.049645:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f52f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789117535.049664:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789117535.053814:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095fd82e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+9:7449:x1876025593041280:12345-0@lo:253: Request processed in 37523us (40030us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117535.053839:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789117535.054120:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000045eceb89 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593041280:0@lo:253: 10000000:01000000:2.0:1789117535.054136:0:7449:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789117535.054139:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789117535.054140:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789117535.054142:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789117535.054143:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1789117535.054144:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789117535.054145:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789117535.054146:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789117535.054147:0:7449:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789117535.054148:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789117535.054150:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789117535.054335:0:7449:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006b858339 from lustre-MDT0001 10000000:01000000:2.0:1789117535.054375:0:7449:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789117535.054379:0:7449:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789117535.054386:0:7449:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff962b88028000 local copy 10000000:01000000:2.0:1789117535.054389:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789117535.054430:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 00000000bb8e4426/0xaa253ed19be1f536 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.054441:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.130@tcp lock: 00000000bb8e4426/0xaa253ed19be1f536 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.054449:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 00000000bb8e4426/0xaa253ed19be1f536 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117535.054473:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000013f615fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593042176:0@lo:101: 00000100:00100000:2.0:1789117535.054535:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117535.054572:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b9c14901 going to sleep for 11 seconds 00000100:00100000:3.0:1789117535.054725:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e26a6d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593041792:0@lo:103: 00000100:00100000:0.0:1789117535.054896:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593042176 00000100:00100000:0.0:1789117535.054904:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593042176 00000100:00100000:0.0:1789117535.054958:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789117535.054967:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e33a66e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+9:7449:x1876025593042176:12345-0@lo:101: 00010000:00010000:0.0:1789117535.054981:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117535.055000:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f53d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f536 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.055024:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f53d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f536 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.055036:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f53d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f536 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.055047:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000060e2d30f, rc 0) 00000100:00100000:0.0:1789117535.055099:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e33a66e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+10:7449:x1876025593042176:12345-0@lo:101: Request processed in 134us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117535.055117:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789117535.055511:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000013f615fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593042176:0@lo:101: 00010000:00010000:2.0:1789117535.055526:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 00000000bb8e4426/0xaa253ed19be1f536 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xaa253ed19be1f53d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.055534:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 00000000bb8e4426/0xaa253ed19be1f536 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xaa253ed19be1f53d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117535.055670:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000013f615fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593042304:0@lo:501: 00000100:00100000:2.0:1789117535.055707:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117535.055744:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b9c14901 going to sleep for 11 seconds 00000100:00100000:0.0:1789117535.057858:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593042304 00000100:00100000:0.0:1789117535.057919:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593042304 00000100:00100000:0.0:1789117535.057995:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789117535.058004:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de04bca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+10:7449:x1876025593042304:12345-0@lo:501: 00000100:00100000:0.0:1789117535.058603:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de04bca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+10:7449:x1876025593042304:12345-0@lo:501: Request processed in 599us (2894us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789117535.058613:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789117535.058935:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000013f615fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593042304:0@lo:501: 10000000:01000000:2.0:1789117535.058963:0:7449:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789117535.058990:0:7449:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789117535.058997:0:7449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 00000000bb8e4426/0xaa253ed19be1f536 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xaa253ed19be1f53d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.059006:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 00000000bb8e4426/0xaa253ed19be1f536 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xaa253ed19be1f53d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.059013:0:7449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: 00000000bb8e4426/0xaa253ed19be1f536 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xaa253ed19be1f53d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.059038:0:7449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789117535.059465:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff962bbcf27000 00010000:00010000:0.0:1789117535.059528:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117535.059535:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: 00000000bb8e4426/0xaa253ed19be1f536 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xaa253ed19be1f53d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.059544:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bb8e4426 already unused, calling callback (00000000f070af84) 10000000:00010000:0.0:1789117535.059547:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: 00000000bb8e4426/0xaa253ed19be1f536 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xaa253ed19be1f53d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.059557:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: 00000000bb8e4426/0xaa253ed19be1f536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xaa253ed19be1f53d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117535.059588:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: 00000000bb8e4426/0xaa253ed19be1f536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xaa253ed19be1f53d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117535.059594:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789117535.059644:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789117535.059650:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff962b88028000 10000000:01000000:2.0:1789117535.059657:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789117535.059660:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff962b88028000 from 1 10000000:01000000:2.0:1789117535.059663:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789117535.059685:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 0000000034f770aa/0xaa253ed19be1f544 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.059691:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 0000000034f770aa/0xaa253ed19be1f544 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.059701:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 0000000034f770aa/0xaa253ed19be1f544 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117535.059724:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000013f615fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593042432:0@lo:101: 00000100:00100000:2.0:1789117535.059780:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117535.059810:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b1b27f4 going to sleep for 11 seconds 00010000:00010000:0.0:1789117535.060383:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: 00000000bb8e4426/0xaa253ed19be1f536 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xaa253ed19be1f53d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.060394:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117535.060418:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: 00000000bb8e4426/0xaa253ed19be1f536 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xaa253ed19be1f53d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.060424:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: 00000000bb8e4426/0xaa253ed19be1f536 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xaa253ed19be1f53d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117535.060537:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593042432 00000100:00100000:2.0:1789117535.060545:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593042432 00000100:00100000:2.0:1789117535.060602:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789117535.060610:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a407246 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+10:7449:x1876025593042432:12345-0@lo:101: 00010000:00010000:2.0:1789117535.060624:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117535.060646:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000015c0bd32/0xaa253ed19be1f54b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f544 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.060667:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000015c0bd32/0xaa253ed19be1f54b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f544 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.060677:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000015c0bd32/0xaa253ed19be1f54b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f544 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.060685:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000015c0bd32, rc 0) 00000100:00100000:2.0:1789117535.060748:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a407246 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+11:7449:x1876025593042432:12345-0@lo:101: Request processed in 139us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117535.060754:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789117535.060802:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000013f615fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593042432:0@lo:101: 00010000:00010000:2.0:1789117535.060818:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 0000000034f770aa/0xaa253ed19be1f544 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f54b expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.060826:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 0000000034f770aa/0xaa253ed19be1f544 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f54b expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117535.060846:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789117535.060857:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 0000000034f770aa/0xaa253ed19be1f544 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f54b expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.060864:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: 0000000034f770aa/0xaa253ed19be1f544 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f54b expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.061518:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117535.061522:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117535.061524:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117535.061541:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d089ea5a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593042560:0@lo:103: 00000100:00100000:0.0:1789117535.061591:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117535.061665:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593042560 00000100:00100000:0.0:1789117535.061670:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593042560 00000100:00100000:0.0:1789117535.061709:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789117535.061715:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f24ae51c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+11:3644:x1876025593042560:12345-0@lo:103: 00010000:00010000:0.0:1789117535.061726:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117535.061742:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f53d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be1f536 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.061757:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117535.061796:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f24ae51c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+10:3644:x1876025593042560:12345-0@lo:103: Request processed in 81us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117535.061804:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789117535.061841:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d089ea5a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593042560:0@lo:103: 10000000:01000000:2.0:1789117535.062425:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff962bbcf27000 10000000:01000000:2.0:1789117535.062459:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789117535.062465:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff962bbcf27000 from 1 10000000:01000000:2.0:1789117535.062470:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789117535.062500:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 000000009ba996e3/0xaa253ed19be1f552 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.062508:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 000000009ba996e3/0xaa253ed19be1f552 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.062516:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 000000009ba996e3/0xaa253ed19be1f552 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117535.062547:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000013f615fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593042688:0@lo:101: 00000100:00100000:2.0:1789117535.062601:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117535.062642:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b1b27f4 going to sleep for 11 seconds 00000100:00100000:0.0:1789117535.062761:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593042688 00000100:00100000:0.0:1789117535.062766:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593042688 00000100:00100000:0.0:1789117535.062800:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789117535.062806:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5c210eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+10:7449:x1876025593042688:12345-0@lo:101: 00010000:00010000:0.0:1789117535.062819:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117535.062830:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000024136832/0xaa253ed19be1f559 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f552 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.062848:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000024136832/0xaa253ed19be1f559 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f552 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.062857:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000024136832/0xaa253ed19be1f559 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f552 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.062863:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000024136832, rc 0) 00000100:00100000:0.0:1789117535.063030:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5c210eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+11:7449:x1876025593042688:12345-0@lo:101: Request processed in 224us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117535.063037:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789117535.063402:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000013f615fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593042688:0@lo:101: 00010000:00010000:2.0:1789117535.063421:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 000000009ba996e3/0xaa253ed19be1f552 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f559 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.063430:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 000000009ba996e3/0xaa253ed19be1f552 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f559 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117535.063449:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789117535.063463:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 000000009ba996e3/0xaa253ed19be1f552 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f559 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.063470:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: 000000009ba996e3/0xaa253ed19be1f552 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f559 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117535.063477:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789117535.063495:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789117535.063500:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff962bbcf27000 10000000:01000000:2.0:1789117535.063505:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789117535.063508:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789117535.063510:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789117535.063529:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 0000000037aa5e21/0xaa253ed19be1f560 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.063535:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 0000000037aa5e21/0xaa253ed19be1f560 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.063554:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 0000000037aa5e21/0xaa253ed19be1f560 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117535.063646:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000013f615fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593042816:0@lo:101: 00000100:00100000:2.0:1789117535.063679:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117535.063704:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593042816 00000100:00100000:2.0:1789117535.063708:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593042816 00000100:00100000:2.0:1789117535.063737:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789117535.063743:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ecbd8b9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+11:7449:x1876025593042816:12345-0@lo:101: 00010000:00010000:2.0:1789117535.063751:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117535.063760:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a7018b1f/0xaa253ed19be1f567 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f560 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.063837:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a7018b1f/0xaa253ed19be1f567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f560 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.063845:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a7018b1f/0xaa253ed19be1f567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f560 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.063852:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a7018b1f, rc 0) 00000100:00100000:2.0:1789117535.063989:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ecbd8b9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+12:7449:x1876025593042816:12345-0@lo:101: Request processed in 139us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117535.063995:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789117535.064029:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b1b27f4 going to sleep for 11 seconds 00000100:00100000:2.0:1789117535.064042:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000013f615fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593042816:0@lo:101: 00010000:00010000:2.0:1789117535.064273:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 0000000037aa5e21/0xaa253ed19be1f560 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f567 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.064298:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 0000000037aa5e21/0xaa253ed19be1f560 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f567 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117535.064418:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000013f615fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593042944:0@lo:501: 00000100:00100000:2.0:1789117535.064448:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117535.064506:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b1b27f4 going to sleep for 11 seconds 00000100:00100000:0.0:1789117535.064746:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593042944 00000100:00100000:0.0:1789117535.064753:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593042944 00000100:00100000:0.0:1789117535.064787:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789117535.064794:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029a4dbc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+12:7449:x1876025593042944:12345-0@lo:501: 00000100:00100000:0.0:1789117535.064978:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029a4dbc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+12:7449:x1876025593042944:12345-0@lo:501: Request processed in 185us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117535.064998:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789117535.065846:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000013f615fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593042944:0@lo:501: 00000100:00100000:2.0:1789117535.066214:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000013f615fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593043072:0@lo:503: 00000100:00100000:2.0:1789117535.066288:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117535.066366:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b1b27f4 going to sleep for 11 seconds 00000100:00100000:0.0:1789117535.066409:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593043072 00000100:00100000:0.0:1789117535.066416:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593043072 00000100:00100000:0.0:1789117535.066496:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789117535.066505:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000100e9c67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+12:7449:x1876025593043072:12345-0@lo:503: 00000100:00100000:0.0:1789117535.066661:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000100e9c67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+12:7449:x1876025593043072:12345-0@lo:503: Request processed in 158us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117535.066668:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789117535.066749:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000013f615fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593043072:0@lo:503: 00000040:00080000:2.0:1789117535.067417:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789117535.067529:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000013f615fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593043200:0@lo:502: 00000100:00100000:2.0:1789117535.067577:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117535.067615:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b1b27f4 going to sleep for 11 seconds 00000100:00100000:3.0:1789117535.067696:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593043200 00000100:00100000:3.0:1789117535.067703:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593043200 00000100:00100000:3.0:1789117535.067754:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789117535.067762:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb7edd60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+12:7449:x1876025593043200:12345-0@lo:502: 00000100:00100000:3.0:1789117535.067927:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb7edd60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+12:7449:x1876025593043200:12345-0@lo:502: Request processed in 165us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117535.067944:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789117535.068852:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000013f615fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593043200:0@lo:502: 00000040:00080000:2.0:1789117535.069395:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789117535.069437:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1789117535.069453:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1789117535.069465:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1789117535.069477:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1789117535.069491:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1789117535.069505:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1789117535.069517:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1789117535.069529:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1789117535.069541:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1789117535.069564:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1789117535.069579:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1789117535.069592:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1789117535.069603:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1789117535.069646:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1789117535.069663:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1789117535.069676:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1789117535.069689:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1789117535.069702:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1789117535.069714:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1789117535.069726:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1789117535.069738:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1789117535.069752:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1789117535.069877:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000013f615fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593043328:0@lo:502: 00000100:00100000:2.0:1789117535.069968:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117535.070108:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b1b27f4 going to sleep for 11 seconds 00000100:00100000:3.0:1789117535.070317:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593043328 00000100:00100000:3.0:1789117535.070328:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593043328 00000100:00100000:2.0:1789117535.070499:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789117535.070508:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093a11da1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+12:7449:x1876025593043328:12345-0@lo:502: 00000100:00100000:2.0:1789117535.070662:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093a11da1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+12:7449:x1876025593043328:12345-0@lo:502: Request processed in 155us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117535.070670:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789117535.070772:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000013f615fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593043328:0@lo:502: 00000040:00080000:3.0:1789117535.070938:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1789117535.070951:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1789117535.071685:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789117535.071698:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117535.071701:0:7461:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789117535.071707:0:7461:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789117535.071710:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789117535.071729:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000e61dcafd) 00000020:00000080:1.0:1789117535.071756:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1789117535.071763:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789117535.071981:0:7461:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789117535.071989:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xaa253ed19be1f575 00000020:00000080:1.0:1789117535.072346:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789117535.072351:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117535.072355:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117535.072357:0:7461:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789117535.072360:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789117535.072363:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117535.072365:0:7461:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789117535.072379:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789117535.072401:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000007a138736) 00000020:00000080:1.0:1789117535.072413:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1789117535.072418:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789117535.072420:0:7461:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789117535.072424:0:7461:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789117535.072432:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789117535.072493:0:7461:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006b858339 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1789117535.072505:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000043ac5a2) 00000020:00000080:1.0:1789117535.072512:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1789117535.072555:0:7461:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789117535.072559:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xaa253ed19be1f58a 00000020:00000080:1.0:1789117535.072672:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1789117535.072680:0:7461:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789117535.072684:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xaa253ed19be1f591 00080000:01000000:1.0:1789117535.072691:0:7461:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789117535.072694:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xaa253ed19be1f598 00080000:10000000:1.0:1789117535.073674:0:7461:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1789117535.073921:0:7461:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:0.0:1789117535.210470:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117535.255665:0:7461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:0.0:1789117535.256397:0:7461:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:0.0:1789117535.260318:0:7461:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1789117535.261399:0:7461:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789117535.287967:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1789117535.287983:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117535.287991:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117535.287993:0:7461:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1789117535.287997:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117535.288003:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117535.288005:0:7461:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1789117535.288020:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789117535.288025:0:7461:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:00000080:0.0:1789117535.288092:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789117535.288132:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000f06237df) 00000020:00000080:0.0:1789117535.288162:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1789117535.288169:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789117535.288293:0:7461:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1789117535.288301:0:7461:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789117535.288309:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xaa253ed19be1f5a6 00010000:00080000:0.0:1789117535.288356:0:7461:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ed9d6fba@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.130@tcp at head 00010000:00010000:0.0:1789117535.290575:0:7461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1789117535.297270:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789117535.297287:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789117535.297328:0:7461:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789117535.297355:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xaa253ed19be1f5ad 00000100:00080000:3.0:1789117535.297370:0:7461:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789117535.297376:0:7461:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000ed9d6fba using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789117535.297415:0:7461:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000c38b8e1 x1876025593043456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789117535.297446:0:7461:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789117535.297564:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c38b8e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593043456:0@lo:38: 00000100:00100000:2.0:1789117535.297648:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1789117535.298234:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117535.298239:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117535.298240:0:7461:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1789117535.298243:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789117535.298246:0:7461:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789117535.298248:0:7461:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789117535.298249:0:7461:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789117535.298251:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789117535.298253:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117535.298254:0:7461:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789117535.298256:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117535.298260:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117535.298262:0:7461:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1789117535.298265:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789117535.298297:0:7461:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789117535.298308:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117535.298310:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117535.298311:0:7461:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1789117535.298314:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117535.298323:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117535.298324:0:7461:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789117535.298327:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789117535.298328:0:7461:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789117535.298353:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117535.298355:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117535.298357:0:7461:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789117535.298359:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:3.0:1789117535.298408:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1789117535.298446:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789117535.298463:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 0000000037aa5e21/0xaa253ed19be1f560 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f567 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117535.298474:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: 0000000037aa5e21/0xaa253ed19be1f560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f567 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117535.298482:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962bbcf27000 from 1 10000000:01000000:3.0:1789117535.298485:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789117535.298513:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 00000000c162a5a1/0xaa253ed19be1f5b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117535.298520:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 00000000c162a5a1/0xaa253ed19be1f5b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117535.298529:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 00000000c162a5a1/0xaa253ed19be1f5b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117535.298545:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000056d2990 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593043584:0@lo:101: 00000100:00100000:3.0:1789117535.298590:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117535.298634:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 000000000de071fd going to sleep for 11 seconds 00000100:00100000:0.0:1789117535.299135:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593043584 00000100:00100000:0.0:1789117535.299145:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593043584 00000100:00100000:0.0:1789117535.299197:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789117535.299207:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000039493ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+12:7449:x1876025593043584:12345-0@lo:101: 00010000:00010000:0.0:1789117535.299223:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117535.299238:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f5bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f5b4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.299264:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f5bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f5b4 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.299276:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f5bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f5b4 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.299284:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000060e2d30f, rc 0) 00000100:00100000:0.0:1789117535.299334:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000039493ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+13:7449:x1876025593043584:12345-0@lo:101: Request processed in 128us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117535.299341:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789117535.299684:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593043456 00000100:00100000:0.0:1789117535.299689:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593043456 00000100:00100000:0.0:1789117535.299721:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789117535.299725:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013f615fc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876025593043456:12345-0@lo:38: 00010000:00080000:0.0:1789117535.299743:0:6524:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:0.0:1789117535.299807:0:6524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xaa253ed19be1f5c2 00000004:00100000:0.0:1789117535.299822:0:6524:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789117535.299829:0:6524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1789117535.300160:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000056d2990 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593043584:0@lo:101: 00010000:00010000:3.0:1789117535.300188:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 00000000c162a5a1/0xaa253ed19be1f5b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f5bb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117535.300198:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 00000000c162a5a1/0xaa253ed19be1f5b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f5bb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117535.300706:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000056d2990 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593043712:0@lo:256: 00000100:00100000:3.0:1789117535.300764:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117535.300813:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 000000000de071fd going to sleep for 11 seconds 00000100:00100000:0.0:1789117535.301615:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593043712 00000100:00100000:0.0:1789117535.301634:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593043712 00000100:00100000:0.0:1789117535.301680:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789117535.301689:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c852e5cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+13:7449:x1876025593043712:12345-0@lo:256: 20000000:01000000:0.0:1789117535.301712:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789117535.301733:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789117535.301737:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789117535.301842:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c852e5cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+13:7449:x1876025593043712:12345-0@lo:256: Request processed in 155us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117535.301851:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789117535.302332:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000056d2990 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593043712:0@lo:256: 10000000:01000000:3.0:1789117535.304836:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789117535.304866:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 00000000c162a5a1/0xaa253ed19be1f5b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f5bb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117535.304884:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: 00000000c162a5a1/0xaa253ed19be1f5b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f5bb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117535.304894:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962bbcf27000 from 1 10000000:01000000:3.0:1789117535.304897:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789117535.304966:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 0000000020f25d6a/0xaa253ed19be1f5c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117535.304974:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 0000000020f25d6a/0xaa253ed19be1f5c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117535.304986:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 0000000020f25d6a/0xaa253ed19be1f5c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117535.305024:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000056d2990 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593043840:0@lo:101: 00000100:00100000:3.0:1789117535.305261:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117535.305304:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 000000000de071fd going to sleep for 11 seconds 00000100:00100000:2.0:1789117535.305609:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593043840 00000100:00100000:2.0:1789117535.305618:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593043840 00000100:00100000:2.0:1789117535.305688:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789117535.305697:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b00aad2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+13:7449:x1876025593043840:12345-0@lo:101: 00010000:00010000:2.0:1789117535.305715:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117535.305731:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000764ac3bc/0xaa253ed19be1f5d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f5c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.305767:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000764ac3bc/0xaa253ed19be1f5d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f5c9 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.305777:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000764ac3bc/0xaa253ed19be1f5d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f5c9 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.305797:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000764ac3bc, rc 0) 00000100:00100000:2.0:1789117535.305852:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b00aad2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+14:7449:x1876025593043840:12345-0@lo:101: Request processed in 156us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117535.305859:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789117535.306116:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000056d2990 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593043840:0@lo:101: 00010000:00010000:2.0:1789117535.306134:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 0000000020f25d6a/0xaa253ed19be1f5c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f5d0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.306144:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 0000000020f25d6a/0xaa253ed19be1f5c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f5d0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117535.306270:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e26a6d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593043968:0@lo:501: 00000100:00100000:2.0:1789117535.306301:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117535.306327:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 0000000038f8f391 going to sleep for 11 seconds 00000100:00100000:3.0:1789117535.306829:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593043968 00000100:00100000:3.0:1789117535.306836:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593043968 00000100:00100000:3.0:1789117535.306884:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789117535.306892:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000206719eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+14:7449:x1876025593043968:12345-0@lo:501: 00000100:00100000:3.0:1789117535.307227:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000206719eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+14:7449:x1876025593043968:12345-0@lo:501: Request processed in 335us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117535.307235:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789117535.307425:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e26a6d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593043968:0@lo:501: 00000100:00100000:2.0:1789117535.307478:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e26a6d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593044096:0@lo:503: 00000100:00100000:2.0:1789117535.307552:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117535.307585:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 0000000038f8f391 going to sleep for 11 seconds 00000100:00100000:3.0:1789117535.307691:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593044096 00000100:00100000:3.0:1789117535.307697:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593044096 00000100:00100000:3.0:1789117535.307726:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789117535.307732:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df1cb47a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+14:7449:x1876025593044096:12345-0@lo:503: 00000040:00080000:3.0:1789117535.307764:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789117535.307808:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df1cb47a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+14:7449:x1876025593044096:12345-0@lo:503: Request processed in 76us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117535.307815:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789117535.307995:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e26a6d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593044096:0@lo:503: 00000040:00080000:2.0:1789117535.308642:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789117535.308719:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1789117535.308855:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789117535.309741:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789117535.309759:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b7d8b2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593044224:0@lo:400: 00000100:00100000:1.0:1789117535.309836:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117535.309896:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593044224 00000100:00100000:1.0:1789117535.309903:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593044224 00000100:00100000:1.0:1789117535.309950:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789117535.309960:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f3587c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593044224:12345-0@lo:400: 00000100:00100000:1.0:1789117535.310014:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f3587c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593044224:12345-0@lo:400: Request processed in 56us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117535.310021:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789117535.310099:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009b7d8b2f x1876025593044224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117535.310144:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b7d8b2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593044224:0@lo:400: 00000040:00080000:2.0:1789117535.311660:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1789117535.312024:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789117535.312080:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789117535.312109:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 0000000020f25d6a/0xaa253ed19be1f5c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f5d0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117535.312124:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: 0000000020f25d6a/0xaa253ed19be1f5c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f5d0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117535.312183:0:7449:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789117535.312186:0:7449:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff962bbcf27000 10000000:01000000:3.0:1789117535.312189:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff962bbcf27000 10000000:01000000:3.0:1789117535.312193:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789117535.312211:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962bbcf27000 from 1 10000000:01000000:3.0:1789117535.312214:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789117535.312251:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 00000000a9bbce8f/0xaa253ed19be1f5d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117535.312258:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 00000000a9bbce8f/0xaa253ed19be1f5d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117535.312269:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 00000000a9bbce8f/0xaa253ed19be1f5d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117535.312292:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006ce8af87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593044352:0@lo:101: 00000100:00100000:3.0:1789117535.312364:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117535.312407:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eef8609b going to sleep for 11 seconds 00000100:00100000:1.0:1789117535.312774:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593044352 00000100:00100000:1.0:1789117535.312791:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593044352 00000100:00100000:1.0:1789117535.312840:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789117535.312849:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e83bf76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+14:7449:x1876025593044352:12345-0@lo:101: 00010000:00010000:1.0:1789117535.312865:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117535.312879:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000990480ba/0xaa253ed19be1f5de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f5d7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117535.312909:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000990480ba/0xaa253ed19be1f5de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f5d7 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117535.312921:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000990480ba/0xaa253ed19be1f5de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f5d7 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117535.312929:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000990480ba, rc 0) 00000100:00100000:1.0:1789117535.312977:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e83bf76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+15:7449:x1876025593044352:12345-0@lo:101: Request processed in 130us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117535.312984:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789117535.313036:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006ce8af87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593044352:0@lo:101: 00010000:00010000:1.0:1789117535.313072:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 00000000a9bbce8f/0xaa253ed19be1f5d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f5de expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117535.313081:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 00000000a9bbce8f/0xaa253ed19be1f5d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f5de expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117535.313392:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b7d8b2f pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593044480:0@lo:501: 00000100:00100000:1.0:1789117535.313443:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117535.313477:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8c14b3e going to sleep for 11 seconds 00000100:00100000:3.0:1789117535.313529:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593044480 00000100:00100000:3.0:1789117535.313545:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593044480 00000100:00100000:3.0:1789117535.313581:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789117535.313587:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dec38cb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+15:7449:x1876025593044480:12345-0@lo:501: 00000100:00100000:3.0:1789117535.313687:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dec38cb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+15:7449:x1876025593044480:12345-0@lo:501: Request processed in 100us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117535.313694:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789117535.318278:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b7d8b2f pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593044480:0@lo:501: 00000100:00100000:1.0:1789117535.318381:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b7d8b2f pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593044608:0@lo:503: 00000100:00100000:1.0:1789117535.318475:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117535.318523:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8c14b3e going to sleep for 11 seconds 00000100:00100000:3.0:1789117535.319388:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593044608 00000100:00100000:3.0:1789117535.319403:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593044608 00000100:00100000:3.0:1789117535.319462:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789117535.319470:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055ced38c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+15:7449:x1876025593044608:12345-0@lo:503: 00000100:00100000:3.0:1789117535.319644:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055ced38c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+15:7449:x1876025593044608:12345-0@lo:503: Request processed in 173us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117535.319653:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789117535.320107:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b7d8b2f pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593044608:0@lo:503: 00000040:00080000:1.0:1789117535.320401:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789117535.320495:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b7d8b2f pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593044736:0@lo:502: 00000100:00100000:1.0:1789117535.321883:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117535.321948:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593044736 00000100:00100000:3.0:1789117535.321972:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593044736 00000100:00100000:3.0:1789117535.322040:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789117535.322049:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096b8bd88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+15:7449:x1876025593044736:12345-0@lo:502: 00000100:00100000:3.0:1789117535.322228:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096b8bd88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+15:7449:x1876025593044736:12345-0@lo:502: Request processed in 180us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117535.322236:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1789117535.322643:0:6524:0:(import.c:65:import_set_state_nolock()) 000000003a653c2d : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789117535.322747:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013f615fc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1876025593043456:12345-0@lo:38: Request processed in 23020us (25098us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117535.322755:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789117535.322898:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789117535.322908:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789117535.322916:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789117535.322922:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789117535.322924:0:3643:0:(import.c:65:import_set_state_nolock()) 00000000ed9d6fba lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789117535.322979:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c38b8e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593043456:0@lo:38: 00000100:00100000:1.0:1789117535.323067:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8c14b3e going to sleep for 11 seconds 00000100:00100000:1.0:1789117535.323083:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b7d8b2f pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593044736:0@lo:502: 00000100:00100000:2.0:1789117535.323123:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d089ea5a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593044864:0@lo:41: 00000100:00100000:2.0:1789117535.323157:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1789117535.323276:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789117535.323307:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789117535.323322:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789117535.323340:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789117535.323353:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789117535.323367:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789117535.323380:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789117535.323394:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789117535.323408:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789117535.323420:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000100:00100000:2.0:1789117535.323432:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593044864 00000040:00080000:1.0:1789117535.323432:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000100:00100000:2.0:1789117535.323438:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593044864 00000040:00080000:1.0:1789117535.323443:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789117535.323453:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789117535.323465:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789117535.323478:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000100:00100000:2.0:1789117535.323480:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117535.323488:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e26a6d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1876025593044864:12345-0@lo:41: 00000040:00080000:1.0:1789117535.323491:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789117535.323512:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000004:00000024:2.0:1789117535.323521:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1789117535.323572:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e26a6d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1876025593044864:12345-0@lo:41: Request processed in 85us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117535.323578:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117535.323607:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d089ea5a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593044864:0@lo:41: 00000040:00080000:1.0:1789117535.324817:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789117535.324868:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789117535.324883:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789117535.324896:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789117535.324910:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789117535.325083:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789117535.325102:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789117535.325118:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789117535.325133:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789117535.325145:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789117535.325157:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1789117535.325216:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b7d8b2f pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593044992:0@lo:502: 00000100:00100000:1.0:1789117535.325321:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117535.325429:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8c14b3e going to sleep for 11 seconds 00000100:00100000:0.0:1789117535.328808:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593044992 00000100:00100000:0.0:1789117535.328830:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593044992 00000100:00100000:0.0:1789117535.329142:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789117535.329154:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a27c6e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+15:7449:x1876025593044992:12345-0@lo:502: 00000100:00100000:0.0:1789117535.329406:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a27c6e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+15:7449:x1876025593044992:12345-0@lo:502: Request processed in 252us (4083us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117535.329415:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789117535.329532:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b7d8b2f pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593044992:0@lo:502: 00000040:00080000:1.0:1789117535.329771:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789117535.329788:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1789117535.331381:0:7467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1789117535.331403:0:7467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000c2c2a296) 00000020:00000080:1.0:1789117535.331429:0:7467:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1789117535.331648:0:7467:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006b858339 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789117535.331653:0:7467:0:(tgt_mount.c:187:server_put_mount()) put mount 000000006b858339 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789117535.331657:0:7467:0:(obd_mount.c:710:lustre_put_lsi()) put 000000006b858339 3 00010000:00080000:1.0:1789117535.331693:0:7467:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000039d6a4e9@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.130@tcp at head 00010000:00010000:2.0:1789117535.335022:0:7467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1789117535.335277:0:7467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1789117535.335335:0:7467:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789117535.335355:0:7467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xaa253ed19be1f5ec 00000100:00080000:2.0:1789117535.335368:0:7467:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789117535.335374:0:7467:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000039d6a4e9 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789117535.335427:0:7467:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000054315abb x1876025593045120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789117535.335465:0:7467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789117535.335661:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054315abb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876025593045120:0@lo:38: 00000100:00100000:0.0:1789117535.335747:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1789117535.336129:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:0.0:1789117535.337784:0:7468:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:2.0:1789117535.341325:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593045120 00000100:00100000:2.0:1789117535.341350:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593045120 00000100:00100000:2.0:1789117535.341424:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117535.341434:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034a78b59 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876025593045120:12345-0@lo:38: 00010000:00080000:2.0:1789117535.341479:0:6520:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:2.0:1789117535.341518:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xaa253ed19be1f5f3 00000004:00100000:2.0:1789117535.341550:0:6520:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789117535.341585:0:6520:0:(import.c:65:import_set_state_nolock()) 0000000000c88adb : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789117535.341703:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034a78b59 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876025593045120:12345-0@lo:38: Request processed in 269us (5956us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117535.341711:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:2.0:1789117535.341740:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 00010000:00080000:1.0:1789117535.341797:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000054315abb x1876025593045120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789117545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117535.341809:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789117535.341817:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789117535.341832:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789117535.341837:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789117535.341840:0:3643:0:(import.c:65:import_set_state_nolock()) 0000000039d6a4e9 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789117535.341845:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054315abb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876025593045120:0@lo:38: 10000000:01000000:2.0:1789117535.342395:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789117535.342425:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 00000000a9bbce8f/0xaa253ed19be1f5d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f5de expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.342437:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: 00000000a9bbce8f/0xaa253ed19be1f5d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f5de expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789117535.342508:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789117535.342511:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789117535.342512:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789117535.342514:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789117535.342515:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789117535.342517:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789117535.342518:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789117535.342519:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789117535.342521:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789117535.342522:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789117535.342527:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789117535.342531:0:7449:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1789117535.342534:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789117535.342535:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789117535.342536:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789117535.342537:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789117535.342538:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789117535.342539:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789117535.342540:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789117535.342541:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789117535.342541:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789117535.342542:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789117535.342543:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789117535.342568:0:7449:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789117535.342584:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000869c0fb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593045248:0@lo:253: 00000100:00100000:2.0:1789117535.342649:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117535.342687:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b9c14901 going to sleep for 11 seconds 00000100:00100000:0.0:1789117535.343206:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593045248 00000100:00100000:0.0:1789117535.343216:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593045248 00000100:00100000:0.0:1789117535.343313:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789117535.343323:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000981e721b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+15:7449:x1876025593045248:12345-0@lo:253: 20000000:01000000:0.0:1789117535.343362:0:6512:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789117535.343381:0:6512:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1789117535.346943:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1789117535.347823:0:6512:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789117535.347845:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1789117535.348427:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789117535.348433:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789117535.348462:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f5fa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.348490:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008c025e39/0xaa253ed19be1f51a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f513 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117535.348493:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000981e721b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+15:7449:x1876025593045248:12345-0@lo:253: Request processed in 5170us (5843us total) trans 0 rc 0/0 00010000:00010000:0.0:1789117535.348497:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f5bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f5b4 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117535.348504:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:0.0:1789117535.348505:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f5fa lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.348654:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f5bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f5b4 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.348693:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f5bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f5b4 expref: 14 pid: 6513 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117535.348712:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed751f9e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876025593045376:0@lo:104: 00000100:00100000:0.0:1789117535.348755:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789117535.348803:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008c025e39/0xaa253ed19be1f51a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f513 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.348810:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008c025e39/0xaa253ed19be1f51a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f513 expref: 14 pid: 6514 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117535.348818:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000045eceb89 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876025593045504:0@lo:104: 00000100:00100000:0.0:1789117535.348855:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117535.348914:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set 0000000007893f7f going to sleep for 11 seconds 00000100:00100000:3.0:1789117535.348977:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000869c0fb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:7449:1876025593045248:0@lo:253: 10000000:01000000:3.0:1789117535.348989:0:7449:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789117535.348993:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789117535.348995:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789117535.348996:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789117535.348997:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789117535.348999:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789117535.349000:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789117535.349001:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789117535.349002:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789117535.349004:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789117535.349006:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789117535.349007:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789117535.349028:0:7449:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789117535.349269:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593045376 00000100:00100000:2.0:1789117535.349277:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593045376 00000100:00100000:2.0:1789117535.349317:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593045504 00000100:00100000:2.0:1789117535.349320:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593045504 00000100:00100000:2.0:1789117535.349336:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789117535.349343:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d089ea5a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+4:6535:x1876025593045376:12345-0@lo:104: 00010000:00010000:2.0:1789117535.349358:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: 00000000c162a5a1/0xaa253ed19be1f5b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f5bb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.349491:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789117535.349497:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d089ea5a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+4:6535:x1876025593045376:12345-0@lo:104: Request processed in 154us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117535.349516:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789117535.349531:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789117535.349548:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046678824 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+3:6535:x1876025593045504:12345-0@lo:104: 00010000:00010000:2.0:1789117535.349555:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: 0000000029d06da3/0xaa253ed19be1f513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f51a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117535.349684:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed751f9e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876025593045376:0@lo:104: 00000100:00100000:0.0:1789117535.349691:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000045eceb89 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876025593045504:0@lo:104: 00010000:00010000:0.0:1789117535.349709:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f5fa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117535.350106:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789117535.350114:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: 00000000c162a5a1/0xaa253ed19be1f5b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f5bb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117535.350121:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c162a5a1 already unused, calling callback (00000000f070af84) 10000000:00010000:1.0:1789117535.350124:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: 00000000c162a5a1/0xaa253ed19be1f5b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f5bb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117535.350132:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: 00000000c162a5a1/0xaa253ed19be1f5b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f5bb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117535.350139:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: 00000000c162a5a1/0xaa253ed19be1f5b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f5bb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117535.350145:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789117535.350278:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: 00000000c162a5a1/0xaa253ed19be1f5b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f5bb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117535.350287:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117535.350310:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: 00000000c162a5a1/0xaa253ed19be1f5b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f5bb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117535.350317:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: 00000000c162a5a1/0xaa253ed19be1f5b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f5bb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117535.350349:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117535.350352:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: 0000000029d06da3/0xaa253ed19be1f513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f51a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117535.350357:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000029d06da3 already unused, calling callback (00000000f070af84) 10000000:00010000:1.0:1789117535.350359:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: 0000000029d06da3/0xaa253ed19be1f513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f51a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117535.350366:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: 0000000029d06da3/0xaa253ed19be1f513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f51a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117535.350371:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: 0000000029d06da3/0xaa253ed19be1f513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f51a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117535.350376:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789117535.350390:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: 0000000029d06da3/0xaa253ed19be1f513 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f51a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117535.350396:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117535.350413:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: 0000000029d06da3/0xaa253ed19be1f513 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f51a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117535.350420:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: 0000000029d06da3/0xaa253ed19be1f513 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f51a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117535.350434:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117535.350436:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117535.350437:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117535.350472:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b7d8b2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593045632:0@lo:103: 00000100:00100000:1.0:1789117535.351010:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117535.351104:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a255aae1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593045760:0@lo:103: 00000100:00100000:1.0:1789117535.351138:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117535.351229:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593045632 00000100:00100000:0.0:1789117535.351236:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593045632 00010000:00010000:0.0:1789117535.351267:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f5bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f5b4 expref: 15 pid: 6513 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117535.351295:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593045760 00000100:00100000:0.0:1789117535.351298:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593045760 00010000:00010000:0.0:1789117535.351312:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008c025e39/0xaa253ed19be1f51a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f513 expref: 16 pid: 6514 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117535.351328:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789117535.351339:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026ce16b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+16:3647:x1876025593045632:12345-0@lo:103: 00010000:00010000:0.0:1789117535.351352:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117535.351359:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f5bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f5b4 expref: 16 pid: 6513 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.351372:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f5bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f5b4 expref: 16 pid: 6513 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.351392:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f5bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f5b4 expref: 16 pid: 6513 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.351412:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117535.351464:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026ce16b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+15:3647:x1876025593045632:12345-0@lo:103: Request processed in 126us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117535.351473:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789117535.351492:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789117535.351498:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f4b8843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+14:3644:x1876025593045760:12345-0@lo:103: 00010000:00010000:0.0:1789117535.351505:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117535.351509:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008c025e39/0xaa253ed19be1f51a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f513 expref: 14 pid: 6514 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.351518:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008c025e39/0xaa253ed19be1f51a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f513 expref: 14 pid: 6514 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.351527:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008c025e39/0xaa253ed19be1f51a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f513 expref: 14 pid: 6514 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.351548:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f5fa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.351557:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f5fa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789117535.351576:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003579606s 00010000:00010000:0.0:1789117535.351581:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f5fa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.351588:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f5fa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.351595:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f5fa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.351611:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f5fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.351617:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ff3b8b90 already unused, calling callback (00000000ed6530dd) 00010000:00010000:0.0:1789117535.351631:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f5fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117535.351633:0:6506:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1789117535.351638:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f5fa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117535.351639:0:6506:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1789117535.351651:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f5fa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.351661:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117535.351678:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b7d8b2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593045632:0@lo:103: 00000100:00100000:0.0:1789117535.351684:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f4b8843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+13:3644:x1876025593045760:12345-0@lo:103: Request processed in 188us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117535.351690:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789117535.351705:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a255aae1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593045760:0@lo:103: 00010000:00010000:0.0:1789117535.351742:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f5fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.351749:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f5fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117535.351753:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ff3b8b90/0xaa253ed19be1f5fa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117535.357886:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789117535.357908:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046678824 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+3:6535:x1876025593045504:12345-0@lo:104: Request processed in 8365us (9046us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117535.357922:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789117535.358012:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1789117535.361344:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1789117535.361547:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789117535.361773:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1789117535.362368:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789117535.362594:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1789117535.362772:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1789117535.365664:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1789117535.366028:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1789117535.366439:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1789117535.366677:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1789117535.366992:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1789117535.367318:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1789117535.373356:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1789117535.373473:0:7473:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1789117535.373480:0:7473:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1789117535.373821:0:7474:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1789117535.373889:0:7474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f24ae51c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7474:1876025593045888:0@lo:700: 00000100:00100000:0.0:1789117535.374013:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117535.374097:0:7474:0:(client.c:2715:ptlrpc_set_wait()) set 0000000014d6fb8b going to sleep for 11 seconds 00000040:01000000:3.0:1789117535.375041:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1789117535.375438:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593045888 00000100:00100000:1.0:1789117535.375450:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593045888 00000100:00100000:1.0:1789117535.375525:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789117535.375535:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045eceb89 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7474:x1876025593045888:12345-0@lo:700: 00000100:00100000:3.0:1789117535.376998:0:7475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eece9485 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876025593046016:0@lo:1000: 00000100:00100000:3.0:1789117535.377261:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117535.377306:0:7475:0:(client.c:2715:ptlrpc_set_wait()) set 0000000028612b41 going to sleep for 11 seconds 00000100:00100000:2.0:1789117535.377372:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593046016 00000100:00100000:2.0:1789117535.377383:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593046016 00000100:00100000:2.0:1789117535.377445:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117535.377454:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0fbe821 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1876025593046016:12345-0@lo:1000: 00000100:00100000:2.0:1789117535.377613:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0fbe821 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1876025593046016:12345-0@lo:1000: Request processed in 160us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117535.377633:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789117535.377740:0:7475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eece9485 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876025593046016:0@lo:1000: 00000040:01000000:3.0:1789117535.377770:0:7475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1789117535.377879:0:7475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eece9485 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876025593046144:0@lo:700: 00000100:00100000:3.0:1789117535.377920:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117535.377975:0:7475:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cb2b651f going to sleep for 11 seconds 00000040:01000000:2.0:1789117535.379520:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1789117535.379733:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 40000000:02000000:1.0:1789117535.381341:0:6526:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:0.0:1789117535.381927:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593046144 00000100:00100000:0.0:1789117535.381941:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593046144 00000100:00100000:0.0:1789117535.382049:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789117535.382076:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c38b8e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7475:x1876025593046144:12345-0@lo:700: 00000100:00100000:0.0:1789117535.382216:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c38b8e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7475:x1876025593046144:12345-0@lo:700: Request processed in 142us (4295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117535.382224:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00000080:2.0:1789117535.382695:0:7449:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789117535.382742:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1789117535.383028:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789117535.383977:0:7449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789117535.385099:0:7449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789117535.385171:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1789117535.385493:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789117535.385730:0:7475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eece9485 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876025593046144:0@lo:700: 00000100:00100000:3.0:1789117535.385970:0:7475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eece9485 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7475:1876025593046272:0@lo:900: 00000100:00100000:3.0:1789117535.386046:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117535.386236:0:7475:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cb2b651f going to sleep for 11 seconds 00080000:10000000:2.0:1789117535.386945:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:0.0:1789117535.387302:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593046272 00000100:00100000:0.0:1789117535.387312:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593046272 00000100:00100000:0.0:1789117535.387417:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789117535.387428:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ce8af87 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7475:x1876025593046272:12345-0@lo:900: 00000100:00100000:0.0:1789117535.387536:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ce8af87 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7475:x1876025593046272:12345-0@lo:900: Request processed in 110us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117535.387552:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:2.0:1789117535.388416:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1789117535.388577:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1789117535.388740:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1789117535.388874:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1789117535.389085:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1789117535.389222:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1789117535.389411:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1789117535.389839:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1789117535.389991:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1789117535.390276:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1789117535.390411:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1789117535.390635:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1789117535.390866:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1789117535.391002:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00010000:00080000:3.0:1789117535.391282:0:7475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000eece9485 x1876025593046272/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789117551 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117535.391300:0:7475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eece9485 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7475:1876025593046272:0@lo:900: 00000100:00100000:3.0:1789117535.391413:0:7475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eece9485 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876025593046400:0@lo:1000: 00000100:00100000:3.0:1789117535.391490:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117535.391543:0:7475:0:(client.c:2715:ptlrpc_set_wait()) set 000000003694174c going to sleep for 11 seconds 00000100:00100000:2.0:1789117535.391603:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593046400 00000100:00100000:2.0:1789117535.391610:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593046400 00000100:00100000:1.0:1789117535.391618:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045eceb89 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7474:x1876025593045888:12345-0@lo:700: Request processed in 16084us (17606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117535.391650:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789117535.391682:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789117535.391694:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000056d2990 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1876025593046400:12345-0@lo:1000: 00000100:00100000:2.0:1789117535.391760:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000056d2990 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1876025593046400:12345-0@lo:1000: Request processed in 70us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117535.391766:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00100000:10000000:2.0:1789117535.391888:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1789117535.392049:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00010000:00080000:3.0:1789117535.396290:0:7474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f24ae51c x1876025593045888/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789117551 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117535.396313:0:7474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f24ae51c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7474:1876025593045888:0@lo:700: 40000000:02000000:3.0:1789117535.396337:0:7474:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:2.0:1789117535.400858:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00000100:00100000:1.0:1789117535.402441:0:7475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eece9485 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876025593046400:0@lo:1000: 00000004:00080000:1.0:1789117535.402531:0:7475:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000cb2b651f with version 0 00000020:00100000:1.0:1789117535.402560:0:7475:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789117535.402567:0:7475:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000a255aae1 x1876025593046656/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789117535.402593:0:7475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a255aae1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876025593046656:0@lo:1000: 00000100:00100000:1.0:1789117535.402693:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117535.402752:0:7475:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8c14b3e going to sleep for 11 seconds 00000100:00100000:2.0:1789117535.403931:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593046656 00000100:00100000:2.0:1789117535.403946:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593046656 00000100:00100000:2.0:1789117535.404025:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789117535.404089:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b7d8b2f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1876025593046656:12345-0@lo:1000: 00100000:10000000:2.0:1789117535.405379:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789117535.405560:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789117535.405761:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789117535.407543:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789117535.407735:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00000001:00080000:1.0:1789117535.414228:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:0.0:1789117535.414475:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b7d8b2f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1876025593046656:12345-0@lo:1000: Request processed in 10383us (11777us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789117535.414493:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1789117535.414590:0:7475:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1789117535.414611:0:7475:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789117535.414637:0:7475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a255aae1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876025593046656:0@lo:1000: 00000100:00100000:1.0:1789117535.414747:0:7475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a255aae1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876025593046784:0@lo:1000: 00000100:00100000:1.0:1789117535.415223:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117535.415327:0:7475:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cb490c1b going to sleep for 11 seconds 00100000:10000000:2.0:1789117535.419458:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1789117535.421128:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789117535.421289:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789117535.421426:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789117535.421562:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789117535.421774:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00000100:00100000:0.0:1789117535.425018:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593046784 00000100:00100000:0.0:1789117535.425042:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593046784 00000100:00100000:0.0:1789117535.425772:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789117535.425869:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f947fd8b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1876025593046784:12345-0@lo:1000: 00100000:10000000:2.0:1789117535.426556:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789117535.426768:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789117535.426933:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789117535.427174:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789117535.427408:0:7449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1789117535.428529:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f947fd8b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1876025593046784:12345-0@lo:1000: Request processed in 2741us (13301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117535.428544:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789117535.433170:0:7475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a255aae1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876025593046784:0@lo:1000: 00000040:00080000:3.0:1789117535.433439:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1789117535.433502:0:7475:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000fcb28095 with version 1 00000040:00080000:3.0:1789117535.435647:0:7475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789117535.435781:0:7475:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789117535.438950:0:7464:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000010a1ffbb version 1 rpc_version 1 00000020:00100000:1.0:1789117535.439172:0:7464:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789117535.439187:0:7464:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000002baa45b3 x1876025593047040/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789117535.439218:0:7464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002baa45b3 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1876025593047040:0@lo:1000: 00000100:00100000:1.0:1789117535.439317:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117535.439417:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set 0000000043f5d72c going to sleep for 11 seconds 00000100:00100000:0.0:1789117535.439543:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593047040 00000100:00100000:0.0:1789117535.439553:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593047040 00000100:00100000:0.0:1789117535.439683:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789117535.439694:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008aca6c0c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7464:x1876025593047040:12345-0@lo:1000: 00000001:00080000:2.0:1789117535.444873:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:0.0:1789117535.445129:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008aca6c0c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7464:x1876025593047040:12345-0@lo:1000: Request processed in 5431us (5806us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789117535.445145:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1789117535.445666:0:7464:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1789117535.445672:0:7464:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789117535.445693:0:7464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002baa45b3 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1876025593047040:0@lo:1000: 00000040:00080000:0.0:1789117535.447366:0:7474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1789117535.447640:0:7449:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789117535.447682:0:7449:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbc5cc1db7988 00100000:10000000:3.0:1789117535.447691:0:7449:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1789117535.448639:0:7449:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789117535.448669:0:7449:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.130@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789117535.448692:0:7449:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789117535.448712:0:7449:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1789117535.449751:0:7449:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000040:00080000:2.0:1789117535.456935:0:7474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789117535.457024:0:7474:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789117535.457030:0:7474:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:00000004:3.0:1789117535.466161:0:7449:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1789117536.232386:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117537.253520:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117538.277348:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117539.307253:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117540.325592:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117540.711435:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f31d84ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593047168:0@lo:400: 00000100:00100000:1.0:1789117540.711538:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117540.711605:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789117540.711610:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a85f41e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593047552:0@lo:400: 00000100:00100000:1.0:1789117540.711637:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117540.711668:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000487bd32d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593047296:0@lo:400: 00000100:00100000:1.0:1789117540.711692:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117540.711710:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117540.711714:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002970ab3a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593047424:0@lo:400: 00000100:00100000:1.0:1789117540.711757:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117540.711799:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593047552 00000100:00100000:1.0:1789117540.711808:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593047552 00000100:00100000:1.0:1789117540.711862:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593047296 00000100:00100000:1.0:1789117540.711865:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593047296 00000100:00100000:1.0:1789117540.711882:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789117540.711890:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a255aae1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593047552:12345-0@lo:400: 00000100:00100000:1.0:1789117540.711944:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a255aae1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593047552:12345-0@lo:400: Request processed in 55us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117540.712026:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593047168 00000100:00100000:3.0:1789117540.712031:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593047168 00000100:00100000:3.0:1789117540.712085:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789117540.712093:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d91545dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+13:3645:x1876025593047168:12345-0@lo:400: 00000100:00100000:3.0:1789117540.712126:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d91545dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+13:3645:x1876025593047168:12345-0@lo:400: Request processed in 35us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117540.712133:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789117540.712209:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789117540.712225:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789117540.712231:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026ce16b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593047296:12345-0@lo:400: 00000100:00100000:1.0:1789117540.712317:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026ce16b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593047296:12345-0@lo:400: Request processed in 87us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117540.712324:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789117540.712353:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593047424 00000100:00100000:1.0:1789117540.712357:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593047424 00000100:00100000:1.0:1789117540.712384:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789117540.712390:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bec70897 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593047424:12345-0@lo:400: 00000100:00100000:1.0:1789117540.712425:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bec70897 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593047424:12345-0@lo:400: Request processed in 36us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117540.712431:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789117540.712484:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a85f41e0 x1876025593047552/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117540.712501:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a85f41e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593047552:0@lo:400: 00000100:00100000:1.0:1789117540.712512:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f31d84ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593047168:0@lo:400: 00000100:00100000:1.0:1789117540.715826:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789117540.715853:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed751f9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593047680:0@lo:41: 00000100:00100000:1.0:1789117540.715930:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117540.716131:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593047680 00000100:00100000:0.0:1789117540.716142:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593047680 00000100:00100000:0.0:1789117540.716196:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789117540.716204:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa5bfbf4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593047680:12345-0@lo:41: 00000004:00000024:0.0:1789117540.716245:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789117540.716293:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa5bfbf4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593047680:12345-0@lo:41: Request processed in 90us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117540.716301:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789117540.716649:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed751f9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593047680:0@lo:41: 00010000:00080000:3.0:1789117540.716779:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000487bd32d x1876025593047296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117540.716791:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000487bd32d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593047296:0@lo:400: 00000100:00100000:3.0:1789117540.716829:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002970ab3a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593047424:0@lo:400: 00010000:00010000:3.0:1789117541.349274:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789117541.619929:0:7720:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789117542.378774:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789117542.964537:0:7772:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789117542.964766:0:7772:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1789117543.273815:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789117543.273823:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962bbcf27000 from 4 10000000:01000000:2.0:1789117543.273827:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789117543.273887:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 00000000d4e11f06/0xaa253ed19be1f601 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117543.273922:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 00000000d4e11f06/0xaa253ed19be1f601 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117543.273934:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 00000000d4e11f06/0xaa253ed19be1f601 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117543.273968:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab0676de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593047808:0@lo:101: 00000100:00100000:2.0:1789117543.274099:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117543.274178:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005575367 going to sleep for 11 seconds 00000100:00100000:3.0:1789117543.280772:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593047808 00000100:00100000:3.0:1789117543.280790:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593047808 00000100:00100000:3.0:1789117543.280863:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789117543.280871:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd542f43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+13:6517:x1876025593047808:12345-0@lo:101: 00010000:00010000:3.0:1789117543.280892:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117543.280926:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c162a5a1/0xaa253ed19be1f608 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f601 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117543.280965:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c162a5a1/0xaa253ed19be1f608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f601 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117543.280978:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c162a5a1/0xaa253ed19be1f608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f601 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117543.280987:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c162a5a1, rc 0) 00000100:00100000:3.0:1789117543.281090:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd542f43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+14:6517:x1876025593047808:12345-0@lo:101: Request processed in 219us (6993us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117543.281097:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789117543.281637:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab0676de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593047808:0@lo:101: 00010000:00010000:2.0:1789117543.281658:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 00000000d4e11f06/0xaa253ed19be1f601 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f608 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117543.281668:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 00000000d4e11f06/0xaa253ed19be1f601 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f608 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117543.281744:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab0676de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593047936:0@lo:256: 00000100:00100000:2.0:1789117543.281789:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117543.281822:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005575367 going to sleep for 11 seconds 00000100:00100000:2.0:1789117543.281839:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593047936 00000100:00100000:2.0:1789117543.281844:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593047936 00000100:00100000:2.0:1789117543.281872:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789117543.281879:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f9a134c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+14:6517:x1876025593047936:12345-0@lo:256: 20000000:01000000:2.0:1789117543.281894:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789117543.281908:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789117543.281922:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1789117543.282226:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f9a134c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+14:6517:x1876025593047936:12345-0@lo:256: Request processed in 342us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117543.282253:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789117543.282322:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab0676de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593047936:0@lo:256: 10000000:01000000:2.0:1789117543.282408:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789117543.282421:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 00000000d4e11f06/0xaa253ed19be1f601 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f608 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117543.282433:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: 00000000d4e11f06/0xaa253ed19be1f601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f608 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117543.282448:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789117543.282452:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962b9832f800 from 21 10000000:01000000:2.0:1789117543.282456:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789117543.282501:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 000000008c025e39/0xaa253ed19be1f60f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117543.282508:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 000000008c025e39/0xaa253ed19be1f60f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117543.282517:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 000000008c025e39/0xaa253ed19be1f60f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117543.282534:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab0676de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593048064:0@lo:101: 00000100:00100000:2.0:1789117543.282580:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117543.282611:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005575367 going to sleep for 11 seconds 00000100:00100000:2.0:1789117543.282637:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593048064 00000100:00100000:2.0:1789117543.282642:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593048064 00000100:00100000:2.0:1789117543.282687:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789117543.282699:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000989b105b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+14:6517:x1876025593048064:12345-0@lo:101: 00010000:00010000:2.0:1789117543.282734:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117543.282750:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bb8e4426/0xaa253ed19be1f616 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f60f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117543.282776:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bb8e4426/0xaa253ed19be1f616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f60f expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117543.282788:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bb8e4426/0xaa253ed19be1f616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f60f expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117543.282797:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bb8e4426, rc 0) 00000100:00100000:2.0:1789117543.282837:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000989b105b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+15:6517:x1876025593048064:12345-0@lo:101: Request processed in 142us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117543.282843:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789117543.282872:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab0676de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593048064:0@lo:101: 00010000:00010000:2.0:1789117543.282881:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 000000008c025e39/0xaa253ed19be1f60f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f616 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117543.282888:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 000000008c025e39/0xaa253ed19be1f60f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f616 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117543.286769:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab0676de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593048192:0@lo:501: 00000100:00100000:2.0:1789117543.286888:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117543.286936:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005575367 going to sleep for 11 seconds 00000100:00100000:2.0:1789117543.287642:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593048192 00000100:00100000:2.0:1789117543.287653:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593048192 00000100:00100000:2.0:1789117543.287731:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789117543.287744:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d99c3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+15:6517:x1876025593048192:12345-0@lo:501: 00000100:00100000:2.0:1789117543.289594:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d99c3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+15:6517:x1876025593048192:12345-0@lo:501: Request processed in 1845us (2700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117543.289610:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789117543.289695:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab0676de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593048192:0@lo:501: 00000100:00100000:2.0:1789117543.289748:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab0676de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593048320:0@lo:503: 00000100:00100000:2.0:1789117543.289811:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117543.289851:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005575367 going to sleep for 11 seconds 00000100:00100000:3.0:1789117543.291193:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593048320 00000100:00100000:3.0:1789117543.291206:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593048320 00000100:00100000:3.0:1789117543.291260:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789117543.291268:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008ea3957 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+15:6517:x1876025593048320:12345-0@lo:503: 00000100:00100000:3.0:1789117543.291427:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008ea3957 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+15:6517:x1876025593048320:12345-0@lo:503: Request processed in 160us (1617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117543.291435:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789117543.295441:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab0676de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593048320:0@lo:503: 00000100:00100000:2.0:1789117543.295721:0:7786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab0676de pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:7786:1876025593048448:0@lo:502: 00000100:00100000:2.0:1789117543.295794:0:7786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117543.295827:0:7786:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086ba8ba3 going to sleep for 11 seconds 00000100:00100000:3.0:1789117543.296103:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593048448 00000100:00100000:3.0:1789117543.296111:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593048448 00000100:00100000:3.0:1789117543.296169:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789117543.296178:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053b011f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+15:7786:x1876025593048448:12345-0@lo:502: 00000100:00100000:3.0:1789117543.296314:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053b011f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+15:7786:x1876025593048448:12345-0@lo:502: Request processed in 138us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117543.296322:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789117543.298235:0:7786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab0676de pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:7786:1876025593048448:0@lo:502: 00000100:00100000:2.0:1789117543.298319:0:7786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab0676de pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:7786:1876025593048576:0@lo:502: 00000100:00100000:2.0:1789117543.300179:0:7786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117543.300239:0:7786:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086ba8ba3 going to sleep for 11 seconds 00000100:00100000:3.0:1789117543.300364:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593048576 00000100:00100000:3.0:1789117543.300374:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593048576 00000100:00100000:3.0:1789117543.300422:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789117543.300431:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000784a20d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+15:7786:x1876025593048576:12345-0@lo:502: 00000100:00100000:3.0:1789117543.300559:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000784a20d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+15:7786:x1876025593048576:12345-0@lo:502: Request processed in 130us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117543.300568:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789117543.315672:0:7786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab0676de pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:7786:1876025593048576:0@lo:502: 00000040:00080000:2.0:1789117543.315723:0:7786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1789117543.315798:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1789117543.315821:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789117543.315831:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 000000008c025e39/0xaa253ed19be1f60f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f616 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117543.315841:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: 000000008c025e39/0xaa253ed19be1f60f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f616 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117543.315865:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789117543.315868:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962b9832f800 from 4 10000000:01000000:2.0:1789117543.315870:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789117543.317455:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 00000000b58be210/0xaa253ed19be1f61d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117543.317488:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 00000000b58be210/0xaa253ed19be1f61d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117543.317500:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 00000000b58be210/0xaa253ed19be1f61d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117543.317527:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab0676de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593048704:0@lo:101: 00000100:00100000:2.0:1789117543.317633:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117543.317697:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086ba8ba3 going to sleep for 11 seconds 00000100:00100000:2.0:1789117543.317735:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593048704 00000100:00100000:2.0:1789117543.317744:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593048704 00000100:00100000:2.0:1789117543.317824:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789117543.317834:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098d7f1f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+15:6517:x1876025593048704:12345-0@lo:101: 00010000:00010000:2.0:1789117543.317851:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117543.317886:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000032fe6fbb/0xaa253ed19be1f624 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f61d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117543.317929:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000032fe6fbb/0xaa253ed19be1f624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f61d expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117543.317941:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000032fe6fbb/0xaa253ed19be1f624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f61d expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117543.319098:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000032fe6fbb, rc 0) 00000100:00100000:2.0:1789117543.319222:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098d7f1f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+16:6517:x1876025593048704:12345-0@lo:101: Request processed in 1386us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117543.319232:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789117543.319750:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab0676de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593048704:0@lo:101: 00010000:00010000:2.0:1789117543.319775:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 00000000b58be210/0xaa253ed19be1f61d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f624 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117543.319786:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 00000000b58be210/0xaa253ed19be1f61d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f624 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117543.319860:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab0676de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593048832:0@lo:256: 00000100:00100000:2.0:1789117543.319902:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117543.321819:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086ba8ba3 going to sleep for 11 seconds 00000100:00100000:3.0:1789117543.325594:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593048832 00000100:00100000:3.0:1789117543.325624:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593048832 00000100:00100000:3.0:1789117543.325913:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789117543.325924:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057a83a04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+16:6517:x1876025593048832:12345-0@lo:256: 20000000:01000000:3.0:1789117543.325957:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789117543.325978:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789117543.325981:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789117543.326161:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057a83a04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+16:6517:x1876025593048832:12345-0@lo:256: Request processed in 238us (6257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117543.326170:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789117543.326379:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab0676de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593048832:0@lo:256: 10000000:01000000:0.0:1789117543.326444:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789117543.326455:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 00000000b58be210/0xaa253ed19be1f61d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f624 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117543.326467:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: 00000000b58be210/0xaa253ed19be1f61d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f624 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117543.326488:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789117543.326491:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1789117543.326494:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789117543.326529:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 00000000f29bf47d/0xaa253ed19be1f62b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117543.326542:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 00000000f29bf47d/0xaa253ed19be1f62b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117543.326552:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 00000000f29bf47d/0xaa253ed19be1f62b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117543.326573:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a72bc7ed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593048960:0@lo:101: 00000100:00100000:0.0:1789117543.326620:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117543.326659:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 000000007fc21abe going to sleep for 11 seconds 00000100:00100000:3.0:1789117543.326731:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593048960 00000100:00100000:3.0:1789117543.326737:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593048960 00000100:00100000:3.0:1789117543.326774:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789117543.326781:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e554c58c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+16:6517:x1876025593048960:12345-0@lo:101: 00010000:00010000:3.0:1789117543.326793:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117543.326809:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f6c3c90d/0xaa253ed19be1f632 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f62b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117543.326834:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f6c3c90d/0xaa253ed19be1f632 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f62b expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117543.326845:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f6c3c90d/0xaa253ed19be1f632 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f62b expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117543.326855:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f6c3c90d, rc 0) 00000100:00100000:3.0:1789117543.326891:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e554c58c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593048960:12345-0@lo:101: Request processed in 111us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117543.326898:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789117543.326931:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a72bc7ed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593048960:0@lo:101: 00010000:00010000:3.0:1789117543.326944:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 00000000f29bf47d/0xaa253ed19be1f62b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f632 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117543.326952:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 00000000f29bf47d/0xaa253ed19be1f62b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f632 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117543.327014:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002970ab3a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593049088:0@lo:501: 00000100:00100000:3.0:1789117543.327039:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117543.327090:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cb2b651f going to sleep for 11 seconds 00000100:00100000:3.0:1789117543.327104:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593049088 00000100:00100000:3.0:1789117543.327107:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593049088 00000100:00100000:3.0:1789117543.327129:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789117543.327136:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000156c89b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593049088:12345-0@lo:501: 00000100:00100000:3.0:1789117543.327287:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000156c89b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593049088:12345-0@lo:501: Request processed in 151us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117543.327305:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789117543.327347:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002970ab3a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593049088:0@lo:501: 00000100:00100000:3.0:1789117543.327382:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002970ab3a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593049216:0@lo:503: 00000100:00100000:3.0:1789117543.327429:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117543.327449:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cb2b651f going to sleep for 11 seconds 00000100:00100000:3.0:1789117543.327468:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593049216 00000100:00100000:3.0:1789117543.329228:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593049216 00000100:00100000:3.0:1789117543.329351:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789117543.329362:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033797c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593049216:12345-0@lo:503: 00000100:00100000:3.0:1789117543.330952:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033797c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593049216:12345-0@lo:503: Request processed in 1582us (3517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117543.330966:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789117543.331128:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002970ab3a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593049216:0@lo:503: 00000100:00100000:0.0:1789117543.332197:0:7787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a72bc7ed pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:7787:1876025593049344:0@lo:502: 00000100:00100000:0.0:1789117543.332271:0:7787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117543.332322:0:7787:0:(client.c:2715:ptlrpc_set_wait()) set 000000003825b3c1 going to sleep for 11 seconds 00000100:00100000:2.0:1789117543.333037:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593049344 00000100:00100000:2.0:1789117543.333048:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593049344 00000100:00100000:2.0:1789117543.333149:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789117543.333157:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2930e12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+17:7787:x1876025593049344:12345-0@lo:502: 00000100:00100000:2.0:1789117543.333323:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2930e12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+17:7787:x1876025593049344:12345-0@lo:502: Request processed in 166us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117543.333332:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789117543.334288:0:7787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a72bc7ed pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:7787:1876025593049344:0@lo:502: 00000020:01000000:0.0:1789117543.334335:0:7787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117543.334349:0:7787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117543.334352:0:7787:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1789117543.334356:0:7787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789117543.334360:0:7787:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:00000080:0.0:1789117543.334389:0:7787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789117543.334407:0:7787:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000d38e8aa5) 00000020:00000080:0.0:1789117543.334431:0:7787:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1789117543.334436:0:7787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789117543.334536:0:7787:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1789117543.334542:0:7787:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789117543.334551:0:7787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa253ed19be1f640 00010000:00080000:0.0:1789117543.334581:0:7787:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000295d5e22@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.130@tcp at head 00010000:00010000:0.0:1789117543.336284:0:7787:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1789117543.347508:0:7787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789117543.347525:0:7787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789117543.347575:0:7787:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789117543.347599:0:7787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa253ed19be1f647 00000100:00080000:2.0:1789117543.347610:0:7787:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789117543.347623:0:7787:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000295d5e22 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789117543.347659:0:7787:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ab0676de x1876025593049472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789117543.347685:0:7787:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1789117543.347732:0:7787:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1789117543.347802:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a72bc7ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593049728:0@lo:400: 00000100:00100000:0.0:1789117543.347882:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117543.347920:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789117543.347926:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004fc332ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593049600:0@lo:400: 00000100:00100000:1.0:1789117543.347934:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab0676de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593049472:0@lo:38: 00000100:00100000:0.0:1789117543.347956:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117543.347986:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117543.348001:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000385b95e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593049856:0@lo:400: 00000100:00100000:1.0:1789117543.348040:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593049728 00000100:00100000:1.0:1789117543.348046:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593049728 00000100:00100000:0.0:1789117543.348047:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117543.348114:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593049472 00000100:00100000:0.0:1789117543.348119:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593049472 00000100:00100000:1.0:1789117543.348120:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789117543.348131:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed751f9e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593049728:12345-0@lo:400: 00000100:00100000:0.0:1789117543.348145:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593049600 00000100:00100000:0.0:1789117543.348150:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593049600 00000100:00100000:0.0:1789117543.348176:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593049856 00000100:00100000:0.0:1789117543.348179:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593049856 00000100:00100000:1.0:1789117543.348190:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed751f9e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593049728:12345-0@lo:400: Request processed in 61us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117543.348197:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789117543.348201:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789117543.348207:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f24ae51c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593049600:12345-0@lo:400: 00000100:00100000:1.0:1789117543.348222:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789117543.348227:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9b98c01 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876025593049472:12345-0@lo:38: 00000100:00100000:0.0:1789117543.348246:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f24ae51c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593049600:12345-0@lo:400: Request processed in 41us (290us total) trans 0 rc 0/0 00010000:00080000:1.0:1789117543.348248:0:6524:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000100:00100000:0.0:1789117543.348260:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789117543.348275:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789117543.348282:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4f85e66 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593049856:12345-0@lo:400: 00000020:00000080:1.0:1789117543.348296:0:6524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa253ed19be1f64e 00000004:00100000:1.0:1789117543.348312:0:6524:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1789117543.348317:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4f85e66 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593049856:12345-0@lo:400: Request processed in 35us (270us total) trans 0 rc 0/0 00000001:00000004:1.0:1789117543.348320:0:6524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1789117543.348326:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789117543.348360:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000385b95e4 x1876025593049856/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117543.348374:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000385b95e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593049856:0@lo:400: 00010000:00080000:0.0:1789117543.348414:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000004fc332ba x1876025593049600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117543.348423:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004fc332ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593049600:0@lo:400: 00000100:00100000:0.0:1789117543.348431:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a72bc7ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593049728:0@lo:400: 00000100:00080000:3.0:1789117543.352310:0:7790:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000487bd32d x1876025593049984/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000020:01000000:2.0:1789117543.352318:0:7787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:3.0:1789117543.352331:0:7790:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b386d94a going to sleep for 0 seconds 00000020:00000080:2.0:1789117543.352331:0:7787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117543.352335:0:7787:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1789117543.352341:0:7787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117543.352346:0:7787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117543.352348:0:7787:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789117543.352351:0:7787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789117543.352353:0:7787:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789117543.352380:0:7787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9ee6289 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:7787:1876025593050112:0@lo:502: 00000100:00100000:2.0:1789117543.352466:0:7787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117543.352516:0:7787:0:(client.c:2715:ptlrpc_set_wait()) set 0000000013e7af88 going to sleep for 11 seconds 00000100:00100000:3.0:1789117543.353219:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593050112 00000100:00100000:3.0:1789117543.353230:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593050112 00000100:00100000:3.0:1789117543.353288:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789117543.353297:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3de9eff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+17:7787:x1876025593050112:12345-0@lo:502: 00000100:00100000:3.0:1789117543.353443:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3de9eff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+17:7787:x1876025593050112:12345-0@lo:502: Request processed in 147us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117543.353451:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789117543.353566:0:7787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9ee6289 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:7787:1876025593050112:0@lo:502: 00000020:01000000:0.0:1789117543.353604:0:7787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117543.353610:0:7787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117543.353613:0:7787:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789117543.353618:0:7787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1789117543.353869:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1789117543.353895:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789117543.353903:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 00000000f29bf47d/0xaa253ed19be1f62b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f632 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117543.353925:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: 00000000f29bf47d/0xaa253ed19be1f62b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f632 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117543.353935:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789117543.353937:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff962b88028000 from 1 10000000:01000000:3.0:1789117543.353940:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789117543.353969:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 00000000070856a3/0xaa253ed19be1f655 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117543.353975:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 00000000070856a3/0xaa253ed19be1f655 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117543.353983:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 00000000070856a3/0xaa253ed19be1f655 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117543.353998:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002970ab3a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593050240:0@lo:101: 00000100:00100000:3.0:1789117543.354032:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117543.354149:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b9b79e4 going to sleep for 11 seconds 00000100:00100000:0.0:1789117543.354218:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593050240 00000100:00100000:0.0:1789117543.354224:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593050240 00000100:00100000:0.0:1789117543.354249:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789117543.354254:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f022d0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593050240:12345-0@lo:101: 00010000:00010000:0.0:1789117543.354265:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117543.354277:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000099c12d13/0xaa253ed19be1f65c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f655 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117543.354297:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000099c12d13/0xaa253ed19be1f65c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f655 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117543.354305:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000099c12d13/0xaa253ed19be1f65c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f655 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117543.354313:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000099c12d13, rc 0) 00000100:00100000:0.0:1789117543.354357:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f022d0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593050240:12345-0@lo:101: Request processed in 103us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117543.354363:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789117543.356675:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002970ab3a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593050240:0@lo:101: 00010000:00010000:1.0:1789117543.356712:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 00000000070856a3/0xaa253ed19be1f655 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f65c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117543.356746:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 00000000070856a3/0xaa253ed19be1f655 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f65c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117543.356866:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002baa45b3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593050368:0@lo:501: 00000100:00100000:1.0:1789117543.356964:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117543.357019:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8b78b52 going to sleep for 11 seconds 00000100:00100000:0.0:1789117543.357763:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593050368 00000100:00100000:0.0:1789117543.357774:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593050368 00000100:00100000:0.0:1789117543.357821:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789117543.357830:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d64040d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593050368:12345-0@lo:501: 00000100:00100000:0.0:1789117543.357950:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d64040d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593050368:12345-0@lo:501: Request processed in 120us (995us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789117543.357958:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789117543.358181:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002baa45b3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593050368:0@lo:501: 10000000:01000000:1.0:1789117543.358233:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789117543.358243:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 00000000070856a3/0xaa253ed19be1f655 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f65c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117543.358255:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: 00000000070856a3/0xaa253ed19be1f655 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f65c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789117543.366404:0:6524:0:(import.c:65:import_set_state_nolock()) 0000000035301296 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789117543.366518:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9b98c01 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876025593049472:12345-0@lo:38: Request processed in 18288us (18531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117543.366534:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789117543.373951:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789117543.373973:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789117543.373984:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789117543.373991:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789117543.373996:0:3643:0:(import.c:65:import_set_state_nolock()) 00000000295d5e22 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789117543.374031:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000b386d94a): req@00000000487bd32d x1876025593049984/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117543.374084:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab0676de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593049472:0@lo:38: 00000100:00100000:1.0:1789117543.377025:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f486c218 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593050496:0@lo:41: 00000100:00100000:1.0:1789117543.377133:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117543.377409:0:7790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117543.377437:0:7790:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b386d94a going to sleep for 11 seconds 00000100:00100000:0.0:1789117543.377515:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593050496 00000100:00100000:0.0:1789117543.377522:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593050496 00000100:00100000:2.0:1789117543.377532:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593049984 00000100:00100000:2.0:1789117543.377539:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593049984 00000100:00100000:0.0:1789117543.377572:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789117543.380498:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002baa45b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3645:x1876025593050496:12345-0@lo:41: 00000004:00000024:0.0:1789117543.380541:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789117543.380914:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002baa45b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3645:x1876025593050496:12345-0@lo:41: Request processed in 431us (3780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117543.380994:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f486c218 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593050496:0@lo:41: 00000100:00100000:0.0:1789117543.386599:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789117543.386660:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789117543.386674:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f31d84ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7790:x1876025593049984:12345-0@lo:1000: 00000100:00100000:0.0:1789117543.386866:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f31d84ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7790:x1876025593049984:12345-0@lo:1000: Request processed in 198us (9458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117543.386874:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789117543.387040:0:7790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000487bd32d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7790:1876025593049984:0@lo:1000: 00000040:01000000:2.0:1789117543.387120:0:7790:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1789117543.387172:0:7790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000025d18f0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7790:1876025593050624:0@lo:1000: 00000100:00100000:2.0:1789117543.387223:0:7790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117543.387262:0:7790:0:(client.c:2715:ptlrpc_set_wait()) set 0000000027ad9f47 going to sleep for 11 seconds 00000100:00100000:0.0:1789117543.387418:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593050624 00000100:00100000:0.0:1789117543.387426:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593050624 00000100:00100000:0.0:1789117543.387483:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789117543.387490:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b292ccd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7790:x1876025593050624:12345-0@lo:1000: 00000100:00100000:0.0:1789117543.387608:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b292ccd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7790:x1876025593050624:12345-0@lo:1000: Request processed in 119us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117543.387614:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789117543.387639:0:7790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000025d18f0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7790:1876025593050624:0@lo:1000: 00000100:00100000:2.0:1789117543.387685:0:7790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000025d18f0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7790:1876025593050752:0@lo:700: 00000100:00100000:2.0:1789117543.387714:0:7790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117543.387740:0:7790:0:(client.c:2715:ptlrpc_set_wait()) set 000000005ad9d960 going to sleep for 11 seconds 00000100:00100000:0.0:1789117543.387788:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593050752 00000100:00100000:0.0:1789117543.387793:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593050752 00000100:00100000:0.0:1789117543.387827:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789117543.387835:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000869c0fb0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7790:x1876025593050752:12345-0@lo:700: 00000100:00100000:0.0:1789117543.387884:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000869c0fb0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7790:x1876025593050752:12345-0@lo:700: Request processed in 51us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117543.387890:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117543.388032:0:7790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000025d18f0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7790:1876025593050752:0@lo:700: 00000100:00100000:2.0:1789117543.388193:0:7790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000025d18f0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7790:1876025593050880:0@lo:1000: 00000100:00100000:2.0:1789117543.388220:0:7790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117543.388238:0:7790:0:(client.c:2715:ptlrpc_set_wait()) set 0000000075b8df85 going to sleep for 11 seconds 00000100:00100000:0.0:1789117543.388529:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593050880 00000100:00100000:0.0:1789117543.388534:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593050880 00000100:00100000:0.0:1789117543.388568:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789117543.388575:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054315abb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7790:x1876025593050880:12345-0@lo:1000: 00000100:00100000:0.0:1789117543.389002:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054315abb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7790:x1876025593050880:12345-0@lo:1000: Request processed in 426us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117543.389009:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789117543.391709:0:7790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000025d18f0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7790:1876025593050880:0@lo:1000: 00000004:00080000:1.0:1789117543.391783:0:7790:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000005ad9d960 with version 0 00000020:00100000:1.0:1789117543.391808:0:7790:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789117543.391815:0:7790:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000002dcc84e2 x1876025593051136/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789117543.391835:0:7790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002dcc84e2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7790:1876025593051136:0@lo:1000: 00000100:00100000:1.0:1789117543.391907:0:7790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117543.391951:0:7790:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ee21ff6a going to sleep for 11 seconds 00000100:00100000:3.0:1789117543.391965:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593051136 00000100:00100000:3.0:1789117543.391973:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593051136 00000100:00100000:3.0:1789117543.392025:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789117543.392034:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf69415d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7790:x1876025593051136:12345-0@lo:1000: 00000001:00080000:0.0:1789117543.394944:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1789117543.394977:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789117543.395640:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf69415d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7790:x1876025593051136:12345-0@lo:1000: Request processed in 3601us (3728us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789117543.395653:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1789117543.395796:0:7790:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1789117543.395801:0:7790:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789117543.395816:0:7790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002dcc84e2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7790:1876025593051136:0@lo:1000: 00000100:00100000:0.0:1789117543.395900:0:7790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a41c26a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7790:1876025593051264:0@lo:1000: 00000100:00100000:0.0:1789117543.395941:0:7790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117543.395981:0:7790:0:(client.c:2715:ptlrpc_set_wait()) set 0000000049def01d going to sleep for 11 seconds 00000100:00100000:1.0:1789117543.396031:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593051264 00000100:00100000:1.0:1789117543.396040:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593051264 00000100:00100000:1.0:1789117543.396123:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789117543.396132:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b6ca10e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7790:x1876025593051264:12345-0@lo:1000: 00000100:00100000:1.0:1789117543.396216:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b6ca10e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7790:x1876025593051264:12345-0@lo:1000: Request processed in 87us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117543.396222:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789117543.396434:0:7790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a41c26a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7790:1876025593051264:0@lo:1000: 00000040:00080000:2.0:1789117543.396455:0:7790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1789117543.396496:0:7790:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000fdd248c9 with version 1 00000004:00080000:1.0:1789117543.396635:0:7788:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000007fc21abe version 1 rpc_version 1 00000020:00100000:1.0:1789117543.396655:0:7788:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789117543.396662:0:7788:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000008e7c5499 x1876025593051520/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789117543.396677:0:7788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008e7c5499 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7788:1876025593051520:0@lo:1000: 00000100:00100000:1.0:1789117543.396707:0:7788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117543.396729:0:7788:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ee21ff6a going to sleep for 11 seconds 00000100:00100000:0.0:1789117543.396774:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593051520 00000100:00100000:0.0:1789117543.396778:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593051520 00000100:00100000:0.0:1789117543.396808:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789117543.396813:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5c5003d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7788:x1876025593051520:12345-0@lo:1000: 00010000:00010000:0.0:1789117543.397441:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789117543.398603:0:7790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789117543.398670:0:7790:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789117543.398675:0:7790:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:3.0:1789117543.414251:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1789117543.414636:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5c5003d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7788:x1876025593051520:12345-0@lo:1000: Request processed in 17819us (17925us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789117543.414649:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:2.0:1789117543.414746:0:7788:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1789117543.414751:0:7788:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789117543.414766:0:7788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008e7c5499 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7788:1876025593051520:0@lo:1000: 00010000:00010000:1.0:1789117544.422559:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117545.445474:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117545.829376:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789117545.829414:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000022ba8067 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593051648:0@lo:41: 00000100:00100000:2.0:1789117545.829531:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117545.829652:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593051648 00000100:00100000:0.0:1789117545.829662:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593051648 00000100:00100000:0.0:1789117545.829729:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789117545.829739:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000025d18f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593051648:12345-0@lo:41: 00000004:00000024:0.0:1789117545.829785:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789117545.829842:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000025d18f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593051648:12345-0@lo:41: Request processed in 104us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117545.829850:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789117545.829904:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000022ba8067 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593051648:0@lo:41: 00000020:00000004:0.0:1789117546.368845:0:7879:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789117546.371129:0:7879:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789117546.469449:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117547.493274:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789117547.802531:0:7927:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd4e05cb20 20000000:00000080:0.0:1789117547.802552:0:7927:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff962bbf706800 uarg=0000000000000000 20000000:01000000:0.0:1789117547.802596:0:7927:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789117547.802605:0:7927:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789117547.802611:0:7927:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789117547.802692:0:7927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1789117547.802707:0:7927:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789117547.810903:0:7927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789117547.812485:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789117547.812545:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789117547.812569:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789117547.812604:0:7927:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789117547.812632:0:7927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f663 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117547.812657:0:7927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001f86278f/0xaa253ed19be1f4e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f4db expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117547.812675:0:7927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000764ac3bc/0xaa253ed19be1f5d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f5c9 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117547.812683:0:7927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f663 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117547.812742:0:7927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000764ac3bc/0xaa253ed19be1f5d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f5c9 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117547.812759:0:7927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000764ac3bc/0xaa253ed19be1f5d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f5c9 expref: 17 pid: 6514 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117547.812792:0:7927:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003c0b44ce pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1876025593051776:0@lo:104: 00000100:00100000:0.0:1789117547.816214:0:7927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117547.816320:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789117547.816350:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593051776 00000100:00100000:1.0:1789117547.816361:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593051776 00010000:00010000:0.0:1789117547.816374:0:7927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001f86278f/0xaa253ed19be1f4e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f4db expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117547.816413:0:7927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001f86278f/0xaa253ed19be1f4e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f4db expref: 17 pid: 6514 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117547.816431:0:7927:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005941e42f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1876025593051904:0@lo:104: 00000100:00100000:1.0:1789117547.816440:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789117547.816451:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069df613d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+3:7927:x1876025593051776:12345-0@lo:104: 00010000:00010000:1.0:1789117547.816475:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: 0000000020f25d6a/0xaa253ed19be1f5c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f5d0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117547.816494:0:7927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117547.816508:0:7927:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e3919df2 going to sleep for 11 seconds 00010000:00010000:1.0:1789117547.816598:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789117547.816604:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069df613d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+3:7927:x1876025593051776:12345-0@lo:104: Request processed in 157us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117547.816611:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789117547.816646:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593051904 00000100:00100000:1.0:1789117547.816650:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593051904 00000100:00100000:1.0:1789117547.816671:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789117547.816675:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063111a81 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+3:7927:x1876025593051904:12345-0@lo:104: 00010000:00010000:1.0:1789117547.816682:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: 00000000846df2e1/0xaa253ed19be1f4db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f4e2 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117547.816711:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789117547.816715:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063111a81 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+3:7927:x1876025593051904:12345-0@lo:104: Request processed in 40us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117547.816720:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1789117547.816735:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789117547.816740:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: 0000000020f25d6a/0xaa253ed19be1f5c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f5d0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117547.816746:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000020f25d6a already unused, calling callback (00000000f070af84) 10000000:00010000:1.0:1789117547.816765:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: 0000000020f25d6a/0xaa253ed19be1f5c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f5d0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117547.816772:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: 0000000020f25d6a/0xaa253ed19be1f5c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f5d0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117547.816778:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: 0000000020f25d6a/0xaa253ed19be1f5c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f5d0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117547.816783:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789117547.816818:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: 0000000020f25d6a/0xaa253ed19be1f5c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f5d0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117547.816825:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117547.816842:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: 0000000020f25d6a/0xaa253ed19be1f5c9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f5d0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117547.816848:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: 0000000020f25d6a/0xaa253ed19be1f5c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f5d0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117547.816860:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117547.816862:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: 00000000846df2e1/0xaa253ed19be1f4db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f4e2 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117547.816867:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000846df2e1 already unused, calling callback (00000000f070af84) 10000000:00010000:1.0:1789117547.816868:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: 00000000846df2e1/0xaa253ed19be1f4db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f4e2 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117547.816873:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: 00000000846df2e1/0xaa253ed19be1f4db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f4e2 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117547.816887:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: 00000000846df2e1/0xaa253ed19be1f4db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f4e2 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117547.816891:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789117547.816902:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: 00000000846df2e1/0xaa253ed19be1f4db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f4e2 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117547.816907:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117547.816917:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: 00000000846df2e1/0xaa253ed19be1f4db lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f4e2 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117547.816922:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: 00000000846df2e1/0xaa253ed19be1f4db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f4e2 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117547.816932:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117547.816933:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117547.816934:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117547.816939:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117547.816957:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b92e532e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593052032:0@lo:103: 00000100:00100000:1.0:1789117547.816987:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117547.817018:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789117547.817024:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f74c5960 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593052160:0@lo:103: 00000100:00100000:1.0:1789117547.817041:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117547.817082:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593052032 00000100:00100000:1.0:1789117547.817086:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593052032 00010000:00010000:1.0:1789117547.817101:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000764ac3bc/0xaa253ed19be1f5d0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f5c9 expref: 18 pid: 6514 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117547.817118:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593052160 00000100:00100000:1.0:1789117547.817126:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593052160 00010000:00010000:1.0:1789117547.817142:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001f86278f/0xaa253ed19be1f4e2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f4db expref: 19 pid: 6514 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117547.817162:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789117547.817167:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001bd29778 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+19:3647:x1876025593052032:12345-0@lo:103: 00010000:00010000:1.0:1789117547.817177:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117547.817181:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000764ac3bc/0xaa253ed19be1f5d0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f5c9 expref: 19 pid: 6514 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117547.817190:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000764ac3bc/0xaa253ed19be1f5d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f5c9 expref: 19 pid: 6514 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117547.817207:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117547.817234:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001bd29778 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+19:3647:x1876025593052032:12345-0@lo:103: Request processed in 68us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117547.817240:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789117547.817253:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789117547.817258:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000720e58f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+18:3645:x1876025593052160:12345-0@lo:103: 00010000:00010000:1.0:1789117547.817265:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117547.817268:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001f86278f/0xaa253ed19be1f4e2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f4db expref: 18 pid: 6514 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117547.817275:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001f86278f/0xaa253ed19be1f4e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f4db expref: 18 pid: 6514 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117547.817285:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f663 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117547.817293:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f663 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117547.817310:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f663 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117547.817316:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f663 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117547.817322:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f663 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117547.817327:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f663 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117547.817333:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000060e2d30f already unused, calling callback (00000000ed6530dd) 00010000:00010000:1.0:1789117547.817336:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f663 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117547.817342:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f663 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117547.817349:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f663 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117547.817357:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117547.817384:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000720e58f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+18:3645:x1876025593052160:12345-0@lo:103: Request processed in 126us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117547.817402:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789117547.817440:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f74c5960 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593052160:0@lo:103: 00000100:00100000:1.0:1789117547.817462:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b92e532e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593052032:0@lo:103: 00010000:00010000:0.0:1789117547.819759:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000764ac3bc/0xaa253ed19be1f5d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f5c9 expref: 17 pid: 6514 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117547.819786:0:7927:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003c0b44ce pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1876025593051776:0@lo:104: 00010000:00010000:0.0:1789117547.819801:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001f86278f/0xaa253ed19be1f4e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f4db expref: 16 pid: 6514 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117547.819840:0:7927:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005941e42f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1876025593051904:0@lo:104: 00010000:00010000:0.0:1789117547.819884:0:7927:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f663 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117547.819896:0:7927:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f663 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117547.819903:0:7927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f663 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117547.819910:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000060e2d30f/0xaa253ed19be1f663 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117548.389408:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117548.389438:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000460b4820 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593052288:0@lo:41: 00000100:00100000:3.0:1789117548.389521:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117548.389629:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593052288 00000100:00100000:1.0:1789117548.389646:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593052288 00000100:00100000:1.0:1789117548.391028:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789117548.391048:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a85f41e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593052288:12345-0@lo:41: 00000004:00000024:1.0:1789117548.391120:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789117548.391224:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a85f41e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593052288:12345-0@lo:41: Request processed in 185us (1702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117548.391231:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789117548.397340:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000460b4820 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593052288:0@lo:41: 00000100:00100000:1.0:1789117548.400463:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e375919b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593052416:0@lo:400: 00000100:00100000:1.0:1789117548.400546:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117548.400609:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117548.400615:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008347ac69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593052544:0@lo:400: 00000100:00100000:1.0:1789117548.400641:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117548.400676:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593052544 00000100:00100000:1.0:1789117548.400682:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593052544 00000100:00100000:1.0:1789117548.400725:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789117548.400733:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082c730eb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593052544:12345-0@lo:400: 00000100:00100000:1.0:1789117548.400783:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082c730eb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593052544:12345-0@lo:400: Request processed in 51us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117548.400790:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789117548.400828:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008347ac69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593052544:0@lo:400: 00000100:00100000:1.0:1789117548.400850:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eece9485 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593052672:0@lo:400: 00000100:00100000:1.0:1789117548.400885:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117548.400914:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593052416 00000100:00100000:1.0:1789117548.400918:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593052416 00000100:00100000:1.0:1789117548.400941:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593052672 00000100:00100000:1.0:1789117548.400944:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593052672 00000100:00100000:1.0:1789117548.400967:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789117548.400972:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000460b4820 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593052416:12345-0@lo:400: 00000100:00100000:1.0:1789117548.401005:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000460b4820 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593052416:12345-0@lo:400: Request processed in 33us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117548.401010:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789117548.401020:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789117548.401025:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b92e532e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593052672:12345-0@lo:400: 00000100:00100000:1.0:1789117548.401070:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b92e532e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593052672:12345-0@lo:400: Request processed in 27us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117548.401077:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789117548.401103:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e375919b x1876025593052416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117548.401114:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e375919b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593052416:0@lo:400: 00010000:00080000:1.0:1789117548.401138:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000eece9485 x1876025593052672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117548.401146:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eece9485 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593052672:0@lo:400: 00010000:00010000:0.0:1789117548.519371:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117549.553179:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789117550.245214:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789117550.245228:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962bbcf27000 from 1 10000000:01000000:1.0:1789117550.245235:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789117550.245308:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 00000000aa0fb10b/0xaa253ed19be1f66a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117550.245325:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 00000000aa0fb10b/0xaa253ed19be1f66a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117550.245338:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 00000000aa0fb10b/0xaa253ed19be1f66a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117550.245396:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f723829 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593052800:0@lo:101: 00000100:00100000:1.0:1789117550.245484:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117550.245551:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 000000002f71fde7 going to sleep for 11 seconds 00000100:00100000:1.0:1789117550.245578:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593052800 00000100:00100000:1.0:1789117550.245587:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593052800 00000100:00100000:1.0:1789117550.245804:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789117550.245816:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c08a9f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+16:6517:x1876025593052800:12345-0@lo:101: 00010000:00010000:1.0:1789117550.245943:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117550.245959:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000ba23cf8/0xaa253ed19be1f671 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f66a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117550.245986:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000ba23cf8/0xaa253ed19be1f671 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f66a expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117550.245996:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000ba23cf8/0xaa253ed19be1f671 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f66a expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117550.246006:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000ba23cf8, rc 0) 00000100:00100000:1.0:1789117550.246051:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c08a9f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593052800:12345-0@lo:101: Request processed in 239us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117550.246087:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789117550.246144:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f723829 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593052800:0@lo:101: 00010000:00010000:1.0:1789117550.246160:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 00000000aa0fb10b/0xaa253ed19be1f66a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f671 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117550.246168:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 00000000aa0fb10b/0xaa253ed19be1f66a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f671 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117550.246266:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f723829 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593052928:0@lo:501: 00000100:00100000:1.0:1789117550.246371:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117550.246386:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 000000002f71fde7 going to sleep for 11 seconds 00000100:00100000:3.0:1789117550.246592:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593052928 00000100:00100000:3.0:1789117550.246598:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593052928 00000100:00100000:3.0:1789117550.246686:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789117550.246694:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d9df30b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593052928:12345-0@lo:501: 00000100:00100000:3.0:1789117550.246991:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d9df30b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593052928:12345-0@lo:501: Request processed in 297us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117550.246999:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789117550.248173:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f723829 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593052928:0@lo:501: 00000100:00100000:1.0:1789117550.248230:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f723829 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593053056:0@lo:503: 00000100:00100000:1.0:1789117550.248610:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117550.248740:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 000000002f71fde7 going to sleep for 11 seconds 00000100:00100000:0.0:1789117550.248956:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593053056 00000100:00100000:0.0:1789117550.248964:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593053056 00000100:00100000:0.0:1789117550.249017:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789117550.249025:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071459598 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593053056:12345-0@lo:503: 00000100:00100000:0.0:1789117550.249175:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071459598 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593053056:12345-0@lo:503: Request processed in 150us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117550.249183:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789117550.249372:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f723829 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593053056:0@lo:503: 00000100:00100000:1.0:1789117550.250485:0:7999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f723829 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:7999:1876025593053184:0@lo:502: 00000100:00100000:1.0:1789117550.250999:0:7999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117550.251050:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593053184 00000100:00100000:1.0:1789117550.251082:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593053184 00000100:00100000:1.0:1789117550.251132:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789117550.251141:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032b32747 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+17:7999:x1876025593053184:12345-0@lo:502: 00000100:00100000:1.0:1789117550.253383:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032b32747 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+17:7999:x1876025593053184:12345-0@lo:502: Request processed in 130us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117550.253405:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789117550.254379:0:7999:0:(client.c:2715:ptlrpc_set_wait()) set 000000002cd42433 going to sleep for 11 seconds 00000100:00100000:1.0:1789117550.254441:0:7999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f723829 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:7999:1876025593053184:0@lo:502: 00000020:01000000:1.0:1789117550.254504:0:7999:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789117550.255425:0:7999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117550.255431:0:7999:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789117550.255440:0:7999:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962bbcf27000 00000020:00000080:1.0:1789117550.255443:0:7999:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789117550.255971:0:7999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf774000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:7999:1876025593053312:0@lo:502: 00000100:00100000:1.0:1789117550.256267:0:7999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117550.256719:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593053312 00000100:00100000:3.0:1789117550.256731:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593053312 00000100:00100000:1.0:1789117550.256940:0:7999:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b600 going to sleep for 11 seconds 00000100:00100000:3.0:1789117550.257032:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789117550.257045:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+17:7999:x1876025593053312:12345-0@lo:502: 00000100:00100000:0.0:1789117550.257656:0:7999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf774000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:7999:1876025593053312:0@lo:502: 00000020:01000000:0.0:1789117550.257705:0:7999:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117550.257714:0:7999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117550.257716:0:7999:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789117550.257722:0:7999:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000100:00100000:3.0:1789117550.258418:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+17:7999:x1876025593053312:12345-0@lo:502: Request processed in 226us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117550.258433:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000020:01000000:2.0:1789117550.259893:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789117550.259935:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789117550.259960:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bc20f4200/0xaa253ed19be1f66a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f671 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117550.259974:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962bc20f4200/0xaa253ed19be1f66a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f671 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117550.259988:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789117550.260007:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962b9832f800 from 1 10000000:01000000:2.0:1789117550.260011:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789117550.260096:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b89b68600/0xaa253ed19be1f678 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117550.260106:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b89b68600/0xaa253ed19be1f678 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117550.260118:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b89b68600/0xaa253ed19be1f678 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117550.260149:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593053440:0@lo:101: 00000100:00100000:2.0:1789117550.260242:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117550.260727:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593053440 00000100:00100000:0.0:1789117550.260738:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593053440 00000100:00100000:0.0:1789117550.261429:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789117550.261442:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593053440:12345-0@lo:101: 00010000:00010000:0.0:1789117550.261463:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117550.261483:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962baea9bc00/0xaa253ed19be1f67f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f678 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117550.261939:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bad82a6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789117550.261985:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962baea9bc00/0xaa253ed19be1f67f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f678 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117550.262001:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962baea9bc00/0xaa253ed19be1f67f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f678 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117550.262013:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962baea9bc00, rc 0) 00000100:00100000:0.0:1789117550.262143:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593053440:12345-0@lo:101: Request processed in 703us (1901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117550.262152:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789117550.262490:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593053440:0@lo:101: 00010000:00010000:3.0:1789117550.262583:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b89b68600/0xaa253ed19be1f678 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f67f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117550.262596:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b89b68600/0xaa253ed19be1f678 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f67f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117550.262813:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a312c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593053568:0@lo:501: 00000100:00100000:3.0:1789117550.262978:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117550.263019:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d78600 going to sleep for 11 seconds 00000100:00100000:0.0:1789117550.263410:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593053568 00000100:00100000:0.0:1789117550.263418:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593053568 00000100:00100000:0.0:1789117550.263457:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789117550.263466:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593053568:12345-0@lo:501: 00000100:00100000:0.0:1789117550.264710:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593053568:12345-0@lo:501: Request processed in 1237us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117550.264724:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789117550.268458:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a312c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593053568:0@lo:501: 00000100:00100000:3.0:1789117550.268936:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a312c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593053696:0@lo:503: 00000100:00100000:3.0:1789117550.269106:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117550.269234:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d78600 going to sleep for 11 seconds 00000100:00100000:2.0:1789117550.274232:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593053696 00000100:00100000:2.0:1789117550.274257:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593053696 00000100:00100000:2.0:1789117550.275653:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789117550.275678:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593053696:12345-0@lo:503: 00000100:00100000:2.0:1789117550.275935:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593053696:12345-0@lo:503: Request processed in 266us (6829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117550.275943:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789117550.276162:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a312c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593053696:0@lo:503: 00000100:00100000:3.0:1789117550.276529:0:8000:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a312c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:8000:1876025593053824:0@lo:502: 00000100:00100000:3.0:1789117550.276589:0:8000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117550.282146:0:8000:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d78cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117550.286978:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593053824 00000100:00100000:0.0:1789117550.287000:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593053824 00000100:00100000:0.0:1789117550.287104:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789117550.287119:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+18:8000:x1876025593053824:12345-0@lo:502: 00000100:00100000:0.0:1789117550.287895:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+18:8000:x1876025593053824:12345-0@lo:502: Request processed in 778us (11303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117550.287914:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789117550.288236:0:8000:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a312c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:8000:1876025593053824:0@lo:502: 00000020:01000000:0.0:1789117550.288293:0:8000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117550.288308:0:8000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117550.288389:0:8000:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789117550.288469:0:8000:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962b9832f800 00000020:00000080:0.0:1789117550.288474:0:8000:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789117550.288534:0:8000:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ef0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:8000:1876025593053952:0@lo:502: 00000100:00100000:0.0:1789117550.288603:0:8000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117550.288637:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593053952 00000100:00100000:0.0:1789117550.288643:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593053952 00000100:00100000:0.0:1789117550.288686:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789117550.288695:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+18:8000:x1876025593053952:12345-0@lo:502: 00000100:00100000:0.0:1789117550.288786:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+18:8000:x1876025593053952:12345-0@lo:502: Request processed in 91us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117550.288794:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789117550.288843:0:8000:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84b149c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117550.288856:0:8000:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ef0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:8000:1876025593053952:0@lo:502: 00000020:01000000:0.0:1789117550.288921:0:8000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117550.288926:0:8000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117550.288928:0:8000:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789117550.288931:0:8000:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789117550.290197:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789117550.290240:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789117550.290254:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b89b68600/0xaa253ed19be1f678 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f67f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117550.290282:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b89b68600/0xaa253ed19be1f678 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f67f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117550.566264:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117550.950564:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593054080:0@lo:41: 00000100:00100000:0.0:1789117550.950665:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117550.952310:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593054080 00000100:00100000:0.0:1789117550.952337:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593054080 00000100:00100000:0.0:1789117550.952438:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789117550.952463:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593054080:12345-0@lo:41: 00000004:00000024:0.0:1789117550.952513:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1789117550.952603:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593054080:12345-0@lo:41: Request processed in 142us (1938us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117550.952611:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789117550.952683:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593054080:0@lo:41: 00010000:00010000:1.0:1789117551.592936:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117552.613514:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117553.509533:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf776580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593054208:0@lo:41: 00000100:00100000:2.0:1789117553.509609:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117553.510011:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593054208 00000100:00100000:1.0:1789117553.510021:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593054208 00000100:00100000:1.0:1789117553.510104:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789117553.510116:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593054208:12345-0@lo:41: 00000004:00000024:1.0:1789117553.510161:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789117553.510215:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593054208:12345-0@lo:41: Request processed in 102us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117553.510223:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789117553.510295:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf776580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593054208:0@lo:41: 00000100:00100000:3.0:1789117553.516712:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593054336:0@lo:400: 00000100:00100000:3.0:1789117553.516788:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117553.516891:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789117553.516898:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593054720:0@lo:400: 00000100:00100000:3.0:1789117553.516926:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117553.516963:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593054720 00000100:00100000:3.0:1789117553.516970:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593054720 00000100:00100000:3.0:1789117553.517014:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789117553.517025:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593054720:12345-0@lo:400: 00000100:00100000:3.0:1789117553.517117:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593054720:12345-0@lo:400: Request processed in 94us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117553.517124:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789117553.517161:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962bbf6eed00 x1876025593054720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117553.517184:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593054720:0@lo:400: 00000100:00100000:3.0:1789117553.517219:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593054464:0@lo:400: 00000100:00100000:3.0:1789117553.517244:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117553.517265:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117553.517269:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593054592:0@lo:400: 00000100:00100000:3.0:1789117553.517305:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117553.517331:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593054336 00000100:00100000:3.0:1789117553.517335:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593054336 00000100:00100000:3.0:1789117553.517358:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789117553.517364:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+18:3647:x1876025593054336:12345-0@lo:400: 00000100:00100000:3.0:1789117553.517568:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+18:3647:x1876025593054336:12345-0@lo:400: Request processed in 203us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117553.517575:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789117553.517604:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593054464 00000100:00100000:3.0:1789117553.517608:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593054464 00000100:00100000:3.0:1789117553.517631:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789117553.517637:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593054464:12345-0@lo:400: 00000100:00100000:3.0:1789117553.517671:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593054464:12345-0@lo:400: Request processed in 34us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117553.517677:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789117553.517703:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962bbf6ed680 x1876025593054464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117553.517720:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593054464:0@lo:400: 00000100:00100000:3.0:1789117553.517745:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593054592 00000100:00100000:3.0:1789117553.517749:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593054592 00000100:00100000:3.0:1789117553.517773:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789117553.517779:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a30780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593054592:12345-0@lo:400: 00000100:00100000:3.0:1789117553.517876:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a30780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593054592:12345-0@lo:400: Request processed in 96us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117553.517883:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789117553.517910:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593054336:0@lo:400: 00000100:00100000:0.0:1789117553.518240:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593054592:0@lo:400: 00010000:00010000:1.0:1789117553.638288:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117554.669536:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117555.685270:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117556.070384:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789117556.070413:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593054848:0@lo:41: 00000100:00100000:2.0:1789117556.070496:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117556.070617:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593054848 00000100:00100000:0.0:1789117556.070626:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593054848 00000100:00100000:0.0:1789117556.070682:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789117556.070691:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593054848:12345-0@lo:41: 00000004:00000024:0.0:1789117556.070743:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1789117556.070805:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593054848:12345-0@lo:41: Request processed in 115us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117556.070813:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789117556.070954:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593054848:0@lo:41: 00010000:00010000:1.0:1789117556.710254:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117557.738171:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117558.630301:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789117558.630405:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593055104:0@lo:400: 00000100:00100000:1.0:1789117558.630427:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf774780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593055232:0@lo:400: 00000100:00100000:3.0:1789117558.630474:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593055488:0@lo:400: 00000100:00100000:2.0:1789117558.634375:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593055360:0@lo:400: 00000100:00100000:1.0:1789117558.634558:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117558.637524:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117558.637599:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593054976:0@lo:41: 00000100:00100000:0.0:1789117558.638171:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117558.638238:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf777c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593055616:0@lo:400: 00000100:00100000:0.0:1789117558.638272:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117558.638535:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593055104 00000100:00100000:1.0:1789117558.638545:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593055104 00000100:00100000:1.0:1789117558.638610:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789117558.638621:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:3645:x1876025593055104:12345-0@lo:400: 00000100:00100000:1.0:1789117558.638689:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:3645:x1876025593055104:12345-0@lo:400: Request processed in 69us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117558.638698:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789117558.638993:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593054976 00000100:00100000:0.0:1789117558.638997:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593054976 00000100:00100000:0.0:1789117558.639021:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593055616 00000100:00100000:0.0:1789117558.639032:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593055616 00000100:00100000:0.0:1789117558.639048:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789117558.639081:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876025593054976:12345-0@lo:41: 00000004:00000024:0.0:1789117558.639113:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789117558.639149:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876025593054976:12345-0@lo:41: Request processed in 95us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117558.639155:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789117558.639169:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789117558.639175:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593055616:12345-0@lo:400: 00000100:00100000:0.0:1789117558.639215:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593055616:12345-0@lo:400: Request processed in 40us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117558.639222:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789117558.639271:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf777c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593055616:0@lo:400: 00000100:00100000:0.0:1789117558.639282:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593055104:0@lo:400: 00000100:00100000:0.0:1789117558.639300:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593054976:0@lo:41: 00000100:00100000:0.0:1789117558.641141:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593055232 00000100:00100000:0.0:1789117558.641154:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593055232 00000100:00100000:0.0:1789117558.641229:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789117558.641239:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf776580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593055232:12345-0@lo:400: 00000100:00100000:0.0:1789117558.641974:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf776580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593055232:12345-0@lo:400: Request processed in 734us (7414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117558.641983:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789117558.642047:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962bbf774780 x1876025593055232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117558.642090:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf774780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593055232:0@lo:400: 00000100:00100000:3.0:1789117558.654075:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117558.654120:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593055488 00000100:00100000:1.0:1789117558.654130:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593055488 00000100:00100000:1.0:1789117558.654207:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789117558.654219:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593055488:12345-0@lo:400: 00000100:00100000:1.0:1789117558.654309:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593055488:12345-0@lo:400: Request processed in 93us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117558.654324:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789117558.654348:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962bbf7752c0 x1876025593055488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117558.654364:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593055488:0@lo:400: 00000100:00100000:2.0:1789117558.655342:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117558.655403:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593055360 00000100:00100000:1.0:1789117558.655409:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593055360 00000100:00100000:1.0:1789117558.655452:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789117558.655460:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593055360:12345-0@lo:400: 00000100:00100000:1.0:1789117558.655515:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593055360:12345-0@lo:400: Request processed in 57us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117558.655522:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789117558.655753:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593055360:0@lo:400: 00010000:00010000:0.0:1789117558.760253:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117559.782342:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789117559.931624:0:8427:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789117559.931631:0:8427:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789117559.931632:0:8427:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789117559.933002:0:8427:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff962bbf4b3000 00000020:01000004:1.0:1789117559.933032:0:8427:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789117559.933050:0:8427:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789117559.933951:0:8427:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff962bbd2b3490) 00000020:00000080:1.0:1789117559.933978:0:8427:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789117560.087221:0:8427:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789117560.087741:0:8427:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1789117560.142586:0:8427:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789117560.145824:0:8427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789117560.146804:0:8427:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789117560.146825:0:8427:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xaa253ed19be1f68d 00000020:01000004:1.0:1789117560.146921:0:8427:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789117560.146952:0:8427:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.130@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789117560.146957:0:8427:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789117560.146966:0:8427:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789117560.146973:0:8427:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789117560.147007:0:8427:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff962bbfac9a48) 00000020:00000080:1.0:1789117560.147023:0:8427:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:1.0:1789117560.154818:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789117560.156985:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789117560.156998:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789117560.161002:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789117560.161020:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789117560.192892:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789117560.192918:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789117560.199741:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789117560.199968:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789117560.199976:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789117560.202715:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789117560.202731:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789117560.275387:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789117560.275733:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789117560.275741:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789117560.288376:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789117560.288402:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789117560.290575:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789117560.290592:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789117560.302750:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789117560.303263:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789117560.303283:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789117560.304762:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789117560.304775:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789117560.371044:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789117560.371309:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789117560.371315:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789117560.376494:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789117560.376518:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789117560.377664:0:8427:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789117560.377707:0:8427:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1789117560.377715:0:8427:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.130@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789117560.461808:0:8427:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789117560.461848:0:8427:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.130@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789117560.461852:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789117560.461854:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789117560.461855:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789117560.461857:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789117560.461858:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789117560.461859:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789117560.461860:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789117560.461863:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789117560.461864:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789117560.461866:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789117560.461867:0:8427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789117560.461871:0:8427:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789117560.461873:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789117560.461874:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789117560.461876:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789117560.461877:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789117560.461878:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789117560.461879:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789117560.461880:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789117560.461881:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789117560.461883:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789117560.461884:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789117560.461885:0:8427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789117560.461918:0:8427:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789117560.461938:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7a7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593055744:0@lo:253: 00000100:00100000:3.0:1789117560.469973:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117560.470116:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f66e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789117560.470124:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593055744 00000100:00100000:0.0:1789117560.470143:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593055744 00000100:00100000:0.0:1789117560.470255:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789117560.470267:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+18:8427:x1876025593055744:12345-0@lo:253: 20000000:01000000:0.0:1789117560.470307:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789117560.470321:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1789117560.470327:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1789117560.470331:0:6514:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1789117560.470655:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789117560.470866:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1789117560.470881:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1789117560.470900:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1789117560.470906:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1789117560.470920:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1789117560.470935:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1789117560.471025:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1789117560.471040:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.130@tcp 20000000:01000000:0.0:1789117560.471043:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.130@tcp (null) (null) (null) 00000040:00080000:0.0:1789117560.471085:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1789117560.471092:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789117560.471107:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1789117560.471113:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.130@tcp (null) (null) 00000040:00080000:0.0:1789117560.471125:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1789117560.471130:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789117560.471143:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1789117560.471174:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1789117560.471248:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1789117560.471259:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.130@tcp 20000000:01000000:0.0:1789117560.471261:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.130@tcp (null) (null) (null) 00000040:00080000:0.0:1789117560.471275:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1789117560.471280:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789117560.471292:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1789117560.471297:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.204.130@tcp (null) (null) 00000040:00080000:0.0:1789117560.471322:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1789117560.471328:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789117560.471342:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1789117560.471374:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1789117560.471730:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1789117560.471740:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.130@tcp 20000000:01000000:0.0:1789117560.471742:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.130@tcp (null) (null) (null) 00000040:00080000:0.0:1789117560.471757:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1789117560.471762:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789117560.471776:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1789117560.471781:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.130@tcp (null) (null) 00000040:00080000:0.0:1789117560.471793:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1789117560.471798:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789117560.471809:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1789117560.471823:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1789117560.471834:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789117560.471836:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789117560.471840:0:6514:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789117560.471880:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789117560.471882:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789117560.476773:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1789117560.476959:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1789117560.476978:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1789117560.477294:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1789117560.477336:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1789117560.477353:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1789117560.477365:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789117560.477368:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789117560.478354:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1789117560.478391:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1789117560.478408:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1789117560.478636:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1789117560.478658:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1789117560.478674:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:0.0:1789117560.478684:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789117560.478686:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789117560.479177:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1789117560.479197:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1789117560.479213:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789117560.479489:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789117560.479512:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789117560.479527:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1789117560.479536:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789117560.479540:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789117560.485812:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1789117560.486434:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1789117560.486477:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1789117560.486491:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:1.0:1789117560.486507:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789117560.486529:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be1f69b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.486547:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962bbbc11600/0xaa253ed19be1f567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f560 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.486554:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962bc20f4c00/0xaa253ed19be1f5de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f5d7 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.486561:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962bbbc11a00/0xaa253ed19be1f616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f60f expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.486567:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b813daa00/0xaa253ed19be1f632 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f62b expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.486574:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962baea9b600/0xaa253ed19be1f65c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f655 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.486582:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be1f69b lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.486628:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962baea9b600/0xaa253ed19be1f65c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f655 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.486646:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962baea9b600/0xaa253ed19be1f65c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f655 expref: 18 pid: 6513 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117560.486662:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf774780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593055872:0@lo:104: 00000100:00100000:1.0:1789117560.486749:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789117560.486836:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b813daa00/0xaa253ed19be1f632 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f62b expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.486845:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962b813daa00/0xaa253ed19be1f632 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f62b expref: 18 pid: 6512 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117560.486854:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf774000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593056000:0@lo:104: 00000100:00100000:1.0:1789117560.486876:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789117560.486907:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962bbbc11a00/0xaa253ed19be1f616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f60f expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.486915:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962bbbc11a00/0xaa253ed19be1f616 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f60f expref: 18 pid: 6513 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117560.486923:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf775a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593056128:0@lo:104: 00000100:00100000:1.0:1789117560.486941:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789117560.486954:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962bc20f4c00/0xaa253ed19be1f5de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f5d7 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.486962:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962bc20f4c00/0xaa253ed19be1f5de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f5d7 expref: 18 pid: 6512 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117560.486969:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7752c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593056256:0@lo:104: 00000100:00100000:1.0:1789117560.487001:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789117560.487015:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962bbbc11600/0xaa253ed19be1f567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f560 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.487024:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962bbbc11600/0xaa253ed19be1f567 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f560 expref: 18 pid: 6513 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117560.487031:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf777c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593056384:0@lo:104: 00000100:00100000:3.0:1789117560.487324:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593055872 00000100:00100000:3.0:1789117560.487332:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593055872 00000100:00100000:3.0:1789117560.487372:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593056000 00000100:00100000:3.0:1789117560.487375:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593056000 00000100:00100000:3.0:1789117560.487399:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593056128 00000100:00100000:3.0:1789117560.487402:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593056128 00000100:00100000:3.0:1789117560.487409:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593056256 00000100:00100000:3.0:1789117560.487411:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593056256 00000100:00100000:3.0:1789117560.487423:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789117560.487434:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf777840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+6:6514:x1876025593055872:12345-0@lo:104: 00010000:00010000:3.0:1789117560.487447:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b813da800/0xaa253ed19be1f655 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f65c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.494392:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789117560.494409:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf777840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+6:6514:x1876025593055872:12345-0@lo:104: Request processed in 6972us (7655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117560.494422:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789117560.494464:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789117560.494475:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf777480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+5:6514:x1876025593056000:12345-0@lo:104: 00010000:00010000:3.0:1789117560.494493:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962baea9aa00/0xaa253ed19be1f62b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f632 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.494545:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789117560.494551:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf777480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+5:6514:x1876025593056000:12345-0@lo:104: Request processed in 80us (7674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117560.494588:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789117560.494603:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789117560.494609:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+4:6514:x1876025593056128:12345-0@lo:104: 00010000:00010000:3.0:1789117560.494617:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be1f60f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f616 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.494648:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789117560.494652:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+4:6514:x1876025593056128:12345-0@lo:104: Request processed in 45us (7711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117560.494657:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789117560.494669:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789117560.494675:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+3:6514:x1876025593056256:12345-0@lo:104: 00010000:00010000:3.0:1789117560.494682:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1f5d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f5de expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.494707:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789117560.494724:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+3:6514:x1876025593056256:12345-0@lo:104: Request processed in 39us (7711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117560.494730:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789117560.494755:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789117560.494761:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b813da800/0xaa253ed19be1f655 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f65c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.494768:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813da800 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:3.0:1789117560.494773:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b813da800/0xaa253ed19be1f655 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f65c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.494803:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b813da800/0xaa253ed19be1f655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f65c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789117560.494810:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b813da800/0xaa253ed19be1f655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f65c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117560.494815:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789117560.494851:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b813da800/0xaa253ed19be1f655 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f65c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.494856:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789117560.494874:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b813da800/0xaa253ed19be1f655 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f65c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.494881:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b813da800/0xaa253ed19be1f655 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f65c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.494896:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789117560.494899:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962baea9aa00/0xaa253ed19be1f62b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f632 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.494904:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9aa00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:3.0:1789117560.494906:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962baea9aa00/0xaa253ed19be1f62b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f632 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.494913:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962baea9aa00/0xaa253ed19be1f62b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f632 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789117560.494918:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962baea9aa00/0xaa253ed19be1f62b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f632 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117560.494929:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789117560.494944:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962baea9aa00/0xaa253ed19be1f62b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f632 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.494950:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789117560.494955:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962baea9aa00/0xaa253ed19be1f62b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f632 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.494961:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962baea9aa00/0xaa253ed19be1f62b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f632 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.494971:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789117560.494973:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be1f60f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f616 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.494978:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc11200 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:3.0:1789117560.494980:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be1f60f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f616 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.494986:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be1f60f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f616 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789117560.494991:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be1f60f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f616 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117560.494996:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789117560.495007:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be1f60f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f616 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.495012:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789117560.495035:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be1f60f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f616 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.495041:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be1f60f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f616 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.495076:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117560.495079:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1f5d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f5de expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.495085:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db600 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:3.0:1789117560.495088:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1f5d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f5de expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.495095:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1f5d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f5de expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789117560.495101:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1f5d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f5de expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117560.495106:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789117560.495807:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1f5d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f5de expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.495817:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789117560.495826:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1f5d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f5de expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.495832:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1f5d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f5de expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.495845:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117560.495853:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117560.495856:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117560.495871:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117560.495902:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593056512:0@lo:103: 00000100:00100000:3.0:1789117560.495959:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117560.496018:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117560.496024:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b9277e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593056640:0@lo:103: 00000100:00100000:3.0:1789117560.496047:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117560.496108:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b9277fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593056768:0@lo:103: 00000100:00100000:3.0:1789117560.496129:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117560.496159:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117560.496165:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593056896:0@lo:103: 00000100:00100000:3.0:1789117560.496187:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117560.496229:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593056512 00000100:00100000:3.0:1789117560.496236:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593056512 00010000:00010000:3.0:1789117560.496263:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962baea9b600/0xaa253ed19be1f65c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f655 expref: 19 pid: 6513 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117560.496281:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593056640 00000100:00100000:3.0:1789117560.496284:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593056640 00010000:00010000:3.0:1789117560.496295:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b813daa00/0xaa253ed19be1f632 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f62b expref: 20 pid: 6512 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117560.496305:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593056768 00000100:00100000:3.0:1789117560.496307:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593056768 00010000:00010000:3.0:1789117560.496318:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962bbbc11a00/0xaa253ed19be1f616 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f60f expref: 21 pid: 6513 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117560.496326:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593056896 00000100:00100000:3.0:1789117560.496329:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593056896 00010000:00010000:3.0:1789117560.496347:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962bc20f4c00/0xaa253ed19be1f5de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f5d7 expref: 22 pid: 6512 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117560.496361:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789117560.496370:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+22:3646:x1876025593056512:12345-0@lo:103: 00010000:00010000:3.0:1789117560.496384:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117560.496389:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962baea9b600/0xaa253ed19be1f65c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f655 expref: 22 pid: 6513 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.496403:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962baea9b600/0xaa253ed19be1f65c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f655 expref: 22 pid: 6513 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.496428:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117560.496465:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+22:3646:x1876025593056512:12345-0@lo:103: Request processed in 94us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117560.496473:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789117560.496491:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789117560.496498:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86809e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+21:3646:x1876025593056640:12345-0@lo:103: 00010000:00010000:3.0:1789117560.496506:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117560.496510:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b813daa00/0xaa253ed19be1f632 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f62b expref: 21 pid: 6512 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.496518:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b813daa00/0xaa253ed19be1f632 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f62b expref: 21 pid: 6512 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.496528:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117560.496550:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86809e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+21:3646:x1876025593056640:12345-0@lo:103: Request processed in 53us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117560.496556:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789117560.496576:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789117560.496582:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+20:3644:x1876025593056768:12345-0@lo:103: 00010000:00010000:3.0:1789117560.496601:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117560.496608:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962bbbc11a00/0xaa253ed19be1f616 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f60f expref: 20 pid: 6513 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.496617:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962bbbc11a00/0xaa253ed19be1f616 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f60f expref: 20 pid: 6513 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.496627:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117560.496656:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+20:3644:x1876025593056768:12345-0@lo:103: Request processed in 74us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117560.496663:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789117560.496676:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789117560.496682:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86808b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+19:3644:x1876025593056896:12345-0@lo:103: 00010000:00010000:3.0:1789117560.496690:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117560.496694:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962bc20f4c00/0xaa253ed19be1f5de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f5d7 expref: 19 pid: 6512 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.496702:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962bc20f4c00/0xaa253ed19be1f5de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f5d7 expref: 19 pid: 6512 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.496710:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117560.496728:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86808b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+19:3644:x1876025593056896:12345-0@lo:103: Request processed in 46us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117560.496733:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789117560.496773:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593056896:0@lo:103: 00000100:00100000:3.0:1789117560.496781:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b9277fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593056768:0@lo:103: 00000100:00100000:3.0:1789117560.496814:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b9277e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593056640:0@lo:103: 00000100:00100000:3.0:1789117560.496821:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593056512:0@lo:103: 00000100:00100000:1.0:1789117560.502883:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117560.503631:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbcf41480 going to sleep for 11 seconds 00010000:00010000:1.0:1789117560.503669:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962baea9b600/0xaa253ed19be1f65c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f655 expref: 18 pid: 6513 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117560.503686:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf774780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593055872:0@lo:104: 00010000:00010000:1.0:1789117560.503697:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813daa00/0xaa253ed19be1f632 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f62b expref: 17 pid: 6512 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117560.503706:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf774000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593056000:0@lo:104: 00010000:00010000:1.0:1789117560.503728:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bbbc11a00/0xaa253ed19be1f616 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f60f expref: 16 pid: 6513 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117560.503736:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf775a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593056128:0@lo:104: 00010000:00010000:1.0:1789117560.503746:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bc20f4c00/0xaa253ed19be1f5de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f5d7 expref: 15 pid: 6512 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117560.503754:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7752c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593056256:0@lo:104: 00000100:00100000:3.0:1789117560.503974:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593056384 00000100:00100000:3.0:1789117560.503982:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593056384 00000100:00100000:3.0:1789117560.504255:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789117560.504266:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+3:6514:x1876025593056384:12345-0@lo:104: 00010000:00010000:3.0:1789117560.504282:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962bbbc10400/0xaa253ed19be1f560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f567 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.504624:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789117560.504631:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+3:6514:x1876025593056384:12345-0@lo:104: Request processed in 368us (1758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117560.504640:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789117560.504687:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117560.504695:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bbbc10400/0xaa253ed19be1f560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f567 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.504703:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc10400 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117560.504707:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bbbc10400/0xaa253ed19be1f560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f567 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.504726:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bbbc10400/0xaa253ed19be1f560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f567 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117560.504733:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bbbc10400/0xaa253ed19be1f560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f567 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117560.504738:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789117560.504776:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962bbbc10400/0xaa253ed19be1f560 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f567 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.504794:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117560.504812:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bbbc10400/0xaa253ed19be1f560 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f567 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.504819:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bbbc10400/0xaa253ed19be1f560 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f567 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.504834:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117560.504836:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117560.504837:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117560.504953:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf777c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593056384:0@lo:104: 00010000:00010000:1.0:1789117560.504995:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be1f69b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117560.505559:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789117560.505576:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593057024:0@lo:103: 00000100:00100000:3.0:1789117560.505629:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117560.505900:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593057024 00000100:00100000:1.0:1789117560.505908:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593057024 00010000:00010000:1.0:1789117560.505942:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962bbbc11600/0xaa253ed19be1f567 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f560 expref: 15 pid: 6513 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117560.505977:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789117560.505984:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb093e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+15:3647:x1876025593057024:12345-0@lo:103: 00010000:00010000:1.0:1789117560.506011:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117560.506017:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962bbbc11600/0xaa253ed19be1f567 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f560 expref: 15 pid: 6513 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.506029:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962bbbc11600/0xaa253ed19be1f567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f560 expref: 15 pid: 6513 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.506047:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bbbc11600/0xaa253ed19be1f567 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f560 expref: 15 pid: 6513 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.506095:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be1f69b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.506103:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be1f69b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.506392:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be1f69b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.506400:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be1f69b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.506406:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be1f69b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.506413:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be1f69b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.506418:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f5e00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117560.506423:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be1f69b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.506446:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be1f69b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.506469:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be1f69b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.506486:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117560.506588:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be1f69b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.506597:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be1f69b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.506610:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be1f69b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789117560.506629:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789117560.506755:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb093e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+14:3647:x1876025593057024:12345-0@lo:103: Request processed in 770us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117560.506764:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789117560.510741:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+13:8427:x1876025593055744:12345-0@lo:253: Request processed in 40465us (40790us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117560.510758:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789117560.510836:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7a7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593055744:0@lo:253: 10000000:01000000:3.0:1789117560.510854:0:8427:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789117560.510858:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789117560.510860:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789117560.510861:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789117560.510862:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1789117560.510863:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789117560.510864:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789117560.510866:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789117560.510880:0:8427:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789117560.510882:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789117560.510883:0:8427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789117560.510902:0:8427:0:(tgt_mount.c:101:server_register_mount()) register mount ffff962bbf4b3000 from lustre-OST0000 10000000:01000000:3.0:1789117560.510933:0:8427:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789117560.510936:0:8427:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789117560.510942:0:8427:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff962b88028000 local copy 10000000:01000000:3.0:1789117560.510946:0:8427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789117560.510981:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1f6a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.510991:0:8427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1f6a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.511000:0:8427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1f6a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117560.511018:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593057152:0@lo:101: 00000100:00100000:3.0:1789117560.511097:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117560.511155:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b87dec9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117560.511564:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593057024:0@lo:103: 00000100:00100000:2.0:1789117560.512296:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593057152 00000100:00100000:2.0:1789117560.512304:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593057152 00000100:00100000:2.0:1789117560.512377:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789117560.512387:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+13:8427:x1876025593057152:12345-0@lo:101: 00010000:00010000:2.0:1789117560.512406:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117560.512423:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b89b69800/0xaa253ed19be1f6a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f6a2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117560.512454:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b89b69800/0xaa253ed19be1f6a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f6a2 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117560.512466:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b89b69800/0xaa253ed19be1f6a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f6a2 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117560.512475:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69800, rc 0) 00000100:00100000:2.0:1789117560.512534:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+14:8427:x1876025593057152:12345-0@lo:101: Request processed in 148us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117560.512540:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789117560.513660:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593057152:0@lo:101: 00010000:00010000:3.0:1789117560.513682:0:8427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1f6a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xaa253ed19be1f6a9 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.513694:0:8427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1f6a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xaa253ed19be1f6a9 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117560.513822:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593057280:0@lo:501: 00000100:00100000:3.0:1789117560.513873:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117560.513919:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b87dec9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117560.514251:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593057280 00000100:00100000:1.0:1789117560.514259:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593057280 00000100:00100000:1.0:1789117560.514298:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789117560.514306:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+14:8427:x1876025593057280:12345-0@lo:501: 00000100:00100000:1.0:1789117560.514394:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+14:8427:x1876025593057280:12345-0@lo:501: Request processed in 88us (520us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789117560.514402:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789117560.515497:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593057280:0@lo:501: 10000000:01000000:3.0:1789117560.515532:0:8427:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789117560.515562:0:8427:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789117560.515570:0:8427:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1f6a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xaa253ed19be1f6a9 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.515579:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1f6a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xaa253ed19be1f6a9 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.515586:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1f6a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xaa253ed19be1f6a9 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.515631:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789117560.515661:0:8427:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff962bbf4b3000 10000000:01000000:3.0:1789117560.515667:0:8427:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789117560.515672:0:8427:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789117560.515675:0:8427:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789117560.515679:0:8427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789117560.515683:0:8427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789117560.515885:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813da800/0xaa253ed19be1f6b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.515894:0:8427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b813da800/0xaa253ed19be1f6b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.515904:0:8427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b813da800/0xaa253ed19be1f6b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117560.515923:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593057408:0@lo:101: 00000100:00100000:3.0:1789117560.515975:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789117560.516079:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117560.516086:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1f6a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xaa253ed19be1f6a9 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.516094:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db600 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789117560.516098:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1f6a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xaa253ed19be1f6a9 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.516106:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1f6a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xaa253ed19be1f6a9 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117560.516133:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1f6a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xaa253ed19be1f6a9 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117560.516139:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789117560.516169:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1f6a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xaa253ed19be1f6a9 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.516176:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117560.516201:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1f6a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xaa253ed19be1f6a9 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.516208:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1f6a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xaa253ed19be1f6a9 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.516221:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117560.516223:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117560.516225:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117560.516366:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117560.516380:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593057536:0@lo:103: 00000100:00100000:3.0:1789117560.516408:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117560.516456:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b87deccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117560.516572:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593057536 00000100:00100000:1.0:1789117560.516579:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593057536 00000100:00100000:1.0:1789117560.516638:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789117560.516648:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+14:3646:x1876025593057536:12345-0@lo:103: 00010000:00010000:1.0:1789117560.516660:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117560.516675:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b89b69800/0xaa253ed19be1f6a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be1f6a2 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.516690:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117560.516736:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+13:3646:x1876025593057536:12345-0@lo:103: Request processed in 90us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117560.516742:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789117560.520930:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593057536:0@lo:103: 00000100:00100000:2.0:1789117560.526593:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593057408 00000100:00100000:2.0:1789117560.526610:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593057408 00000100:00100000:3.0:1789117560.528262:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789117560.528277:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+13:8427:x1876025593057408:12345-0@lo:101: 00010000:00010000:3.0:1789117560.528295:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117560.528326:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813db400/0xaa253ed19be1f6b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f6b0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.528356:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813db400/0xaa253ed19be1f6b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f6b0 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.528368:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813db400/0xaa253ed19be1f6b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f6b0 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.528379:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813db400, rc 0) 00000100:00100000:3.0:1789117560.528475:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+14:8427:x1876025593057408:12345-0@lo:101: Request processed in 201us (12500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117560.528484:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789117560.528677:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593057408:0@lo:101: 00010000:00010000:0.0:1789117560.528700:0:8427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b813da800/0xaa253ed19be1f6b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f6b7 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.528712:0:8427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b813da800/0xaa253ed19be1f6b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f6b7 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117560.528834:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ee940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593057664:0@lo:501: 00000100:00100000:0.0:1789117560.528882:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117560.528924:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d2e900 going to sleep for 11 seconds 00000100:00100000:3.0:1789117560.529570:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593057664 00000100:00100000:3.0:1789117560.529578:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593057664 00000100:00100000:3.0:1789117560.529631:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789117560.529641:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+14:8427:x1876025593057664:12345-0@lo:501: 00000100:00100000:3.0:1789117560.529795:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+14:8427:x1876025593057664:12345-0@lo:501: Request processed in 155us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117560.529802:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789117560.529916:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ee940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593057664:0@lo:501: 00000100:00100000:0.0:1789117560.529962:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ee940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593057792:0@lo:503: 00000100:00100000:0.0:1789117560.530027:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117560.530097:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d2e900 going to sleep for 11 seconds 00000100:00100000:3.0:1789117560.530396:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593057792 00000100:00100000:3.0:1789117560.530401:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593057792 00000100:00100000:3.0:1789117560.530436:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789117560.530443:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+14:8427:x1876025593057792:12345-0@lo:503: 00000100:00100000:3.0:1789117560.530537:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+14:8427:x1876025593057792:12345-0@lo:503: Request processed in 94us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117560.530544:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789117560.530585:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ee940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593057792:0@lo:503: 00000040:00080000:3.0:1789117560.531649:0:8427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789117560.531774:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86808f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593057920:0@lo:502: 00000100:00100000:3.0:1789117560.533100:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117560.533225:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b87dec240 going to sleep for 11 seconds 00000100:00100000:2.0:1789117560.543531:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593057920 00000100:00100000:2.0:1789117560.543547:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593057920 00000100:00100000:2.0:1789117560.543634:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789117560.543645:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+14:8427:x1876025593057920:12345-0@lo:502: 00000100:00100000:2.0:1789117560.543848:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+14:8427:x1876025593057920:12345-0@lo:502: Request processed in 205us (10749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117560.543856:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789117560.544345:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86808f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593057920:0@lo:502: 00000040:00080000:3.0:1789117560.544596:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789117560.544636:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789117560.544652:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789117560.544677:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789117560.544692:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789117560.544706:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789117560.544748:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86808f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593058048:0@lo:502: 00000100:00100000:3.0:1789117560.544800:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117560.544838:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b87dec240 going to sleep for 11 seconds 00000100:00100000:0.0:1789117560.545097:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593058048 00000100:00100000:0.0:1789117560.545103:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593058048 00000100:00100000:0.0:1789117560.545158:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789117560.545168:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+14:8427:x1876025593058048:12345-0@lo:502: 00000100:00100000:0.0:1789117560.545281:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+14:8427:x1876025593058048:12345-0@lo:502: Request processed in 115us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117560.545289:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789117560.545435:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86808f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593058048:0@lo:502: 00000040:00080000:3.0:1789117560.545480:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789117560.545489:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1789117560.547398:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789117560.547412:0:8451:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1789117560.547421:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117560.547423:0:8451:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789117560.547432:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789117560.547453:0:8451:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff962bbfac8000) 00000020:00000080:1.0:1789117560.547482:0:8451:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789117560.547487:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789117560.547566:0:8451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962bbf4b3000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789117560.547573:0:8451:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789117560.547579:0:8451:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xaa253ed19be1f6c5 00010000:00010000:0.0:1789117560.567445:0:8451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1789117560.568225:0:8451:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1789117560.574449:0:8451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789117560.575424:0:8451:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1789117560.590975:0:8451:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1789117560.591179:0:8451:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1789117560.617977:0:8451:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1789117560.631974:0:8451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789117560.631996:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117560.632016:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117560.632019:0:8451:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789117560.632022:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117560.632026:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117560.632028:0:8451:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789117560.632031:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789117560.632033:0:8451:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789117560.632076:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117560.632080:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117560.632082:0:8451:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789117560.632085:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789117560.632162:0:8427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789117560.632190:0:8427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789117560.632207:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813da800/0xaa253ed19be1f6b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f6b7 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.632221:0:8427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b813da800/0xaa253ed19be1f6b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f6b7 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117560.632229:0:8427:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962bbf4b3000 from 1 10000000:01000000:3.0:1789117560.632232:0:8427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789117560.632270:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813dba00/0xaa253ed19be1f6cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.632278:0:8427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b813dba00/0xaa253ed19be1f6cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.632289:0:8427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b813dba00/0xaa253ed19be1f6cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117560.632312:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86808f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593058176:0@lo:101: 00000100:00100000:3.0:1789117560.632388:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117560.632438:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b87dec240 going to sleep for 11 seconds 00000100:00100000:1.0:1789117560.633027:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593058176 00000100:00100000:1.0:1789117560.633037:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593058176 00000100:00100000:1.0:1789117560.633124:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789117560.633136:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+14:8427:x1876025593058176:12345-0@lo:101: 00010000:00010000:1.0:1789117560.633161:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117560.633178:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bc20f4c00/0xaa253ed19be1f6d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f6cc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.633204:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bc20f4c00/0xaa253ed19be1f6d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f6cc expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.633216:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bc20f4c00/0xaa253ed19be1f6d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f6cc expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.633224:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f4c00, rc 0) 00000100:00100000:1.0:1789117560.633282:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+15:8427:x1876025593058176:12345-0@lo:101: Request processed in 149us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117560.633290:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789117560.633343:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86808f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593058176:0@lo:101: 00010000:00010000:1.0:1789117560.633369:0:8427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b813dba00/0xaa253ed19be1f6cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f6d3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.633379:0:8427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b813dba00/0xaa253ed19be1f6cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f6d3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117560.633475:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a868192c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593058304:0@lo:501: 00000100:00100000:1.0:1789117560.633504:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117560.633521:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbcf41c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117560.642292:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593058304 00000100:00100000:3.0:1789117560.642307:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593058304 00000100:00100000:3.0:1789117560.642371:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789117560.642381:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+15:8427:x1876025593058304:12345-0@lo:501: 00000100:00100000:3.0:1789117560.642565:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+15:8427:x1876025593058304:12345-0@lo:501: Request processed in 185us (9060us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117560.642573:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789117560.645403:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a868192c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593058304:0@lo:501: 00000100:00100000:0.0:1789117560.645497:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ede00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593058432:0@lo:503: 00000100:00100000:0.0:1789117560.645589:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117560.645640:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b90019c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117560.645713:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593058432 00000100:00100000:3.0:1789117560.645721:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593058432 00000100:00100000:3.0:1789117560.645793:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789117560.645802:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+15:8427:x1876025593058432:12345-0@lo:503: 00000100:00100000:3.0:1789117560.645923:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+15:8427:x1876025593058432:12345-0@lo:503: Request processed in 122us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117560.645931:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789117560.646252:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ede00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593058432:0@lo:503: 00000040:00080000:1.0:1789117560.646558:0:8427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789117560.646652:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593058560:0@lo:502: 00000100:00100000:1.0:1789117560.646695:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117560.646734:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbcf410c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117560.646802:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593058560 00000100:00100000:3.0:1789117560.646806:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593058560 00000100:00100000:3.0:1789117560.646841:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789117560.646848:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+15:8427:x1876025593058560:12345-0@lo:502: 00000100:00100000:3.0:1789117560.646939:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+15:8427:x1876025593058560:12345-0@lo:502: Request processed in 91us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117560.646946:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789117560.647548:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593058560:0@lo:502: 00000040:00080000:1.0:1789117560.647818:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789117560.647846:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789117560.647879:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593058688:0@lo:502: 00000100:00100000:1.0:1789117560.647928:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117560.648893:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbcf410c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117560.663714:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593058688 00000100:00100000:3.0:1789117560.663731:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593058688 00000100:00100000:3.0:1789117560.663805:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789117560.663822:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+15:8427:x1876025593058688:12345-0@lo:502: 00000100:00100000:3.0:1789117560.664083:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+15:8427:x1876025593058688:12345-0@lo:502: Request processed in 268us (16154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117560.664093:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789117560.666112:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593058688:0@lo:502: 00000040:00080000:1.0:1789117560.666247:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789117560.666261:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789117560.668041:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789117560.668084:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117560.668087:0:8455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789117560.668096:0:8455:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962bbf4b3000 00000020:00000080:1.0:1789117560.668113:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789117560.668133:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117560.668136:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117560.668137:0:8455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789117560.668140:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789117560.668388:0:8427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789117560.668418:0:8427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789117560.668437:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813dba00/0xaa253ed19be1f6cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f6d3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.668449:0:8427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b813dba00/0xaa253ed19be1f6cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f6d3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117560.668505:0:8427:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789117560.668508:0:8427:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff962bbf4b3000 10000000:01000000:0.0:1789117560.668511:0:8427:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff962bbf4b3000 10000000:01000000:0.0:1789117560.668515:0:8427:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789117560.668522:0:8427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962bbf4b3000 from 1 10000000:01000000:0.0:1789117560.668525:0:8427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789117560.668560:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f6da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.668568:0:8427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f6da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.668579:0:8427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f6da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117560.668610:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6eda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593058816:0@lo:101: 00000100:00100000:0.0:1789117560.668678:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117560.668721:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d78600 going to sleep for 11 seconds 00000100:00100000:1.0:1789117560.670446:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593058816 00000100:00100000:1.0:1789117560.670460:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593058816 00000100:00100000:1.0:1789117560.670527:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789117560.670536:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+15:8427:x1876025593058816:12345-0@lo:101: 00010000:00010000:1.0:1789117560.670551:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117560.670568:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be1f6e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f6da expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.670593:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be1f6e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f6da expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.670604:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be1f6e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f6da expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.670613:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f5e00, rc 0) 00000100:00100000:1.0:1789117560.670680:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+16:8427:x1876025593058816:12345-0@lo:101: Request processed in 145us (2001us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117560.670688:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789117560.672523:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6eda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593058816:0@lo:101: 00010000:00010000:0.0:1789117560.672553:0:8427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f6da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f6e1 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.672566:0:8427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f6da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f6e1 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117560.672722:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6eda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593058944:0@lo:501: 00000100:00100000:0.0:1789117560.672789:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117560.672832:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d78600 going to sleep for 11 seconds 00000100:00100000:1.0:1789117560.672980:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593058944 00000100:00100000:1.0:1789117560.672986:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593058944 00000100:00100000:1.0:1789117560.673028:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789117560.673036:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+16:8427:x1876025593058944:12345-0@lo:501: 00000100:00100000:1.0:1789117560.673187:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+16:8427:x1876025593058944:12345-0@lo:501: Request processed in 151us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117560.673195:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789117560.673241:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6eda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593058944:0@lo:501: 00000100:00100000:1.0:1789117560.673269:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593059072:0@lo:503: 00000100:00100000:1.0:1789117560.673307:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117560.673321:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbcf41c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117560.673334:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593059072 00000100:00100000:1.0:1789117560.673337:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593059072 00000100:00100000:1.0:1789117560.673355:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789117560.673360:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+16:8427:x1876025593059072:12345-0@lo:503: 00000100:00100000:1.0:1789117560.673442:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+16:8427:x1876025593059072:12345-0@lo:503: Request processed in 81us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117560.673447:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789117560.673517:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593059072:0@lo:503: 00000040:00080000:1.0:1789117560.673800:0:8427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789117560.673860:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593059200:0@lo:502: 00000100:00100000:1.0:1789117560.673895:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117560.673911:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b87cf6900 going to sleep for 11 seconds 00000100:00100000:1.0:1789117560.673926:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593059200 00000100:00100000:1.0:1789117560.673929:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593059200 00000100:00100000:1.0:1789117560.673947:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789117560.673953:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+16:8427:x1876025593059200:12345-0@lo:502: 00000100:00100000:1.0:1789117560.674028:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+16:8427:x1876025593059200:12345-0@lo:502: Request processed in 74us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117560.674034:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789117560.674112:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593059200:0@lo:502: 00000040:00080000:1.0:1789117560.674350:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789117560.674377:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789117560.674403:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789117560.674418:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789117560.674431:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789117560.674444:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789117560.674457:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789117560.674471:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789117560.674483:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789117560.674496:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789117560.674510:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789117560.674522:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789117560.674537:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789117560.674552:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789117560.674565:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789117560.674591:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789117560.674608:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789117560.674621:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789117560.674634:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789117560.674647:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789117560.674658:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789117560.674671:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789117560.674683:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789117560.674697:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789117560.674712:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789117560.674725:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789117560.674737:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789117560.674748:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1789117560.674760:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789117560.674772:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1789117560.674783:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1789117560.674811:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1789117560.674825:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1789117560.674839:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1789117560.674852:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1789117560.674875:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1789117560.674889:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1789117560.674917:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593059328:0@lo:502: 00000100:00100000:1.0:1789117560.674963:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117560.675005:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593059328 00000100:00100000:1.0:1789117560.675009:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593059328 00000100:00100000:1.0:1789117560.675031:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789117560.675037:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+16:8427:x1876025593059328:12345-0@lo:502: 00000100:00100000:1.0:1789117560.675136:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+16:8427:x1876025593059328:12345-0@lo:502: Request processed in 98us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117560.675156:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789117560.675240:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b87cf6900 going to sleep for 11 seconds 00000100:00100000:1.0:1789117560.675270:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593059328:0@lo:502: 00000040:00080000:1.0:1789117560.675329:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1789117560.675337:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1789117560.675692:0:8456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789117560.675713:0:8456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff962bbfacced8) 00000020:00000080:1.0:1789117560.675735:0:8456:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1789117560.699095:0:8456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962bbf4b3000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789117560.699109:0:8456:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962bbf4b3000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789117560.699112:0:8456:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962bbf4b3000 3 00010000:00080000:1.0:1789117560.699170:0:8456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962a86831000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.130@tcp at head 00010000:00010000:1.0:1789117560.700812:0:8456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1789117560.701105:0:8456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789117560.701164:0:8456:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789117560.701180:0:8456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xaa253ed19be1f6ef 00000100:00080000:1.0:1789117560.701191:0:8456:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789117560.701198:0:8456:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff962a86831000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789117560.701243:0:8456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a8681a1c0 x1876025593059456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789117560.701265:0:8456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789117560.701681:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593059712:0@lo:400: 00000100:00100000:3.0:1789117560.701750:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117560.701797:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789117560.701804:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a868083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593059584:0@lo:400: 00000100:00100000:3.0:1789117560.701832:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117560.701862:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8680b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593059840:0@lo:400: 00000100:00100000:3.0:1789117560.701886:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117560.701907:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117560.701913:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8680a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593059968:0@lo:400: 00000100:00100000:3.0:1789117560.701935:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117560.701975:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593059712 00000100:00100000:3.0:1789117560.701981:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593059712 00000100:00100000:3.0:1789117560.702007:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593059968 00000100:00100000:3.0:1789117560.702008:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593059968 00000100:00100000:3.0:1789117560.702021:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789117560.702029:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593059712:12345-0@lo:400: 00000100:00100000:3.0:1789117560.702116:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593059712:12345-0@lo:400: Request processed in 87us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117560.702124:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789117560.702157:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789117560.702164:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593059968:12345-0@lo:400: 00000100:00100000:3.0:1789117560.702197:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593059968:12345-0@lo:400: Request processed in 34us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117560.702215:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789117560.702234:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593059584 00000100:00100000:3.0:1789117560.702238:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593059584 00000100:00100000:3.0:1789117560.702260:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593059840 00000100:00100000:3.0:1789117560.702262:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593059840 00000100:00100000:3.0:1789117560.702273:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789117560.702279:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a868092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593059584:12345-0@lo:400: 00000100:00100000:3.0:1789117560.702312:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a868092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593059584:12345-0@lo:400: Request processed in 33us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117560.702318:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789117560.702330:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789117560.702335:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593059840:12345-0@lo:400: 00000100:00100000:3.0:1789117560.702361:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593059840:12345-0@lo:400: Request processed in 26us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117560.702367:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789117560.702414:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8680a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593059968:0@lo:400: 00010000:00080000:3.0:1789117560.702427:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962a8680b840 x1876025593059840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117560.702436:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8680b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593059840:0@lo:400: 00010000:00080000:3.0:1789117560.702463:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962a868083c0 x1876025593059584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117560.702472:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a868083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593059584:0@lo:400: 00000100:00100000:3.0:1789117560.702481:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593059712:0@lo:400: 00000100:00100000:0.0:1789117560.705660:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876025593059456:0@lo:38: 00000100:00100000:0.0:1789117560.705744:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117560.706361:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593059456 00000100:00100000:2.0:1789117560.706371:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593059456 00000100:00100000:2.0:1789117560.706434:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789117560.706442:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876025593059456:12345-0@lo:38: 00010000:00080000:2.0:1789117560.706471:0:6521:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:2.0:1789117560.706519:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xaa253ed19be1f6f6 00000004:00100000:2.0:1789117560.706535:0:6521:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789117560.706567:0:6521:0:(import.c:65:import_set_state_nolock()) ffff962bbd042800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789117560.706634:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876025593059456:12345-0@lo:38: Request processed in 191us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117560.706642:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789117560.706686:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962a8681a1c0 x1876025593059456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789117570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117560.706696:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789117560.706704:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789117560.706711:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789117560.706716:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789117560.706718:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a86831000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789117560.706725:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876025593059456:0@lo:38: 00000020:01000004:1.0:1789117560.714923:0:8456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789117560.714942:0:8456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff962bbfacb490) 00000020:00000080:1.0:1789117560.714965:0:8456:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1789117560.715043:0:8456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962bbf4b3000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789117560.715075:0:8456:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962bbf4b3000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789117560.715078:0:8456:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962bbf4b3000 3 00010000:00080000:1.0:1789117560.715133:0:8456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962bc1a2b000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.130@tcp at head 00010000:00010000:1.0:1789117560.722681:0:8456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1789117560.722956:0:8456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789117560.723002:0:8456:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789117560.723014:0:8456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xaa253ed19be1f704 00000100:00080000:1.0:1789117560.723026:0:8456:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789117560.723032:0:8456:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff962bc1a2b000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789117560.731609:0:8456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a8681b0c0 x1876025593060096/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789117560.732682:0:8456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789117560.733089:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593060608:0@lo:400: 00000100:00100000:2.0:1789117560.733175:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117560.733220:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789117560.733227:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593060480:0@lo:400: 00000100:00100000:2.0:1789117560.733254:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117560.733291:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593060608 00000100:00100000:2.0:1789117560.733299:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593060608 00000100:00100000:2.0:1789117560.733348:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789117560.733358:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593060608:12345-0@lo:400: 00000100:00100000:2.0:1789117560.733420:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593060608:12345-0@lo:400: Request processed in 64us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117560.733428:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789117560.733471:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962bbf7a4780 x1876025593060608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117560.733484:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593060608:0@lo:400: 00000100:00100000:2.0:1789117560.733504:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593060352:0@lo:400: 00000100:00100000:2.0:1789117560.733525:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117560.733544:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593060864:0@lo:400: 00000100:00100000:2.0:1789117560.733562:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117560.733578:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789117560.733584:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593060224:0@lo:400: 00000100:00100000:2.0:1789117560.733608:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117560.733634:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593060736:0@lo:400: 00000100:00100000:2.0:1789117560.733655:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117560.733679:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593060352 00000100:00100000:2.0:1789117560.733683:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593060352 00000100:00100000:2.0:1789117560.733700:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593060864 00000100:00100000:2.0:1789117560.733702:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593060864 00000100:00100000:2.0:1789117560.733725:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789117560.733731:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593060352:12345-0@lo:400: 00000100:00100000:2.0:1789117560.733765:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593060352:12345-0@lo:400: Request processed in 34us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117560.733771:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789117560.733800:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789117560.733806:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593060864:12345-0@lo:400: 00000100:00100000:2.0:1789117560.733843:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593060864:12345-0@lo:400: Request processed in 37us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117560.733849:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789117560.733867:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593060224 00000100:00100000:2.0:1789117560.733871:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593060224 00000100:00100000:2.0:1789117560.733896:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789117560.733903:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+16:3645:x1876025593060224:12345-0@lo:400: 00000100:00100000:2.0:1789117560.733931:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+16:3645:x1876025593060224:12345-0@lo:400: Request processed in 29us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117560.733936:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1789117560.733974:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117560.733993:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593060480 00000100:00100000:2.0:1789117560.733996:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593060480 00000100:00100000:2.0:1789117560.734012:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593060736 00000100:00100000:2.0:1789117560.734014:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593060736 00000100:00100000:2.0:1789117560.734025:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789117560.734030:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593060480:12345-0@lo:400: 00000100:00100000:2.0:1789117560.734084:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593060480:12345-0@lo:400: Request processed in 54us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117560.734090:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789117560.734101:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789117560.734107:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593060736:12345-0@lo:400: 00000100:00100000:2.0:1789117560.734131:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593060736:12345-0@lo:400: Request processed in 25us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117560.734135:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789117560.734177:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593060480:0@lo:400: 00000100:00100000:2.0:1789117560.734195:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593060224:0@lo:400: 00000100:00100000:2.0:1789117560.734211:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593060736:0@lo:400: 00010000:00080000:2.0:1789117560.734220:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962bbf7a61c0 x1876025593060352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117560.734229:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593060352:0@lo:400: 00010000:00080000:2.0:1789117560.734238:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962bbf7a5a40 x1876025593060864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117560.734244:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593060864:0@lo:400: 00000100:00100000:0.0:1789117560.739866:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876025593060096:0@lo:38: 00000100:00100000:0.0:1789117560.739958:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117560.740035:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593060096 00000100:00100000:0.0:1789117560.740043:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593060096 00000100:00100000:0.0:1789117560.740089:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789117560.740096:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876025593060096:12345-0@lo:38: 00010000:00080000:0.0:1789117560.740124:0:6519:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:0.0:1789117560.740202:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xaa253ed19be1f70b 00000004:00100000:0.0:1789117560.740219:0:6519:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789117560.740255:0:6519:0:(import.c:65:import_set_state_nolock()) ffff962bbcfea000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789117560.740313:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876025593060096:12345-0@lo:38: Request processed in 215us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117560.740321:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789117560.740367:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962a8681b0c0 x1876025593060096/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789117570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117560.740377:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789117560.740384:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789117560.740392:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789117560.740397:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789117560.740399:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bc1a2b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789117560.740404:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876025593060096:0@lo:38: 00000040:00080000:1.0:1789117560.745463:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1789117560.745519:0:8427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1789117560.745544:0:8427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789117560.745562:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f6da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f6e1 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.745574:0:8427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f6da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f6e1 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789117560.745631:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789117560.745633:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789117560.745635:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789117560.745637:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789117560.745638:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789117560.745639:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789117560.745641:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789117560.745643:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789117560.745644:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789117560.745646:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789117560.745647:0:8427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789117560.745652:0:8427:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1789117560.745654:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789117560.745655:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789117560.745656:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789117560.745657:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789117560.745658:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789117560.745659:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789117560.745660:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789117560.745661:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789117560.745663:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789117560.745664:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789117560.745665:0:8427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789117560.745696:0:8427:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789117560.745716:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86818780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593060992:0@lo:253: 00000100:00100000:1.0:1789117560.745794:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117560.745824:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84c2cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789117560.748647:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593060992 00000100:00100000:0.0:1789117560.748659:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593060992 00000100:00100000:0.0:1789117560.748722:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789117560.748733:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+16:8427:x1876025593060992:12345-0@lo:253: 20000000:01000000:0.0:1789117560.748766:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789117560.748779:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789117560.757662:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789117560.757687:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789117560.757796:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789117560.757801:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789117560.757823:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962b89b69e00/0xaa253ed19be1f712 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117560.757842:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b813db800/0xaa253ed19be1f608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f601 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117560.757849:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b89b69200/0xaa253ed19be1f624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f61d expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117560.757856:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962b89b69e00/0xaa253ed19be1f712 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117560.757895:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b89b69200/0xaa253ed19be1f624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f61d expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117560.757909:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962b89b69200/0xaa253ed19be1f624 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f61d expref: 16 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117560.757922:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7a5a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876025593061120:0@lo:104: 00000100:00100000:2.0:1789117560.758002:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789117560.758097:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b813db800/0xaa253ed19be1f608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f601 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117560.758106:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962b813db800/0xaa253ed19be1f608 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f601 expref: 16 pid: 6512 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117560.758114:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7a61c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876025593061248:0@lo:104: 00000100:00100000:2.0:1789117560.758135:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f66f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117560.758340:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789117560.758364:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117560.758381:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593061120 00000100:00100000:3.0:1789117560.758387:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593061120 00000100:00100000:3.0:1789117560.758418:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593061248 00000100:00100000:3.0:1789117560.758420:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593061248 00000100:00100000:3.0:1789117560.758433:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789117560.758441:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf336050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+4:6535:x1876025593061120:12345-0@lo:104: 00010000:00010000:3.0:1789117560.758453:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962bbbc10a00/0xaa253ed19be1f61d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f624 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.758517:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789117560.758524:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf336050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+4:6535:x1876025593061120:12345-0@lo:104: Request processed in 84us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117560.758531:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789117560.758568:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789117560.758574:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86808000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+3:6535:x1876025593061248:12345-0@lo:104: 00010000:00010000:3.0:1789117560.758581:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962bbbc10000/0xaa253ed19be1f601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f608 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.758609:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789117560.758613:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86808000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+3:6535:x1876025593061248:12345-0@lo:104: Request processed in 40us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117560.758619:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1789117560.758662:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789117560.758670:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bbbc10a00/0xaa253ed19be1f61d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f624 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.758677:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc10a00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789117560.758681:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bbbc10a00/0xaa253ed19be1f61d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f624 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.758701:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bbbc10a00/0xaa253ed19be1f61d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f624 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117560.758708:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bbbc10a00/0xaa253ed19be1f61d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f624 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117560.758714:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789117560.758749:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962bbbc10a00/0xaa253ed19be1f61d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f624 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.758756:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117560.758772:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bbbc10a00/0xaa253ed19be1f61d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f624 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.758780:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bbbc10a00/0xaa253ed19be1f61d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f624 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.758792:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117560.758795:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bbbc10000/0xaa253ed19be1f601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f608 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.758800:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc10000 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789117560.758803:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bbbc10000/0xaa253ed19be1f601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f608 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.758809:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bbbc10000/0xaa253ed19be1f601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f608 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117560.758815:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bbbc10000/0xaa253ed19be1f601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f608 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117560.758825:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789117560.758838:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962bbbc10000/0xaa253ed19be1f601 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f608 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.758843:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117560.758848:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bbbc10000/0xaa253ed19be1f601 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f608 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.758853:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bbbc10000/0xaa253ed19be1f601 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f608 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117560.758864:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117560.758865:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117560.758866:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117560.758872:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117560.759171:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+16:8427:x1876025593060992:12345-0@lo:253: Request processed in 10438us (13375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117560.759180:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789117560.759351:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86818780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:8427:1876025593060992:0@lo:253: 10000000:01000000:1.0:1789117560.759363:0:8427:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789117560.759366:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789117560.759368:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789117560.759369:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789117560.759370:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789117560.759371:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789117560.759373:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789117560.759374:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789117560.759376:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789117560.759378:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789117560.759379:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789117560.759381:0:8427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789117560.759412:0:8427:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789117560.761395:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86819680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593061376:0@lo:103: 00000100:00100000:2.0:1789117560.761506:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117560.761585:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789117560.761592:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86819a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593061504:0@lo:103: 00000100:00100000:2.0:1789117560.761615:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117560.761701:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7a5a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876025593061120:0@lo:104: 00000100:00100000:2.0:1789117560.761716:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7a61c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876025593061248:0@lo:104: 00010000:00010000:2.0:1789117560.761749:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962b89b69e00/0xaa253ed19be1f712 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117560.761921:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593061376 00000100:00100000:0.0:1789117560.761929:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593061376 00010000:00010000:0.0:1789117560.761969:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b89b69200/0xaa253ed19be1f624 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f61d expref: 16 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117560.762003:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593061504 00000100:00100000:0.0:1789117560.762020:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593061504 00010000:00010000:0.0:1789117560.762034:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b813db800/0xaa253ed19be1f608 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f601 expref: 17 pid: 6512 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117560.762090:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789117560.762101:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+17:3646:x1876025593061376:12345-0@lo:103: 00010000:00010000:0.0:1789117560.762120:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117560.762127:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b89b69200/0xaa253ed19be1f624 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f61d expref: 17 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.762138:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b89b69200/0xaa253ed19be1f624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f61d expref: 17 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.762173:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b89b69200/0xaa253ed19be1f624 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f61d expref: 17 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.762190:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117560.762248:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+16:3646:x1876025593061376:12345-0@lo:103: Request processed in 149us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117560.762256:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789117560.762273:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789117560.762280:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+15:3646:x1876025593061504:12345-0@lo:103: 00010000:00010000:0.0:1789117560.762294:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117560.762299:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b813db800/0xaa253ed19be1f608 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f601 expref: 15 pid: 6512 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.762307:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b813db800/0xaa253ed19be1f608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f601 expref: 15 pid: 6512 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.762317:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813db800/0xaa253ed19be1f608 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f601 expref: 15 pid: 6512 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.762336:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962b89b69e00/0xaa253ed19be1f712 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.762345:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b89b69e00/0xaa253ed19be1f712 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789117560.762362:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004560801s 00010000:00010000:0.0:1789117560.762367:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962b89b69e00/0xaa253ed19be1f712 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.762375:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962b89b69e00/0xaa253ed19be1f712 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.762382:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962b89b69e00/0xaa253ed19be1f712 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.762389:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962b89b69e00/0xaa253ed19be1f712 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.762395:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69e00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789117560.762399:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962b89b69e00/0xaa253ed19be1f712 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.762408:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962b89b69e00/0xaa253ed19be1f712 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.762421:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962b89b69e00/0xaa253ed19be1f712 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.762431:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117560.762463:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+14:3646:x1876025593061504:12345-0@lo:103: Request processed in 183us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117560.762470:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789117560.773106:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86819a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593061504:0@lo:103: 00000100:00100000:2.0:1789117560.773122:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86819680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593061376:0@lo:103: 00010000:00010000:2.0:1789117560.773195:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962b89b69e00/0xaa253ed19be1f712 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117560.773208:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962b89b69e00/0xaa253ed19be1f712 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117560.773235:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b89b69e00/0xaa253ed19be1f712 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1789117560.782769:0:8427:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1789117560.783072:0:8427:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789117560.783278:0:8427:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1789117560.783449:0:8427:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789117560.783717:0:8427:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1789117560.783870:0:8427:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1789117560.788511:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1789117560.806921:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789117560.821512:0:8427:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789117560.821523:0:8427:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789117560.821562:0:8427:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789117560.821609:0:8427:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789117560.821639:0:8427:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789117560.821667:0:8427:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1789117560.822681:0:8427:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789117560.822872:0:8427:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:2.0:1789117561.208234:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a868083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593061632:0@lo:41: 00000100:00100000:2.0:1789117561.208315:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117561.210008:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593061632 00000100:00100000:0.0:1789117561.210020:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593061632 00000100:00100000:0.0:1789117561.213960:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789117561.213980:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593061632:12345-0@lo:41: 00000004:00000024:0.0:1789117561.214019:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1789117561.214129:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593061632:12345-0@lo:41: Request processed in 157us (5813us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117561.214147:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789117561.214299:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a868083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593061632:0@lo:41: 00010000:00010000:1.0:1789117561.834417:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789117562.283802:0:8512:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789117562.287543:0:8512:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789117562.856989:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117563.754893:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789117563.754939:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593061760:0@lo:41: 00000100:00100000:0.0:1789117563.755039:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117563.755149:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593061760 00000100:00100000:0.0:1789117563.755158:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593061760 00000100:00100000:0.0:1789117563.755211:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789117563.756895:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593061760:12345-0@lo:41: 00000004:00000024:0.0:1789117563.756943:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789117563.758248:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593061760:12345-0@lo:41: Request processed in 1362us (3197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117563.758271:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789117563.758471:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593061760:0@lo:41: 00010000:00010000:1.0:1789117563.879849:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117564.912212:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117565.798263:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789117565.801864:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593062016:0@lo:400: 00000100:00100000:3.0:1789117565.801942:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117565.802023:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593061888:0@lo:400: 00000100:00100000:3.0:1789117565.802079:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117565.802160:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593062016 00000100:00100000:2.0:1789117565.802169:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593062016 00000100:00100000:2.0:1789117565.802225:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789117565.802234:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593062016:12345-0@lo:400: 00000100:00100000:2.0:1789117565.802285:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593062016:12345-0@lo:400: Request processed in 51us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117565.802293:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1789117565.802374:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf6ec000 x1876025593062016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117565.802392:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593062016:0@lo:400: 00000100:00100000:1.0:1789117565.802469:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593061888 00000100:00100000:1.0:1789117565.802473:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593061888 00000100:00100000:1.0:1789117565.802516:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789117565.802665:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+14:3647:x1876025593061888:12345-0@lo:400: 00000100:00100000:1.0:1789117565.802711:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+14:3647:x1876025593061888:12345-0@lo:400: Request processed in 188us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117565.802718:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789117565.802792:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593061888:0@lo:400: 00000100:00100000:2.0:1789117565.802994:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789117565.803040:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117565.803071:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593062272:0@lo:400: 00000100:00100000:3.0:1789117565.803100:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117565.805150:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593062144:0@lo:400: 00000100:00100000:2.0:1789117565.805377:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117565.805582:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593062272 00000100:00100000:1.0:1789117565.805591:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593062272 00000100:00100000:1.0:1789117565.805632:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789117565.805640:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593062272:12345-0@lo:400: 00000100:00100000:1.0:1789117565.805698:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593062272:12345-0@lo:400: Request processed in 58us (2597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117565.805706:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789117565.805780:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593062144 00000100:00100000:3.0:1789117565.805784:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593062144 00000100:00100000:3.0:1789117565.805819:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789117565.805826:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593062144:12345-0@lo:400: 00000100:00100000:3.0:1789117565.805866:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593062144:12345-0@lo:400: Request processed in 41us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117565.805872:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1789117565.805910:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf6ee580 x1876025593062272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117565.805924:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593062272:0@lo:400: 00000100:00100000:3.0:1789117565.805953:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593062144:0@lo:400: 00000100:00100000:3.0:1789117565.807220:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789117565.807280:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789117565.807296:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593062528:0@lo:400: 00000100:00100000:2.0:1789117565.807347:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117565.807449:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593062528 00000100:00100000:1.0:1789117565.807457:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593062528 00000100:00100000:1.0:1789117565.807515:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789117565.807531:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593062528:12345-0@lo:400: 00000100:00100000:1.0:1789117565.807577:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593062528:12345-0@lo:400: Request processed in 54us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117565.807583:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1789117565.807617:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf6efc00 x1876025593062528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117565.807630:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593062528:0@lo:400: 00000100:00080000:2.0:1789117565.809760:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117565.810688:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593062400:0@lo:400: 00000100:00100000:3.0:1789117565.810772:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117565.810899:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593062400 00000100:00100000:2.0:1789117565.810906:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593062400 00000100:00100000:2.0:1789117565.810948:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789117565.810957:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86808780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593062400:12345-0@lo:400: 00000100:00100000:2.0:1789117565.811015:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86808780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593062400:12345-0@lo:400: Request processed in 59us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117565.811021:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789117565.811106:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593062400:0@lo:400: 00000100:00100000:3.0:1789117565.811778:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593062656:0@lo:400: 00000100:00100000:3.0:1789117565.811827:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117565.814831:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593062656 00000100:00100000:2.0:1789117565.814863:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593062656 00000100:00100000:2.0:1789117565.814956:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789117565.814967:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86809680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593062656:12345-0@lo:400: 00000100:00080000:0.0:1789117565.815198:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789117565.816308:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86809680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593062656:12345-0@lo:400: Request processed in 1339us (4475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117565.816318:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1789117565.833239:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf6eed00 x1876025593062656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117565.833262:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593062656:0@lo:400: 00010000:00010000:1.0:1789117565.925305:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117566.313661:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593062784:0@lo:41: 00000100:00100000:0.0:1789117566.313752:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117566.313839:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593062784 00000100:00100000:0.0:1789117566.313847:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593062784 00000100:00100000:0.0:1789117566.313893:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789117566.313903:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593062784:12345-0@lo:41: 00000004:00000024:0.0:1789117566.313940:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1789117566.313992:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593062784:12345-0@lo:41: Request processed in 89us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117566.314000:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789117566.314079:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593062784:0@lo:41: 00010000:00010000:0.0:1789117566.959155:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117567.975823:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117568.869308:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593062912:0@lo:41: 00000100:00100000:2.0:1789117568.869403:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117568.869885:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593062912 00000100:00100000:3.0:1789117568.869893:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593062912 00000100:00100000:3.0:1789117568.869949:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789117568.869959:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593062912:12345-0@lo:41: 00000004:00000024:3.0:1789117568.870007:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789117568.873135:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593062912:12345-0@lo:41: Request processed in 3162us (3716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117568.873155:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789117568.875367:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593062912:0@lo:41: 00010000:00010000:1.0:1789117568.997306:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789117569.984977:0:8802:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789117570.024403:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789117570.405127:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789117570.405137:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962bbcf27000 from 30 10000000:01000000:3.0:1789117570.405143:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789117570.405207:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f719 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.405220:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f719 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.405232:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f719 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117570.405261:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593063040:0@lo:101: 00000100:00100000:3.0:1789117570.405350:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117570.405404:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8e9e1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789117570.405740:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593063040 00000100:00100000:0.0:1789117570.405749:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593063040 00000100:00100000:0.0:1789117570.405819:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789117570.405830:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+14:6517:x1876025593063040:12345-0@lo:101: 00010000:00010000:0.0:1789117570.405847:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117570.405862:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962baea9a600/0xaa253ed19be1f720 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f719 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117570.405891:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962baea9a600/0xaa253ed19be1f720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f719 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117570.405937:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962baea9a600/0xaa253ed19be1f720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f719 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117570.405949:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962baea9a600, rc 0) 00000100:00100000:0.0:1789117570.406004:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+15:6517:x1876025593063040:12345-0@lo:101: Request processed in 175us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117570.406011:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789117570.408310:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593063040:0@lo:101: 00010000:00010000:3.0:1789117570.408341:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f719 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f720 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.408377:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f719 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f720 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117570.408493:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593063168:0@lo:501: 00000100:00100000:3.0:1789117570.408554:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117570.408600:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8e9e1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789117570.408749:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593063168 00000100:00100000:0.0:1789117570.408756:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593063168 00000100:00100000:0.0:1789117570.408800:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789117570.408811:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+15:6517:x1876025593063168:12345-0@lo:501: 00000100:00100000:0.0:1789117570.408980:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+15:6517:x1876025593063168:12345-0@lo:501: Request processed in 170us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117570.408987:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789117570.409553:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593063168:0@lo:501: 00000100:00100000:3.0:1789117570.409588:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593063296:0@lo:503: 00000100:00100000:3.0:1789117570.409634:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117570.409664:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8e9e1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789117570.410214:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593063296 00000100:00100000:1.0:1789117570.410220:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593063296 00000100:00100000:1.0:1789117570.410263:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789117570.410271:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+15:6517:x1876025593063296:12345-0@lo:503: 00000100:00100000:1.0:1789117570.410386:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+15:6517:x1876025593063296:12345-0@lo:503: Request processed in 114us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117570.410451:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593063296:0@lo:503: 00000100:00100000:3.0:1789117570.411437:0:8824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:8824:1876025593063424:0@lo:502: 00000100:00100000:3.0:1789117570.411549:0:8824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117570.411587:0:8824:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8e9e1780 going to sleep for 11 seconds 00000100:00100000:0.0:1789117570.411638:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593063424 00000100:00100000:0.0:1789117570.411644:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593063424 00000100:00100000:0.0:1789117570.411681:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789117570.411688:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+16:8824:x1876025593063424:12345-0@lo:502: 00000100:00100000:0.0:1789117570.411786:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+16:8824:x1876025593063424:12345-0@lo:502: Request processed in 97us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117570.411793:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789117570.412126:0:8824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:8824:1876025593063424:0@lo:502: 00000100:00100000:3.0:1789117570.412174:0:8824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:8824:1876025593063552:0@lo:502: 00000100:00100000:3.0:1789117570.412209:0:8824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117570.412232:0:8824:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8e9e1780 going to sleep for 11 seconds 00000100:00100000:0.0:1789117570.412302:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593063552 00000100:00100000:0.0:1789117570.412307:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593063552 00000100:00100000:0.0:1789117570.412329:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789117570.412336:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+16:8824:x1876025593063552:12345-0@lo:502: 00000100:00100000:0.0:1789117570.412407:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+16:8824:x1876025593063552:12345-0@lo:502: Request processed in 71us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117570.412421:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789117570.412551:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789117570.413261:0:8824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:8824:1876025593063552:0@lo:502: 00000040:00080000:3.0:1789117570.413296:0:8824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789117570.413567:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789117570.413626:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789117570.413639:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f719 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f720 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117570.413651:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f720 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117570.413663:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789117570.413667:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962bbcf27000 from 5 10000000:01000000:0.0:1789117570.413670:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789117570.413711:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117570.413720:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117570.413731:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117570.413751:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593063680:0@lo:101: 00000100:00100000:0.0:1789117570.413804:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117570.413842:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8168e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789117570.414848:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593063680 00000100:00100000:1.0:1789117570.414858:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593063680 00000100:00100000:1.0:1789117570.414918:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789117570.415125:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba1a92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+15:6517:x1876025593063680:12345-0@lo:101: 00010000:00010000:1.0:1789117570.415252:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117570.415272:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bc20f5a00/0xaa253ed19be1f72e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f727 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.415301:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bc20f5a00/0xaa253ed19be1f72e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f727 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.415312:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bc20f5a00/0xaa253ed19be1f72e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f727 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.415322:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f5a00, rc 0) 00000100:00100000:1.0:1789117570.415390:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba1a92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+16:6517:x1876025593063680:12345-0@lo:101: Request processed in 270us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117570.415397:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789117570.415604:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593063680:0@lo:101: 00010000:00010000:3.0:1789117570.415624:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f727 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f72e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.415651:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f727 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f72e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117570.415715:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593063808:0@lo:256: 00000100:00100000:3.0:1789117570.415753:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117570.415787:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8e9e1780 going to sleep for 11 seconds 00000100:00100000:0.0:1789117570.415869:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593063808 00000100:00100000:0.0:1789117570.415874:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593063808 00000100:00100000:0.0:1789117570.415907:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789117570.415915:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba1a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+16:6517:x1876025593063808:12345-0@lo:256: 20000000:01000000:0.0:1789117570.416018:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789117570.416044:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789117570.416048:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789117570.416520:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593063808:0@lo:256: 10000000:01000000:1.0:1789117570.416569:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789117570.416581:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f727 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f72e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.416589:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f72e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117570.416598:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789117570.416600:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1789117570.416603:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789117570.416625:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bc20f4400/0xaa253ed19be1f735 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.416632:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962bc20f4400/0xaa253ed19be1f735 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.416639:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962bc20f4400/0xaa253ed19be1f735 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117570.416652:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593063936:0@lo:101: 00000100:00100000:1.0:1789117570.416680:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117570.416712:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bae4ac540 going to sleep for 11 seconds 00000100:00100000:0.0:1789117570.416746:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba1a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+16:6517:x1876025593063808:12345-0@lo:256: Request processed in 830us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117570.416755:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789117570.416781:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593063936 00000100:00100000:0.0:1789117570.416786:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593063936 00000100:00100000:0.0:1789117570.416819:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789117570.416827:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba1a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+16:6517:x1876025593063936:12345-0@lo:101: 00010000:00010000:0.0:1789117570.416838:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117570.416848:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962baea9a200/0xaa253ed19be1f73c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f735 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117570.416867:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962baea9a200/0xaa253ed19be1f73c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f735 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117570.416875:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962baea9a200/0xaa253ed19be1f73c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f735 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117570.416882:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962baea9a200, rc 0) 00000100:00100000:0.0:1789117570.417024:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba1a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593063936:12345-0@lo:101: Request processed in 95us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117570.417032:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789117570.417744:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593063936:0@lo:101: 00010000:00010000:2.0:1789117570.417764:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962bc20f4400/0xaa253ed19be1f735 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f73c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.417772:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962bc20f4400/0xaa253ed19be1f735 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f73c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117570.417860:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593064064:0@lo:501: 00000100:00100000:2.0:1789117570.417899:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117570.418240:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593064064 00000100:00100000:3.0:1789117570.418248:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593064064 00000100:00100000:2.0:1789117570.418365:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b880f6600 going to sleep for 11 seconds 00000100:00100000:3.0:1789117570.418428:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789117570.418447:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90434450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593064064:12345-0@lo:501: 00000100:00100000:3.0:1789117570.418582:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90434450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593064064:12345-0@lo:501: Request processed in 146us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117570.418590:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789117570.418662:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593064064:0@lo:501: 00000100:00100000:2.0:1789117570.418696:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593064192:0@lo:503: 00000100:00100000:2.0:1789117570.418737:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117570.418877:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b880f6600 going to sleep for 11 seconds 00000100:00100000:1.0:1789117570.418911:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593064192 00000100:00100000:1.0:1789117570.418916:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593064192 00000100:00100000:1.0:1789117570.418950:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789117570.418967:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593064192:12345-0@lo:503: 00000100:00100000:1.0:1789117570.419077:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593064192:12345-0@lo:503: Request processed in 120us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117570.419083:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789117570.419162:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593064192:0@lo:503: 00000100:00100000:2.0:1789117570.419514:0:8825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:8825:1876025593064320:0@lo:502: 00000100:00100000:2.0:1789117570.419548:0:8825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117570.419568:0:8825:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b880f69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117570.419675:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593064320 00000100:00100000:1.0:1789117570.419679:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593064320 00000100:00100000:1.0:1789117570.419722:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789117570.419729:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+17:8825:x1876025593064320:12345-0@lo:502: 00000100:00100000:1.0:1789117570.419817:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+17:8825:x1876025593064320:12345-0@lo:502: Request processed in 87us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117570.419824:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789117570.420102:0:8825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:8825:1876025593064320:0@lo:502: 00000020:01000000:2.0:1789117570.420135:0:8825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789117570.420143:0:8825:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789117570.420150:0:8825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117570.420152:0:8825:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789117570.420157:0:8825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789117570.420160:0:8825:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:01000000:2.0:1789117570.420182:0:8825:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789117570.420185:0:8825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789117570.420200:0:8825:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff962bbcdd9a48) 00000020:00000080:2.0:1789117570.420223:0:8825:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1789117570.420229:0:8825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789117570.420333:0:8825:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1789117570.420339:0:8825:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789117570.420352:0:8825:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xaa253ed19be1f74a 00010000:00080000:2.0:1789117570.420380:0:8825:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962bbf97c800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.130@tcp at head 00010000:00010000:2.0:1789117570.420736:0:8825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1789117570.433489:0:8825:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789117570.433529:0:8825:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789117570.433756:0:8825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789117570.434021:0:8825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789117570.434169:0:8825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789117570.434273:0:8825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1789117570.438048:0:8826:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789117570.438077:0:8826:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789117570.440948:0:8825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789117570.440976:0:8825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789117570.441028:0:8825:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789117570.441121:0:8825:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xaa253ed19be1f751 00000100:00080000:2.0:1789117570.441134:0:8825:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789117570.441141:0:8825:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff962bbf97c800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789117570.441183:0:8825:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbf7a7480 x1876025593064448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789117570.442281:0:8825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789117570.442387:0:8825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117570.442393:0:8825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117570.442395:0:8825:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789117570.442398:0:8825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117570.442402:0:8825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117570.442403:0:8825:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789117570.442406:0:8825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789117570.442408:0:8825:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789117570.442590:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593064448:0@lo:8: 00000100:00100000:0.0:1789117570.442676:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117570.446212:0:8825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7a43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:8825:1876025593064576:0@lo:502: 00000100:00100000:2.0:1789117570.446328:0:8825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117570.446392:0:8825:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b780 going to sleep for 11 seconds 00000100:00100000:1.0:1789117570.447030:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593064576 00000100:00100000:1.0:1789117570.447042:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593064576 00000100:00100000:1.0:1789117570.447176:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789117570.447188:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90434050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+17:8825:x1876025593064576:12345-0@lo:502: 00000100:00100000:1.0:1789117570.447378:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90434050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+17:8825:x1876025593064576:12345-0@lo:502: Request processed in 192us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117570.447386:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789117570.447917:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593064448 00000100:00100000:3.0:1789117570.447924:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593064448 00000100:00100000:3.0:1789117570.447947:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789117570.447954:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876025593064448:12345-0@lo:8: 00010000:00080000:3.0:1789117570.447990:0:8433:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:3.0:1789117570.448028:0:8433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xaa253ed19be1f758 00000100:00100000:0.0:1789117570.448047:0:8825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7a43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:8825:1876025593064576:0@lo:502: 00002000:00100000:3.0:1789117570.448086:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff962bbf941800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398c ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789117570.448090:0:8433:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1789117570.448094:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:0.0:1789117570.448098:0:8825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117570.448105:0:8825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117570.448107:0:8825:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789117570.448118:0:8825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:2.0:1789117570.448221:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86809e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593064832:0@lo:400: 00000100:00100000:2.0:1789117570.448264:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117570.448296:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a868083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593065344:0@lo:400: 00000100:00100000:2.0:1789117570.448322:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117570.448345:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117570.448352:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8680a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593064960:0@lo:400: 00000100:00100000:2.0:1789117570.448374:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117570.448418:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593065344 00000100:00100000:2.0:1789117570.448422:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593065344 00000100:00100000:2.0:1789117570.448458:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593064960 00000100:00100000:2.0:1789117570.448462:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593064960 00000100:00100000:2.0:1789117570.448477:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789117570.448484:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593065344:12345-0@lo:400: 00000100:00100000:2.0:1789117570.448525:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593065344:12345-0@lo:400: Request processed in 41us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117570.448532:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789117570.448544:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789117570.448551:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593064960:12345-0@lo:400: 00000100:00100000:2.0:1789117570.448576:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593064960:12345-0@lo:400: Request processed in 26us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117570.448582:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1789117570.448600:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789117570.448622:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a8680a940 x1876025593064960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117570.448635:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8680a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593064960:0@lo:400: 00010000:00080000:2.0:1789117570.448646:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a868083c0 x1876025593065344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117570.448664:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a868083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593065344:0@lo:400: 00002000:00100000:3.0:1789117570.448826:0:8433:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1789117570.449250:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8680ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593064704:0@lo:400: 00000100:00100000:1.0:1789117570.449289:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117570.449310:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593065216:0@lo:400: 00000100:00100000:1.0:1789117570.449330:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117570.449353:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789117570.449360:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86808b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593065088:0@lo:400: 00000100:00100000:1.0:1789117570.449386:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117570.449434:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593064832 00000100:00100000:1.0:1789117570.449440:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593064832 00000100:00100000:1.0:1789117570.449464:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593065088 00000100:00100000:1.0:1789117570.449467:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593065088 00000100:00100000:1.0:1789117570.449480:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789117570.449486:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593064832:12345-0@lo:400: 00000100:00100000:1.0:1789117570.449532:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593064832:12345-0@lo:400: Request processed in 46us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117570.449548:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789117570.449562:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789117570.449567:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86818f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593065088:12345-0@lo:400: 00000100:00100000:1.0:1789117570.449600:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86818f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593065088:12345-0@lo:400: Request processed in 32us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117570.449605:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789117570.449620:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593064704 00000100:00100000:1.0:1789117570.449624:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593064704 00000100:00100000:1.0:1789117570.449641:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593065216 00000100:00100000:1.0:1789117570.449644:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593065216 00000100:00100000:1.0:1789117570.449666:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789117570.449671:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86818b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593064704:12345-0@lo:400: 00000100:00100000:1.0:1789117570.449699:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86818b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593064704:12345-0@lo:400: Request processed in 27us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117570.449705:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789117570.449715:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789117570.449720:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593065216:12345-0@lo:400: 00000100:00100000:1.0:1789117570.449742:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593065216:12345-0@lo:400: Request processed in 22us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117570.449748:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1789117570.449764:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117570.449786:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86808b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593065088:0@lo:400: 00010000:00080000:1.0:1789117570.449797:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a8680ad00 x1876025593064704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117570.449806:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8680ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593064704:0@lo:400: 00010000:00080000:1.0:1789117570.449826:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a86809a40 x1876025593065216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117570.449834:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593065216:0@lo:400: 00000100:00100000:1.0:1789117570.449866:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86809e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593064832:0@lo:400: 00000020:01000000:1.0:1789117570.449883:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1789117570.449910:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789117570.449920:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bc20f4400/0xaa253ed19be1f735 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f73c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.449932:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962bc20f4400/0xaa253ed19be1f735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f73c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117570.449942:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789117570.449944:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962b9832f800 from 30 10000000:01000000:1.0:1789117570.449947:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789117570.449999:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1f75f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.450008:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1f75f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.450019:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1f75f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117570.450034:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a868183c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593065472:0@lo:101: 00000100:00100000:1.0:1789117570.450087:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117570.450111:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f66240 going to sleep for 11 seconds 00002000:00080000:3.0:1789117570.450834:0:8433:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1789117570.450870:0:8433:0:(import.c:65:import_set_state_nolock()) ffff962bbf942000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789117570.450982:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593065472 00000100:00100000:1.0:1789117570.450994:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593065472 00000100:00100000:1.0:1789117570.451050:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789117570.451082:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90436450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593065472:12345-0@lo:101: 00010000:00010000:1.0:1789117570.451092:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117570.451108:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbf70c000/0xaa253ed19be1f766 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f75f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.451147:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbf70c000/0xaa253ed19be1f766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f75f expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.451158:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbf70c000/0xaa253ed19be1f766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f75f expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.451167:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70c000, rc 0) 00000100:00100000:1.0:1789117570.451202:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90436450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593065472:12345-0@lo:101: Request processed in 123us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117570.451208:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789117570.451248:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a868183c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593065472:0@lo:101: 00010000:00010000:1.0:1789117570.451262:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1f75f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f766 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.451272:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1f75f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f766 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117570.451331:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a868183c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593065600:0@lo:501: 00000100:00100000:1.0:1789117570.451358:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117570.451380:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f66240 going to sleep for 11 seconds 00000100:00100000:3.0:1789117570.452679:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1876025593064448:12345-0@lo:8: Request processed in 4717us (9995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117570.452692:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789117570.453234:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593065600 00000100:00100000:2.0:1789117570.453243:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593065600 00000100:00100000:2.0:1789117570.453292:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789117570.453299:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90436050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593065600:12345-0@lo:501: 00000100:00100000:2.0:1789117570.453503:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90436050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593065600:12345-0@lo:501: Request processed in 204us (2143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117570.453511:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789117570.454234:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a868183c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593065600:0@lo:501: 00000100:00100000:3.0:1789117570.454299:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86808f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593065728:0@lo:503: 00000100:00100000:3.0:1789117570.454363:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117570.454538:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8e9e1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117570.454558:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593065728 00000100:00100000:3.0:1789117570.454563:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593065728 00000100:00100000:3.0:1789117570.454598:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789117570.454605:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90434c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593065728:12345-0@lo:503: 00000100:00100000:3.0:1789117570.454696:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90434c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593065728:12345-0@lo:503: Request processed in 90us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117570.454703:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789117570.454744:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86808f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593065728:0@lo:503: 00000100:00100000:3.0:1789117570.454941:0:8828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86808f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:8828:1876025593065856:0@lo:502: 00000100:00100000:3.0:1789117570.455003:0:8828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117570.455022:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593065856 00000100:00100000:3.0:1789117570.455025:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593065856 00000100:00100000:3.0:1789117570.455042:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789117570.455047:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:8828:x1876025593065856:12345-0@lo:502: 00000100:00100000:3.0:1789117570.456882:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:8828:x1876025593065856:12345-0@lo:502: Request processed in 1827us (1871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117570.456894:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789117570.456951:0:8828:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8e9e1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117570.456984:0:8828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86808f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:8828:1876025593065856:0@lo:502: 00000100:00100000:3.0:1789117570.457048:0:8828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86808f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:8828:1876025593065984:0@lo:502: 00000100:00100000:3.0:1789117570.457108:0:8828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789117570.459535:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf7a7480 x1876025593064448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789117580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117570.459553:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789117570.459565:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789117570.459575:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789117570.459581:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789117570.459585:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbf97c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789117570.459600:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789117570.459606:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593064448:0@lo:8: 00000004:00080000:0.0:1789117570.460361:0:8826:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789117570.460451:0:8826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 222743395524ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789117570.460458:0:8826:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789117570.460647:0:8828:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf6296c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117570.461761:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593065984 00000100:00100000:1.0:1789117570.461772:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593065984 00000100:00100000:1.0:1789117570.461851:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789117570.461859:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90437c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+18:8828:x1876025593065984:12345-0@lo:502: 00000100:00100000:1.0:1789117570.462024:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90437c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+18:8828:x1876025593065984:12345-0@lo:502: Request processed in 164us (4914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117570.462032:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789117570.462145:0:8827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86818000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8827:1876025593066112:0@lo:700: 00000100:00100000:3.0:1789117570.464206:0:8828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86808f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:8828:1876025593065984:0@lo:502: 00000040:00080000:3.0:1789117570.464271:0:8828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789117570.466327:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789117570.466405:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789117570.466422:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1f75f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f766 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117570.466440:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1f75f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f766 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117570.466455:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789117570.466460:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962b9832f800 from 5 10000000:01000000:0.0:1789117570.466463:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789117570.466513:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9b600/0xaa253ed19be1f76d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117570.466522:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962baea9b600/0xaa253ed19be1f76d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117570.466544:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962baea9b600/0xaa253ed19be1f76d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117570.466569:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593066240:0@lo:101: 00000100:00100000:0.0:1789117570.466644:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117570.466703:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b880f6600 going to sleep for 11 seconds 00000100:00100000:3.0:1789117570.466772:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593066240 00000100:00100000:3.0:1789117570.466782:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593066240 00000100:00100000:3.0:1789117570.466849:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789117570.466860:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593066240:12345-0@lo:101: 00010000:00010000:3.0:1789117570.466872:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117570.466885:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813dae00/0xaa253ed19be1f774 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f76d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.466908:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813dae00/0xaa253ed19be1f774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f76d expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.466918:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813dae00/0xaa253ed19be1f774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f76d expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.466927:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813dae00, rc 0) 00000100:00100000:3.0:1789117570.466980:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+19:6517:x1876025593066240:12345-0@lo:101: Request processed in 121us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117570.466986:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789117570.467080:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593066240:0@lo:101: 00010000:00010000:3.0:1789117570.467095:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962baea9b600/0xaa253ed19be1f76d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f774 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.467116:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962baea9b600/0xaa253ed19be1f76d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f774 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117570.467390:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86808f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593066368:0@lo:256: 00000100:00100000:3.0:1789117570.467526:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117570.467544:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf6296c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117570.468374:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593066368 00000100:00100000:0.0:1789117570.468381:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593066368 00000100:00100000:0.0:1789117570.468419:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789117570.468428:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90437050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+19:6517:x1876025593066368:12345-0@lo:256: 20000000:01000000:0.0:1789117570.468447:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789117570.468466:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789117570.468469:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1789117570.468567:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90437050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+19:6517:x1876025593066368:12345-0@lo:256: Request processed in 139us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117570.468574:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000004:00080000:3.0:1789117570.468597:0:7451:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1789117570.468638:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86808f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593066368:0@lo:256: 10000000:01000000:3.0:1789117570.468686:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789117570.468695:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9b600/0xaa253ed19be1f76d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f774 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.468704:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962baea9b600/0xaa253ed19be1f76d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f774 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117570.468712:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789117570.468714:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1789117570.468716:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789117570.468742:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f77b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.468749:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f77b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.468758:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f77b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117570.468773:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86808f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593066496:0@lo:101: 00000100:00100000:3.0:1789117570.468810:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117570.468844:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d78180 going to sleep for 11 seconds 00000100:00100000:1.0:1789117570.468888:0:8827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117570.468938:0:8827:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f66e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789117570.468994:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593066496 00000100:00100000:0.0:1789117570.469001:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593066496 00000100:00100000:0.0:1789117570.469034:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789117570.469040:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+19:6517:x1876025593066496:12345-0@lo:101: 00010000:00010000:0.0:1789117570.469048:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117570.469082:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962baea9aa00/0xaa253ed19be1f782 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f77b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117570.469103:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962baea9aa00/0xaa253ed19be1f782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f77b expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117570.469112:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962baea9aa00/0xaa253ed19be1f782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f77b expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117570.469206:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962baea9aa00, rc 0) 00000100:00100000:0.0:1789117570.469378:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+20:6517:x1876025593066496:12345-0@lo:101: Request processed in 337us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117570.469384:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789117570.470280:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593066112 00000100:00100000:3.0:1789117570.470287:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593066112 00000100:00100000:3.0:1789117570.472891:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789117570.472912:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8827:x1876025593066112:12345-0@lo:700: 00000100:00100000:3.0:1789117570.473007:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86809e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8443:1876025593066624:0@lo:700: 00000100:00100000:3.0:1789117570.473123:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117570.473166:0:8443:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d78c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117570.473255:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86808f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593066496:0@lo:101: 00010000:00010000:3.0:1789117570.473283:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f77b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f782 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.473298:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f77b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f782 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117570.473376:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86808f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593066752:0@lo:501: 00000100:00100000:3.0:1789117570.473404:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117570.473433:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d78180 going to sleep for 11 seconds 00000100:00100000:1.0:1789117570.473712:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593066624 00000100:00100000:1.0:1789117570.473719:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593066624 00000100:00100000:1.0:1789117570.473769:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789117570.473778:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86809a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8443:x1876025593066624:12345-0@lo:700: 00000100:00100000:1.0:1789117570.475774:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593066752 00000100:00100000:1.0:1789117570.475787:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593066752 00000100:00100000:1.0:1789117570.475845:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789117570.475855:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90434850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+20:6517:x1876025593066752:12345-0@lo:501: 00000100:00100000:1.0:1789117570.476112:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90434850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+20:6517:x1876025593066752:12345-0@lo:501: Request processed in 258us (2706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117570.476121:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789117570.476189:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86808f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593066752:0@lo:501: 00000100:00100000:1.0:1789117570.476236:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a868183c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593066880:0@lo:503: 00000100:00100000:1.0:1789117570.476288:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117570.476326:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f66f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117570.476653:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593066880 00000100:00100000:3.0:1789117570.476659:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593066880 00000100:00100000:3.0:1789117570.476691:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789117570.476699:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+20:6517:x1876025593066880:12345-0@lo:503: 00000100:00100000:3.0:1789117570.476790:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+20:6517:x1876025593066880:12345-0@lo:503: Request processed in 91us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117570.476797:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789117570.476884:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a868183c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593066880:0@lo:503: 00000100:00080000:0.0:1789117570.477193:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789117570.481142:0:8829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8680ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:8829:1876025593067008:0@lo:502: 00000100:00100000:3.0:1789117570.481248:0:8829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117570.481292:0:8829:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84f40480 going to sleep for 11 seconds 00000100:00100000:0.0:1789117570.483177:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593067008 00000100:00100000:0.0:1789117570.483194:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593067008 00000100:00100000:0.0:1789117570.483264:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789117570.483275:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+20:8829:x1876025593067008:12345-0@lo:502: 00000100:00100000:0.0:1789117570.483477:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+20:8829:x1876025593067008:12345-0@lo:502: Request processed in 203us (2229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117570.483485:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789117570.483825:0:8829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8680ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:8829:1876025593067008:0@lo:502: 00000020:01000000:3.0:1789117570.483867:0:8829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789117570.483877:0:8829:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789117570.483885:0:8829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117570.483888:0:8829:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789117570.483893:0:8829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789117570.483897:0:8829:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:01000000:3.0:1789117570.483921:0:8829:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789117570.483925:0:8829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789117570.483941:0:8829:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff962bb082b490) 00000020:00000080:3.0:1789117570.483975:0:8829:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1789117570.483982:0:8829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789117570.484137:0:8829:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789117570.484144:0:8829:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789117570.484151:0:8829:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa253ed19be1f790 00010000:00080000:3.0:1789117570.484182:0:8829:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962bbf8f5800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.130@tcp at head 00010000:00010000:3.0:1789117570.484629:0:8829:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 40000000:02000000:1.0:1789117570.486310:0:6526:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:1.0:1789117570.495655:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86809a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8443:x1876025593066624:12345-0@lo:700: Request processed in 21871us (22524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117570.495672:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789117570.496092:0:8443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a86809e00 x1876025593066624/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789117586 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117570.496108:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86809e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8443:1876025593066624:0@lo:700: 40000000:02000000:3.0:1789117570.496130:0:8443:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:0.0:1789117570.499817:0:8829:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789117570.499841:0:8829:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789117570.500106:0:8829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789117570.500342:0:8829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789117570.500586:0:8829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789117570.500667:0:8829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1789117570.501074:0:8830:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789117570.501079:0:8830:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789117570.505046:0:8829:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789117570.505079:0:8829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789117570.505211:0:8829:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789117570.505240:0:8829:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa253ed19be1f797 00000100:00080000:0.0:1789117570.505251:0:8829:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789117570.505258:0:8829:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff962bbf8f5800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1789117570.505293:0:8829:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbf6eed00 x1876025593067136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789117570.505333:0:8829:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789117570.505397:0:8829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117570.505401:0:8829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117570.505403:0:8829:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789117570.505406:0:8829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117570.505410:0:8829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117570.505411:0:8829:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789117570.505414:0:8829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789117570.505416:0:8829:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789117570.505552:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593067136:0@lo:8: 00000100:00100000:2.0:1789117570.505624:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117570.505744:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593067136 00000100:00100000:0.0:1789117570.505751:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593067136 00000100:00100000:0.0:1789117570.505789:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789117570.505798:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876025593067136:12345-0@lo:8: 00010000:00080000:0.0:1789117570.505825:0:8437:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:0.0:1789117570.505849:0:8437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa253ed19be1f79e 00002000:00100000:0.0:1789117570.505863:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff962bc1a32800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789117570.505867:0:8437:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789117570.505870:0:8437:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1789117570.506067:0:8829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:8829:1876025593067264:0@lo:502: 00000100:00100000:2.0:1789117570.506119:0:8829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117570.506152:0:8829:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117570.506531:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593067264 00000100:00100000:1.0:1789117570.506539:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593067264 00000100:00100000:1.0:1789117570.506585:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789117570.506595:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+20:8829:x1876025593067264:12345-0@lo:502: 00000100:00100000:1.0:1789117570.506740:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+20:8829:x1876025593067264:12345-0@lo:502: Request processed in 145us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117570.506747:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789117570.507259:0:8829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:8829:1876025593067264:0@lo:502: 00000020:01000000:1.0:1789117570.507291:0:8829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117570.507307:0:8829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117570.507309:0:8829:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789117570.507313:0:8829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1789117570.507384:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1789117570.507407:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789117570.507417:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f77b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f782 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.507428:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f77b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f782 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117570.507439:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789117570.507451:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff962b88028000 from 1 10000000:01000000:1.0:1789117570.507454:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789117570.507491:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70c800/0xaa253ed19be1f7a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.507510:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962bbf70c800/0xaa253ed19be1f7a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.507521:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962bbf70c800/0xaa253ed19be1f7a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117570.507539:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a868183c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593067392:0@lo:101: 00000100:00100000:1.0:1789117570.507577:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117570.507599:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f663c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117570.509814:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593067392 00000100:00100000:3.0:1789117570.509830:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593067392 00000100:00100000:3.0:1789117570.509884:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789117570.509895:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+20:6517:x1876025593067392:12345-0@lo:101: 00010000:00010000:3.0:1789117570.509932:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117570.509954:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813db600/0xaa253ed19be1f7ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f7a5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.509993:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813db600/0xaa253ed19be1f7ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f7a5 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.510004:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813db600/0xaa253ed19be1f7ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f7a5 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.510013:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813db600, rc 0) 00000100:00100000:3.0:1789117570.512105:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593067392:12345-0@lo:101: Request processed in 2203us (4517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117570.512116:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789117570.515856:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a868183c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593067392:0@lo:101: 00010000:00010000:1.0:1789117570.515883:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962bbf70c800/0xaa253ed19be1f7a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f7ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.515896:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962bbf70c800/0xaa253ed19be1f7a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f7ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117570.515985:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a868183c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593067520:0@lo:501: 00000100:00100000:1.0:1789117570.516051:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117570.516128:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f663c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117570.516149:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593067520 00000100:00100000:1.0:1789117570.516154:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593067520 00000100:00100000:1.0:1789117570.516195:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789117570.516203:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83ada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593067520:12345-0@lo:501: 00000100:00100000:1.0:1789117570.516293:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83ada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593067520:12345-0@lo:501: Request processed in 89us (242us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789117570.516300:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789117570.516341:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a868183c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593067520:0@lo:501: 10000000:01000000:1.0:1789117570.516367:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789117570.516373:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70c800/0xaa253ed19be1f7a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f7ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.516382:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962bbf70c800/0xaa253ed19be1f7a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f7ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1789117570.516833:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1789117570.516944:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8827:x1876025593066112:12345-0@lo:700: Request processed in 44039us (48820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117570.516953:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789117570.517076:0:8827:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a86818000 x1876025593066112/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789117586 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117570.517089:0:8827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86818000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8827:1876025593066112:0@lo:700: 00002000:00080000:1.0:1789117570.518412:0:8437:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789117570.518459:0:8437:0:(import.c:65:import_set_state_nolock()) ffff962bc1a2e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789117570.518544:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1876025593067136:12345-0@lo:8: Request processed in 12744us (12917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117570.518558:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789117570.518706:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf6eed00 x1876025593067136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789117580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117570.518718:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789117570.518725:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789117570.518734:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789117570.518740:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789117570.518742:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbf8f5800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789117570.518770:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789117570.518776:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593067136:0@lo:8: 00000004:00080000:1.0:1789117570.520249:0:8830:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789117570.520319:0:8830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 222803264453ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789117570.520326:0:8830:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1789117570.530793:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789117570.530824:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593067648:0@lo:13: 00000100:00100000:1.0:1789117570.530900:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1789117570.530966:0:8827:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789117570.530986:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593067648 00000100:00100000:1.0:1789117570.530991:0:8827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8827:1876025593067776:0@lo:7: 00000100:00100000:2.0:1789117570.530996:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593067648 00000100:00100000:2.0:1789117570.531082:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789117570.531096:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a868183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593067648:12345-0@lo:13: 00002000:00000024:2.0:1789117570.531144:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1789117570.531240:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a868183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593067648:12345-0@lo:13: Request processed in 147us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117570.531248:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789117570.531307:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a86818000 x1876025593067648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117570.531340:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593067648:0@lo:13: 00000100:00100000:1.0:1789117570.531785:0:8827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117570.531821:0:8827:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f66e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789117570.531920:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593067776 00000100:00100000:3.0:1789117570.531927:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593067776 00000100:00100000:3.0:1789117570.531978:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789117570.531987:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8827:x1876025593067776:12345-0@lo:7: 00000100:00100000:2.0:1789117570.531999:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789117570.532012:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:0.0:1789117570.534661:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1789117570.539326:0:8831:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789117570.539418:0:8831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6efc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8831:1876025593068032:0@lo:7: 00000100:00100000:0.0:1789117570.539551:0:8831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117570.539581:0:8831:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c64600 going to sleep for 11 seconds 00000100:00100000:1.0:1789117570.539637:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593067904:0@lo:13: 00000100:00100000:1.0:1789117570.539674:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117570.539721:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593068032 00000100:00100000:1.0:1789117570.539728:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593068032 00000100:00100000:1.0:1789117570.539789:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789117570.539801:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8831:x1876025593068032:12345-0@lo:7: 00000100:00080000:0.0:1789117570.539891:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789117570.540141:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593067904 00000100:00100000:2.0:1789117570.540146:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593067904 00000100:00100000:2.0:1789117570.540177:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117570.540184:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86819e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876025593067904:12345-0@lo:13: 00002000:00000024:2.0:1789117570.541544:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1789117570.541632:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86819e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876025593067904:12345-0@lo:13: Request processed in 1446us (1955us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117570.541642:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789117570.541735:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf6eed00 x1876025593067904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117570.541755:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593067904:0@lo:13: 00002000:00080000:3.0:1789117570.543889:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1789117570.543898:0:8433:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789117570.544191:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8827:x1876025593067776:12345-0@lo:7: Request processed in 12199us (12401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117570.544205:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789117570.545188:0:8827:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a8681a940 x1876025593067776/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789117586 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117570.545218:0:8827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8827:1876025593067776:0@lo:7: 00000004:00080000:2.0:1789117570.545233:0:8827:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789117570.545272:0:8827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7a7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8827:1876025593068160:0@lo:5: 00000100:00100000:2.0:1789117570.545330:0:8827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117570.545364:0:8827:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117570.545424:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593068160 00000100:00100000:3.0:1789117570.545431:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593068160 00000100:00100000:3.0:1789117570.545477:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789117570.545493:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8827:x1876025593068160:12345-0@lo:5: 00002000:00080000:3.0:1789117570.545524:0:8833:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1789117570.545566:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8827:x1876025593068160:12345-0@lo:5: Request processed in 75us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117570.545574:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789117570.545584:0:8827:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf7a7480 x1876025593068160/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789117586 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117570.545595:0:8827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7a7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8827:1876025593068160:0@lo:5: 00000004:00080000:2.0:1789117570.545604:0:8827:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789117570.545625:0:8827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fe940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8827:1876025593068288:0@lo:5: 00000100:00100000:2.0:1789117570.545644:0:8827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117570.545664:0:8827:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117570.545849:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593068288 00000100:00100000:3.0:1789117570.545854:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593068288 00000100:00100000:3.0:1789117570.545888:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789117570.545897:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8827:x1876025593068288:12345-0@lo:5: 00002000:00080000:3.0:1789117570.545920:0:8433:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1789117570.553235:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8827:x1876025593068288:12345-0@lo:5: Request processed in 7333us (7582us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789117570.553249:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789117570.556921:0:8827:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf6fe940 x1876025593068288/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789117586 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117570.556945:0:8827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fe940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8827:1876025593068288:0@lo:5: 00000004:00080000:2.0:1789117570.557091:0:8827:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1789117570.557138:0:8827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8827:1876025593068416:0@lo:900: 00000100:00100000:2.0:1789117570.557221:0:8827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117570.557489:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593068416 00000100:00100000:2.0:1789117570.557496:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593068416 00000100:00100000:2.0:1789117570.557550:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117570.557562:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8827:x1876025593068416:12345-0@lo:900: 00000100:00100000:2.0:1789117570.557622:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8827:x1876025593068416:12345-0@lo:900: Request processed in 62us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117570.557631:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117570.557662:0:8827:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 11 seconds 00010000:00080000:2.0:1789117570.557679:0:8827:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf6ff480 x1876025593068416/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789117586 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117570.557704:0:8827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8827:1876025593068416:0@lo:900: 00002000:00080000:1.0:1789117570.561520:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1789117570.561529:0:8437:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789117570.561618:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8831:x1876025593068032:12345-0@lo:7: Request processed in 21817us (22063us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117570.561629:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789117570.562628:0:8831:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf6efc00 x1876025593068032/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789117586 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117570.562646:0:8831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6efc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8831:1876025593068032:0@lo:7: 00000004:00080000:0.0:1789117570.562664:0:8831:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789117570.562716:0:8831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6efc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8831:1876025593068544:0@lo:5: 00000100:00100000:0.0:1789117570.562763:0:8831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117570.562809:0:8831:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c64600 going to sleep for 11 seconds 00000100:00100000:2.0:1789117570.562820:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593068544 00000100:00100000:2.0:1789117570.562828:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593068544 00000100:00100000:2.0:1789117570.562883:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789117570.562893:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6eed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8831:x1876025593068544:12345-0@lo:5: 00002000:00080000:2.0:1789117570.562921:0:8833:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789117570.562924:0:8833:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:1.0:1789117570.573549:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:1.0:1789117570.573568:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1789117570.573575:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789117570.573767:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6eed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8831:x1876025593068544:12345-0@lo:5: Request processed in 10872us (11000us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789117570.573779:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789117570.573927:0:8831:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf6efc00 x1876025593068544/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789117586 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117570.573941:0:8831:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789117570.573948:0:8831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6efc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8831:1876025593068544:0@lo:5: 00000004:00080000:1.0:1789117570.573975:0:8831:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789117570.574090:0:8831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86818780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8831:1876025593068672:0@lo:700: 00000100:00100000:1.0:1789117570.574138:0:8831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117570.574187:0:8831:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f66540 going to sleep for 11 seconds 00000100:00100000:0.0:1789117570.574320:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593068672 00000100:00100000:0.0:1789117570.574327:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593068672 00000100:00100000:0.0:1789117570.574371:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789117570.574379:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86819680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8831:x1876025593068672:12345-0@lo:700: 00000100:00100000:3.0:1789117570.598970:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86819680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8831:x1876025593068672:12345-0@lo:700: Request processed in 24569us (24810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117570.598989:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789117570.599226:0:8831:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a86818780 x1876025593068672/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789117586 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117570.599244:0:8831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86818780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8831:1876025593068672:0@lo:700: 00000004:02000040:0.0:1789117570.608613:0:8831:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1789117570.613929:0:8831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ee580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8831:1876025593068800:0@lo:5: 00000100:00100000:0.0:1789117570.614032:0:8831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117570.614670:0:8831:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c64000 going to sleep for 11 seconds 00000100:00100000:2.0:1789117570.616587:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593068800 00000100:00100000:2.0:1789117570.616605:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593068800 00000100:00100000:2.0:1789117570.616687:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789117570.616697:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8831:x1876025593068800:12345-0@lo:5: 00002000:00080000:2.0:1789117570.621925:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789117570.621967:0:8433:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1789117570.628899:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8831:x1876025593068800:12345-0@lo:5: Request processed in 12196us (14859us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789117570.628919:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789117570.630186:0:8831:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf6ee580 x1876025593068800/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789117586 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117570.630252:0:8831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ee580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8831:1876025593068800:0@lo:5: 00000004:00080000:3.0:1789117570.630269:0:8831:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000020:00000004:0.0:1789117570.917944:0:8863:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789117570.918748:0:8863:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789117571.049554:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117571.429475:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86809e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593068928:0@lo:41: 00000100:00100000:0.0:1789117571.429559:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117571.429836:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593068928 00000100:00100000:2.0:1789117571.429845:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593068928 00000100:00100000:2.0:1789117571.429896:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789117571.429906:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593068928:12345-0@lo:41: 00000004:00000024:2.0:1789117571.429955:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1789117571.430018:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593068928:12345-0@lo:41: Request processed in 113us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117571.430026:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789117571.430226:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86809e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593068928:0@lo:41: 00000001:00080000:2.0:1789117571.872886:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:1.0:1789117572.071217:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117573.095256:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789117573.922590:0:8964:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789117573.923540:0:8964:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789117574.003314:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593069056:0@lo:41: 00000100:00100000:2.0:1789117574.003588:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117574.003722:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593069056 00000100:00100000:2.0:1789117574.003729:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593069056 00000100:00100000:2.0:1789117574.011820:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789117574.011843:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593069056:12345-0@lo:41: 00000004:00000024:2.0:1789117574.011912:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789117574.012051:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593069056:12345-0@lo:41: Request processed in 216us (8463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117574.012076:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789117574.012135:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593069056:0@lo:41: 00010000:00010000:0.0:1789117574.117956:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789117575.015014:0:9013:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789117575.015025:0:9013:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1789117575.141232:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117575.525334:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789117575.525379:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86808b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593069312:0@lo:400: 00000100:00100000:3.0:1789117575.525496:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117575.525602:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8680a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593069440:0@lo:400: 00000100:00100000:3.0:1789117575.525650:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117575.525728:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789117575.525735:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b9277e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593069824:0@lo:400: 00000100:00100000:3.0:1789117575.525760:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117575.525805:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876025593069952:0@lo:400: 00000100:00100000:3.0:1789117575.525826:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117575.526105:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593069312 00000100:00100000:1.0:1789117575.526115:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593069312 00000100:00100000:1.0:1789117575.526176:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593069824 00000100:00100000:1.0:1789117575.526180:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593069824 00000100:00100000:1.0:1789117575.526211:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593069952 00000100:00100000:1.0:1789117575.526214:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593069952 00000100:00100000:1.0:1789117575.526230:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789117575.526238:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a868083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593069312:12345-0@lo:400: 00000100:00100000:1.0:1789117575.526294:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a868083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593069312:12345-0@lo:400: Request processed in 57us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117575.526302:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789117575.526318:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789117575.526324:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9277fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593069824:12345-0@lo:400: 00000100:00100000:1.0:1789117575.526366:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9277fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593069824:12345-0@lo:400: Request processed in 42us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117575.526372:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789117575.526382:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789117575.526387:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876025593069952:12345-0@lo:400: 00000100:00100000:1.0:1789117575.526432:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876025593069952:12345-0@lo:400: Request processed in 44us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117575.526437:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1789117575.526476:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbfd14b40 x1876025593069952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117575.526489:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876025593069952:0@lo:400: 00010000:00080000:1.0:1789117575.526500:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b9277e580 x1876025593069824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117575.526513:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b9277e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593069824:0@lo:400: 00010000:00080000:1.0:1789117575.526525:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a86808b40 x1876025593069312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117575.526532:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86808b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593069312:0@lo:400: 00000100:00080000:3.0:1789117575.526786:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789117575.526791:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117575.526855:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593069568:0@lo:400: 00000100:00100000:2.0:1789117575.526930:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117575.526949:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593070080:0@lo:400: 00000100:00100000:2.0:1789117575.526972:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117575.527016:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789117575.527022:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8680ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593069184:0@lo:400: 00000100:00100000:2.0:1789117575.527046:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117575.527088:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593069696:0@lo:400: 00000100:00100000:2.0:1789117575.527110:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117575.527128:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593070208:0@lo:400: 00000100:00100000:2.0:1789117575.527146:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117575.527171:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593069440 00000100:00100000:2.0:1789117575.527175:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593069440 00000100:00100000:2.0:1789117575.527196:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593069696 00000100:00100000:2.0:1789117575.527198:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593069696 00000100:00100000:2.0:1789117575.527210:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789117575.527216:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86809e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593069440:12345-0@lo:400: 00000100:00100000:2.0:1789117575.527257:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86809e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593069440:12345-0@lo:400: Request processed in 40us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117575.527263:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789117575.527276:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789117575.527280:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593069696:12345-0@lo:400: 00000100:00100000:2.0:1789117575.527311:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593069696:12345-0@lo:400: Request processed in 30us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117575.527318:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789117575.527334:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593069568 00000100:00100000:2.0:1789117575.527351:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593069568 00000100:00100000:2.0:1789117575.527372:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789117575.527378:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593069568:12345-0@lo:400: 00000100:00100000:2.0:1789117575.527417:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593069568:12345-0@lo:400: Request processed in 39us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117575.527431:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789117575.527463:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593069696:0@lo:400: 00010000:00080000:2.0:1789117575.527474:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a86808f00 x1876025593069568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117575.527483:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593069568:0@lo:400: 00000100:00100000:3.0:1789117575.527724:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593070080 00000100:00100000:3.0:1789117575.527728:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593070080 00000100:00100000:3.0:1789117575.527778:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593070208 00000100:00100000:3.0:1789117575.527781:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593070208 00000100:00100000:3.0:1789117575.527801:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789117575.527808:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593070080:12345-0@lo:400: 00000100:00100000:3.0:1789117575.527848:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593070080:12345-0@lo:400: Request processed in 41us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117575.527854:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789117575.527878:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789117575.527885:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593070208:12345-0@lo:400: 00000100:00100000:3.0:1789117575.527912:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593070208:12345-0@lo:400: Request processed in 28us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117575.527917:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789117575.527945:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbfd143c0 x1876025593070208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117575.527953:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1789117575.527975:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593070208:0@lo:400: 00010000:00080000:3.0:1789117575.528001:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbfd14f00 x1876025593070080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117575.528019:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789117575.528028:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593070080:0@lo:400: 00000100:00100000:1.0:1789117575.528562:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593069184 00000100:00100000:1.0:1789117575.528568:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593069184 00000100:00100000:1.0:1789117575.528615:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789117575.528623:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b904e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+21:3644:x1876025593069184:12345-0@lo:400: 00000100:00100000:1.0:1789117575.528694:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b904e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+21:3644:x1876025593069184:12345-0@lo:400: Request processed in 71us (1645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117575.528700:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789117575.528755:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8680a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593069440:0@lo:400: 00000100:00100000:0.0:1789117575.528910:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8680ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593069184:0@lo:400: 00000100:00080000:2.0:1789117575.528987:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117576.037470:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789117576.037498:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593070336:0@lo:13: 00000100:00100000:0.0:1789117576.037573:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117576.037714:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593070336 00000100:00100000:2.0:1789117576.037722:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593070336 00000100:00100000:2.0:1789117576.037779:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117576.037789:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593070336:12345-0@lo:13: 00002000:00000024:2.0:1789117576.037820:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117576.037881:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593070336:12345-0@lo:13: Request processed in 94us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117576.037889:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789117576.037969:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf6fd2c0 x1876025593070336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117576.037987:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593070336:0@lo:13: 00000100:00100000:0.0:1789117576.038131:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593070464:0@lo:13: 00000100:00100000:0.0:1789117576.038155:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117576.038490:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593070464 00000100:00100000:2.0:1789117576.038495:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593070464 00000100:00100000:2.0:1789117576.038528:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789117576.038534:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593070464:12345-0@lo:13: 00002000:00000024:2.0:1789117576.038546:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117576.038575:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593070464:12345-0@lo:13: Request processed in 42us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117576.038581:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789117576.038636:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbfd14f00 x1876025593070464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117576.038649:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593070464:0@lo:13: 00010000:00010000:1.0:1789117576.165347:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117576.549642:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789117576.549727:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593070592:0@lo:41: 00000100:00100000:2.0:1789117576.549813:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117576.551411:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593070592 00000100:00100000:3.0:1789117576.551425:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593070592 00000100:00100000:3.0:1789117576.551510:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789117576.551524:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593070592:12345-0@lo:41: 00000004:00000024:3.0:1789117576.551582:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1789117576.551701:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593070592:12345-0@lo:41: Request processed in 180us (1886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117576.551709:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789117576.551953:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593070592:0@lo:41: 00010000:00010000:0.0:1789117577.191370:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117578.213230:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117579.112417:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593070720:0@lo:41: 00000100:00100000:2.0:1789117579.112501:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117579.112623:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593070720 00000100:00100000:1.0:1789117579.112632:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593070720 00000100:00100000:1.0:1789117579.112689:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789117579.112699:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593070720:12345-0@lo:41: 00000004:00000024:1.0:1789117579.112739:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789117579.112853:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593070720:12345-0@lo:41: Request processed in 155us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117579.112861:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789117579.112913:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593070720:0@lo:41: 00010000:00010000:0.0:1789117579.239407:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117580.263099:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117580.646549:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593070848:0@lo:400: 00000100:00100000:3.0:1789117580.646632:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117580.646687:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593071360:0@lo:400: 00000100:00100000:3.0:1789117580.646717:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117580.646751:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593071872:0@lo:400: 00000100:00100000:3.0:1789117580.646785:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117580.646811:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789117580.646816:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593070976:0@lo:400: 00000100:00100000:3.0:1789117580.646840:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117580.646869:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593071488:0@lo:400: 00000100:00100000:3.0:1789117580.646891:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117580.646922:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593071104:0@lo:400: 00000100:00100000:3.0:1789117580.646946:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117580.646962:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593071616:0@lo:400: 00000100:00100000:3.0:1789117580.646998:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117580.647015:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789117580.647020:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593071232:0@lo:400: 00000100:00100000:3.0:1789117580.647041:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117580.647051:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593071744:0@lo:400: 00000100:00100000:3.0:1789117580.647106:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117580.647144:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593070848 00000100:00100000:3.0:1789117580.647151:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593070848 00000100:00100000:3.0:1789117580.647198:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789117580.647207:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b904eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+21:3646:x1876025593070848:12345-0@lo:400: 00000100:00100000:3.0:1789117580.647257:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b904eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+21:3646:x1876025593070848:12345-0@lo:400: Request processed in 51us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117580.647265:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789117580.647299:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593071360 00000100:00100000:3.0:1789117580.647303:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593071360 00000100:00100000:3.0:1789117580.647321:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593071104 00000100:00100000:3.0:1789117580.647323:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593071104 00000100:00100000:3.0:1789117580.647335:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789117580.647341:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593071360:12345-0@lo:400: 00000100:00100000:3.0:1789117580.647374:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593071360:12345-0@lo:400: Request processed in 33us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117580.647380:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789117580.647392:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789117580.647398:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593071104:12345-0@lo:400: 00000100:00100000:3.0:1789117580.647430:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593071104:12345-0@lo:400: Request processed in 32us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117580.647436:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789117580.647461:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593071872 00000100:00100000:3.0:1789117580.647465:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593071872 00000100:00100000:3.0:1789117580.647499:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593071744 00000100:00100000:3.0:1789117580.647502:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593071744 00000100:00100000:3.0:1789117580.647521:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789117580.647527:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593071872:12345-0@lo:400: 00000100:00100000:3.0:1789117580.647559:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593071872:12345-0@lo:400: Request processed in 32us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117580.647565:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789117580.647577:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789117580.647583:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593071744:12345-0@lo:400: 00000100:00100000:3.0:1789117580.647609:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593071744:12345-0@lo:400: Request processed in 27us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117580.647615:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789117580.647632:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593070976 00000100:00100000:3.0:1789117580.647636:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593070976 00000100:00100000:3.0:1789117580.647653:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593071488 00000100:00100000:3.0:1789117580.647655:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593071488 00000100:00100000:3.0:1789117580.647669:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593071616 00000100:00100000:3.0:1789117580.647671:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593071616 00000100:00100000:3.0:1789117580.647684:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593071232 00000100:00100000:3.0:1789117580.647686:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593071232 00000100:00100000:3.0:1789117580.647701:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789117580.647707:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593070976:12345-0@lo:400: 00000100:00100000:3.0:1789117580.647737:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593070976:12345-0@lo:400: Request processed in 31us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117580.647743:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789117580.647755:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789117580.647761:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593071488:12345-0@lo:400: 00000100:00100000:3.0:1789117580.647816:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593071488:12345-0@lo:400: Request processed in 55us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117580.647821:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789117580.647832:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789117580.647838:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593071616:12345-0@lo:400: 00000100:00100000:3.0:1789117580.647876:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593071616:12345-0@lo:400: Request processed in 38us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117580.647882:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789117580.647893:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789117580.647899:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593071232:12345-0@lo:400: 00000100:00100000:3.0:1789117580.647922:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593071232:12345-0@lo:400: Request processed in 24us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117580.647927:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1789117580.647977:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbfd16580 x1876025593070976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117580.647991:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593070976:0@lo:400: 00010000:00080000:3.0:1789117580.648002:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbfd170c0 x1876025593071488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117580.648010:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593071488:0@lo:400: 00000100:00100000:3.0:1789117580.648018:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593070848:0@lo:400: 00000100:00100000:3.0:1789117580.648027:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593071360:0@lo:400: 00010000:00080000:3.0:1789117580.648035:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbfd15a40 x1876025593071872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117580.648043:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593071872:0@lo:400: 00010000:00080000:3.0:1789117580.648115:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbfd152c0 x1876025593071232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117580.648124:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593071232:0@lo:400: 00010000:00080000:3.0:1789117580.648134:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbfd15680 x1876025593071744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117580.648142:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593071744:0@lo:400: 00000100:00100000:3.0:1789117580.648151:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593071104:0@lo:400: 00010000:00080000:3.0:1789117580.648159:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbfd14780 x1876025593071616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117580.648167:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593071616:0@lo:400: 00000100:00080000:3.0:1789117580.648185:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789117580.648189:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789117580.648191:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117581.158539:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf81de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593072000:0@lo:13: 00000100:00100000:0.0:1789117581.158648:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117581.158742:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593072000 00000100:00100000:3.0:1789117581.158751:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593072000 00000100:00100000:3.0:1789117581.159338:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789117581.159353:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593072000:12345-0@lo:13: 00002000:00000024:3.0:1789117581.159395:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117581.159467:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593072000:12345-0@lo:13: Request processed in 118us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117581.159474:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789117581.161509:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593072128:0@lo:13: 00000100:00100000:0.0:1789117581.161599:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789117581.164653:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf81de00 x1876025593072000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117581.164686:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf81de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593072000:0@lo:13: 00000100:00100000:1.0:1789117581.168387:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593072128 00000100:00100000:1.0:1789117581.168426:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593072128 00000100:00100000:1.0:1789117581.168501:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789117581.168513:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593072128:12345-0@lo:13: 00002000:00000024:1.0:1789117581.168546:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117581.168732:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593072128:12345-0@lo:13: Request processed in 221us (7133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117581.168740:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789117581.170722:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf6fed00 x1876025593072128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117581.170765:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593072128:0@lo:13: 00010000:00010000:0.0:1789117581.288188:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117581.679835:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf81cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593072256:0@lo:41: 00000100:00100000:3.0:1789117581.679988:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117581.680097:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593072256 00000100:00100000:3.0:1789117581.680105:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593072256 00000100:00100000:3.0:1789117581.680159:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789117581.680167:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593072256:12345-0@lo:41: 00000004:00000024:3.0:1789117581.681379:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1789117581.681455:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593072256:12345-0@lo:41: Request processed in 1285us (1465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117581.681464:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789117581.681636:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf81cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593072256:0@lo:41: 00010000:00010000:0.0:1789117582.312044:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117583.336869:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117584.230140:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593072384:0@lo:41: 00000100:00100000:2.0:1789117584.230234:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117584.230503:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593072384 00000100:00100000:0.0:1789117584.230517:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593072384 00000100:00100000:0.0:1789117584.230595:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789117584.230606:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593072384:12345-0@lo:41: 00000004:00000024:0.0:1789117584.230664:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789117584.231031:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593072384:12345-0@lo:41: Request processed in 426us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117584.231039:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789117584.231281:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593072384:0@lo:41: 00010000:00010000:2.0:1789117584.357356:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117585.382255:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117585.773035:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593072512:0@lo:400: 00000100:00100000:1.0:1789117585.773143:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117585.773314:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593072512 00000100:00100000:3.0:1789117585.773323:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593072512 00000100:00100000:3.0:1789117585.773376:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789117585.773388:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b904eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:3647:x1876025593072512:12345-0@lo:400: 00000100:00100000:0.0:1789117585.776231:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593072640:0@lo:400: 00000100:00100000:3.0:1789117585.779105:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b904eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:3647:x1876025593072512:12345-0@lo:400: Request processed in 5707us (5949us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117585.779121:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789117585.779205:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593072768:0@lo:400: 00000100:00100000:3.0:1789117585.779328:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117585.780426:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789117585.780448:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593073152:0@lo:400: 00000100:00100000:0.0:1789117585.781686:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117585.782433:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789117585.782450:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593073280:0@lo:400: 00000100:00100000:0.0:1789117585.782510:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117585.787765:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593072768 00000100:00100000:1.0:1789117585.787785:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593072768 00000100:00100000:1.0:1789117585.787857:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789117585.787869:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593072768:12345-0@lo:400: 00000100:00100000:1.0:1789117585.788148:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593072768:12345-0@lo:400: Request processed in 281us (8887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117585.788157:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789117585.788901:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593072896:0@lo:400: 00000100:00100000:1.0:1789117585.790465:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593072512:0@lo:400: 00000100:00100000:1.0:1789117585.790502:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593073024:0@lo:400: 00000100:00100000:1.0:1789117585.790558:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117585.790604:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593073024 00000100:00100000:1.0:1789117585.790610:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593073024 00000100:00100000:1.0:1789117585.790649:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789117585.790657:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a868192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593073024:12345-0@lo:400: 00000100:00100000:1.0:1789117585.790730:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a868192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593073024:12345-0@lo:400: Request processed in 73us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117585.790747:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789117585.790783:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593073024:0@lo:400: 00000100:00100000:1.0:1789117585.790790:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593073536:0@lo:400: 00000100:00100000:1.0:1789117585.790817:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117585.790842:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593073536 00000100:00100000:1.0:1789117585.790845:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593073536 00000100:00100000:1.0:1789117585.790883:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789117585.790890:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593073536:12345-0@lo:400: 00000100:00100000:1.0:1789117585.790933:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593073536:12345-0@lo:400: Request processed in 44us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117585.790939:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789117585.790956:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789117585.790978:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bc1a77480 x1876025593073536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117585.790988:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593073536:0@lo:400: 00000100:00100000:0.0:1789117585.792527:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117585.799390:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593072640 00000100:00100000:2.0:1789117585.799404:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593072640 00000100:00100000:2.0:1789117585.799478:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593073280 00000100:00100000:2.0:1789117585.799482:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593073280 00000100:00080000:2.0:1789117585.799514:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789117585.799540:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789117585.799552:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593072640:12345-0@lo:400: 00000100:00100000:2.0:1789117585.799660:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593072640:12345-0@lo:400: Request processed in 111us (17997us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117585.799797:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789117585.799817:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789117585.799823:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593073280:12345-0@lo:400: 00000100:00100000:2.0:1789117585.799858:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593073280:12345-0@lo:400: Request processed in 36us (17347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117585.799864:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1789117585.799974:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b98a312c0 x1876025593073280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117585.799990:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593073280:0@lo:400: 00010000:00080000:2.0:1789117585.800019:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf6ffc00 x1876025593072640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117585.800028:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593072640:0@lo:400: 00000100:00100000:0.0:1789117585.801370:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593073408:0@lo:400: 00000100:00100000:0.0:1789117585.801435:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117585.801514:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593073408 00000100:00100000:3.0:1789117585.801521:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593073408 00000100:00100000:3.0:1789117585.801580:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789117585.801589:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593073408:12345-0@lo:400: 00000100:00100000:3.0:1789117585.801642:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593073408:12345-0@lo:400: Request processed in 55us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117585.801649:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789117585.801691:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117585.801859:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593072768:0@lo:400: 00000100:00100000:3.0:1789117585.801883:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593072896 00000100:00100000:3.0:1789117585.801979:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593072896 00000100:00100000:3.0:1789117585.802006:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593073152 00000100:00100000:3.0:1789117585.802009:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593073152 00000100:00100000:3.0:1789117585.802024:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789117585.802030:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593072896:12345-0@lo:400: 00000100:00100000:3.0:1789117585.802098:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593072896:12345-0@lo:400: Request processed in 68us (9583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117585.802105:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789117585.802117:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789117585.802123:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593073152:12345-0@lo:400: 00000100:00100000:3.0:1789117585.802155:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593073152:12345-0@lo:400: Request processed in 32us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117585.802160:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1789117585.802190:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf6fed00 x1876025593073152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117585.802201:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593073152:0@lo:400: 00000100:00080000:0.0:1789117585.802317:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789117585.802322:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789117585.802342:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf6fd2c0 x1876025593072896/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117585.802352:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593072896:0@lo:400: 00010000:00080000:0.0:1789117585.802362:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf7a7480 x1876025593073408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117585.802370:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593073408:0@lo:400: 00000100:00100000:3.0:1789117586.284706:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789117586.284735:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf81c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593073664:0@lo:13: 00000100:00100000:3.0:1789117586.284815:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117586.284886:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593073664 00000100:00100000:3.0:1789117586.284894:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593073664 00000100:00100000:3.0:1789117586.284948:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789117586.284958:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593073664:12345-0@lo:13: 00002000:00000024:3.0:1789117586.284995:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117586.285043:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593073664:12345-0@lo:13: Request processed in 86us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117586.285050:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789117586.285128:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf81c000 x1876025593073664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117602 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117586.285160:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf81c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593073664:0@lo:13: 00000100:00100000:3.0:1789117586.289366:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117586.289400:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593073792:0@lo:13: 00000100:00100000:3.0:1789117586.289483:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117586.289570:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593073792 00000100:00100000:3.0:1789117586.289579:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593073792 00000100:00100000:3.0:1789117586.289630:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789117586.289640:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593073792:12345-0@lo:13: 00002000:00000024:3.0:1789117586.289676:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117586.289720:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593073792:12345-0@lo:13: Request processed in 81us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117586.289727:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789117586.289780:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bc1a74f00 x1876025593073792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117602 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117586.289801:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593073792:0@lo:13: 00010000:00010000:0.0:1789117586.406501:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117586.792181:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593073920:0@lo:41: 00000100:00100000:1.0:1789117586.792276:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117586.792371:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593073920 00000100:00100000:1.0:1789117586.792380:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593073920 00000100:00100000:1.0:1789117586.792434:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789117586.792444:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593073920:12345-0@lo:41: 00000004:00000024:1.0:1789117586.792495:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789117586.792550:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593073920:12345-0@lo:41: Request processed in 107us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117586.792559:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789117586.792629:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593073920:0@lo:41: 00010000:00010000:2.0:1789117587.431145:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789117588.029142:0:9512:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789117588.029148:0:9512:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789117588.029149:0:9512:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789117588.029288:0:9512:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff962b872f5000 00000020:01000004:2.0:1789117588.029305:0:9512:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789117588.029320:0:9512:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789117588.029335:0:9512:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff962bbcdd8000) 00000020:00000080:2.0:1789117588.029356:0:9512:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789117588.101476:0:9512:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789117588.101554:0:9512:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1789117588.136745:0:9512:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789117588.137025:0:9512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789117588.137043:0:9512:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789117588.137352:0:9512:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xaa253ed19be1f7ba 00000020:01000004:2.0:1789117588.137365:0:9512:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789117588.137402:0:9512:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.130@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789117588.137407:0:9512:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789117588.137416:0:9512:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789117588.137454:0:9512:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789117588.137460:0:9512:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.130@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789117588.197485:0:9512:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789117588.199657:0:9512:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.130@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789117588.199669:0:9512:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789117588.199671:0:9512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789117588.199672:0:9512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789117588.199674:0:9512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789117588.199675:0:9512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789117588.199677:0:9512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789117588.199678:0:9512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789117588.199692:0:9512:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789117588.199693:0:9512:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789117588.199695:0:9512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789117588.199696:0:9512:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789117588.199702:0:9512:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789117588.199705:0:9512:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789117588.199706:0:9512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789117588.199707:0:9512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789117588.199708:0:9512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789117588.199709:0:9512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789117588.199710:0:9512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789117588.199711:0:9512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789117588.199712:0:9512:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789117588.199713:0:9512:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789117588.199714:0:9512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789117588.199715:0:9512:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789117588.199766:0:9512:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789117588.199795:0:9512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593074048:0@lo:253: 00000100:00100000:2.0:1789117588.199889:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117588.199946:0:9512:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f2e480 going to sleep for 11 seconds 00000100:00100000:3.0:1789117588.200003:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593074048 00000100:00100000:3.0:1789117588.200012:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593074048 00000100:00100000:3.0:1789117588.200108:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789117588.200120:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b904e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+21:9512:x1876025593074048:12345-0@lo:253: 20000000:01000000:3.0:1789117588.200171:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789117588.200176:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1789117588.200183:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1789117588.200186:0:6514:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1789117588.200609:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789117588.200784:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1789117588.200802:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1789117588.200817:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1789117588.200824:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1789117588.200835:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1789117588.200851:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1789117588.200942:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1789117588.200957:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.130@tcp 20000000:01000000:3.0:1789117588.200959:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.130@tcp (null) (null) (null) 00000040:00080000:3.0:1789117588.200974:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1789117588.200979:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789117588.200992:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1789117588.200997:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.130@tcp (null) (null) 00000040:00080000:3.0:1789117588.201009:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1789117588.201016:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789117588.201028:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1789117588.201043:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1789117588.201150:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1789117588.201161:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.130@tcp 20000000:01000000:3.0:1789117588.201163:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.130@tcp (null) (null) (null) 00000040:00080000:3.0:1789117588.201176:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1789117588.201181:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789117588.201193:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1789117588.201198:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.204.130@tcp (null) (null) 00000040:00080000:3.0:1789117588.201210:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1789117588.201215:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789117588.201225:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1789117588.201239:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1789117588.201606:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1789117588.201619:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.130@tcp 20000000:01000000:3.0:1789117588.201646:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.130@tcp (null) (null) (null) 00000040:00080000:3.0:1789117588.201669:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1789117588.201676:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789117588.201691:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1789117588.201695:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.130@tcp (null) (null) 00000040:00080000:3.0:1789117588.201706:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1789117588.201711:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789117588.201723:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1789117588.201739:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1789117588.201752:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789117588.201756:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789117588.201760:0:6514:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789117588.201813:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789117588.201816:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789117588.211084:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1789117588.211342:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1789117588.211362:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1789117588.213737:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1789117588.213775:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1789117588.213790:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1789117588.213801:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789117588.213804:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789117588.214849:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1789117588.214888:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1789117588.214905:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1789117588.215153:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1789117588.215180:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1789117588.215200:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:0.0:1789117588.215213:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789117588.215216:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789117588.218453:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1789117588.218520:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1789117588.218537:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1789117588.218991:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1789117588.219019:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1789117588.219096:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1789117588.219113:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789117588.219117:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789117588.219671:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1789117588.219761:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1789117588.219781:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1789117588.219794:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1789117588.219801:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789117588.219804:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789117588.220288:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1789117588.220321:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1789117588.220336:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1789117588.220636:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1789117588.220661:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1789117588.220676:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 10000000:01000000:0.0:1789117588.220705:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789117588.220731:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962baea9be00/0xaa253ed19be1f7c1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.220749:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b813db400/0xaa253ed19be1f6b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f6b0 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.220757:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be1f6e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f6da expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.220764:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962baea9a600/0xaa253ed19be1f720 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f719 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.220770:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962baea9a200/0xaa253ed19be1f73c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f735 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.220777:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962bbf70c000/0xaa253ed19be1f766 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f75f expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.220785:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962baea9aa00/0xaa253ed19be1f782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f77b expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.220791:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b813db600/0xaa253ed19be1f7ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f7a5 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.220799:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962baea9be00/0xaa253ed19be1f7c1 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.220843:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b813db600/0xaa253ed19be1f7ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f7a5 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.220860:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962b813db600/0xaa253ed19be1f7ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f7a5 expref: 21 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117588.220886:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6e940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593074176:0@lo:104: 00000100:00100000:0.0:1789117588.220964:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789117588.225828:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962baea9aa00/0xaa253ed19be1f782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f77b expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.225854:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962baea9aa00/0xaa253ed19be1f782 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f77b expref: 21 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117588.225872:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6ed00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593074304:0@lo:104: 00000100:00100000:0.0:1789117588.227526:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117588.235209:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593074176 00000100:00100000:3.0:1789117588.235224:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593074176 00000100:00100000:3.0:1789117588.235276:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593074304 00000100:00100000:3.0:1789117588.235280:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593074304 00000100:00100000:3.0:1789117588.235297:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789117588.235306:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+4:6514:x1876025593074176:12345-0@lo:104: 00010000:00010000:1.0:1789117588.235309:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962bbf70c000/0xaa253ed19be1f766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f75f expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.235321:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962bbf70c800/0xaa253ed19be1f7a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f7ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.235324:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962bbf70c000/0xaa253ed19be1f766 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f75f expref: 21 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117588.235338:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681b0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593074432:0@lo:104: 00000100:00100000:1.0:1789117588.235383:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789117588.235405:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962baea9a200/0xaa253ed19be1f73c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f735 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.235406:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789117588.235411:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+4:6514:x1876025593074176:12345-0@lo:104: Request processed in 107us (14448us total) trans 0 rc 0/0 00010000:00010000:1.0:1789117588.235413:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962baea9a200/0xaa253ed19be1f73c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f735 expref: 21 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117588.235421:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86818780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593074560:0@lo:104: 00000100:00100000:3.0:1789117588.235442:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789117588.235458:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593074432 00000100:00100000:1.0:1789117588.235459:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117588.235461:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593074432 00000100:00100000:3.0:1789117588.235472:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593074560 00000100:00100000:3.0:1789117588.235475:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593074560 00010000:00010000:1.0:1789117588.235476:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962baea9a600/0xaa253ed19be1f720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f719 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117588.235484:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1789117588.235486:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962baea9a600/0xaa253ed19be1f720 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f719 expref: 21 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117588.235490:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+5:6514:x1876025593074304:12345-0@lo:104: 00010000:00010000:3.0:1789117588.235497:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f77b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f782 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117588.235501:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86818000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593074688:0@lo:104: 00000100:00100000:1.0:1789117588.235522:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789117588.235536:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1789117588.235538:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be1f6e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f6da expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117588.235541:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+5:6514:x1876025593074304:12345-0@lo:104: Request processed in 51us (8025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117588.235547:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1789117588.235547:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be1f6e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f6da expref: 21 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117588.235555:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fd2c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593074816:0@lo:104: 00000100:00100000:3.0:1789117588.235557:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593074688 00000100:00100000:3.0:1789117588.235560:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593074688 00000100:00100000:3.0:1789117588.235572:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789117588.235577:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86819a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+5:6514:x1876025593074432:12345-0@lo:104: 00010000:00010000:3.0:1789117588.235585:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1f75f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f766 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117588.235592:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789117588.235607:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1789117588.235610:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b813db400/0xaa253ed19be1f6b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f6b0 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117588.235611:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86819a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+5:6514:x1876025593074432:12345-0@lo:104: Request processed in 35us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117588.235618:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1789117588.235629:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962b813db400/0xaa253ed19be1f6b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f6b0 expref: 21 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117588.235638:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fed00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593074944:0@lo:104: 00000100:00100000:1.0:1789117588.235657:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86ab5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789117588.235664:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789117588.235679:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6e940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593074176:0@lo:104: 00000100:00100000:3.0:1789117588.235680:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117588.235688:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6ed00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593074304:0@lo:104: 00000100:00100000:3.0:1789117588.235689:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593074816 00000100:00100000:1.0:1789117588.235694:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681b0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593074432:0@lo:104: 00000100:00100000:3.0:1789117588.235696:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593074816 00000100:00100000:3.0:1789117588.235709:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593074944 00000100:00100000:3.0:1789117588.235711:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593074944 00000100:00100000:3.0:1789117588.235723:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789117588.235729:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+6:6514:x1876025593074560:12345-0@lo:104: 00010000:00010000:3.0:1789117588.235736:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962bc20f4400/0xaa253ed19be1f735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f73c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.235779:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789117588.235784:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+6:6514:x1876025593074560:12345-0@lo:104: Request processed in 56us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117588.235792:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789117588.235804:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789117588.235809:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+5:6514:x1876025593074688:12345-0@lo:104: 00010000:00010000:3.0:1789117588.235816:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f720 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.235842:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789117588.235846:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+5:6514:x1876025593074688:12345-0@lo:104: Request processed in 38us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117588.235852:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789117588.235863:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789117588.235869:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+4:6514:x1876025593074816:12345-0@lo:104: 00010000:00010000:3.0:1789117588.235876:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f6da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f6e1 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.235902:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1789117588.235907:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+4:6514:x1876025593074816:12345-0@lo:104: Request processed in 39us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117588.235917:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86818780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593074560:0@lo:104: 00000100:00100000:3.0:1789117588.235920:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789117588.235923:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86818000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593074688:0@lo:104: 00000100:00100000:1.0:1789117588.235929:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fd2c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593074816:0@lo:104: 00000100:00100000:3.0:1789117588.235950:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789117588.235956:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+3:6514:x1876025593074944:12345-0@lo:104: 00010000:00010000:3.0:1789117588.235963:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b813da800/0xaa253ed19be1f6b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f6b7 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.235973:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1789117588.235980:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bbf70c800/0xaa253ed19be1f7a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f7ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.235988:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c800 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117588.235994:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70c800/0xaa253ed19be1f7a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f7ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.236001:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00010000:00010000:0.0:1789117588.236003:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bbf70c800/0xaa253ed19be1f7a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f7ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117588.236005:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+3:6514:x1876025593074944:12345-0@lo:104: Request processed in 50us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117588.236012:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 10000000:00010000:0.0:1789117588.236012:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70c800/0xaa253ed19be1f7a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f7ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117588.236018:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789117588.236029:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1789117588.236091:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962bbf70c800/0xaa253ed19be1f7a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f7ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236098:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117588.236124:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bbf70c800/0xaa253ed19be1f7a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f7ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236131:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bbf70c800/0xaa253ed19be1f7a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f7ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236147:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789117588.236150:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1f75f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f766 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236156:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d400 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117588.236159:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1f75f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f766 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236166:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1f75f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f766 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117588.236173:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1f75f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f766 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117588.236178:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789117588.236195:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1f75f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f766 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236201:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117588.236214:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1f75f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f766 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236221:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1f75f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f766 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236231:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789117588.236240:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bc20f4400/0xaa253ed19be1f735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f73c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236246:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4400 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117588.236250:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bc20f4400/0xaa253ed19be1f735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f73c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236256:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bc20f4400/0xaa253ed19be1f735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f73c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117588.236261:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bc20f4400/0xaa253ed19be1f735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f73c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117588.236266:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789117588.236281:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962bc20f4400/0xaa253ed19be1f735 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f73c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236286:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117588.236291:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bc20f4400/0xaa253ed19be1f735 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f73c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236297:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bc20f4400/0xaa253ed19be1f735 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f73c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236306:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789117588.236308:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f720 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236313:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dbe00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117588.236316:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f720 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236332:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f720 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117588.236338:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f720 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117588.236342:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789117588.236366:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f719 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f720 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236371:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117588.236377:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f719 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f720 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236383:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f719 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f720 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236392:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789117588.236395:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f6da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f6e1 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236401:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9ba00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117588.236404:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f6da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f6e1 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236410:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f6da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f6e1 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117588.236416:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f6da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f6e1 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117588.236427:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789117588.236583:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fed00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1876025593074944:0@lo:104: 00010000:00010000:1.0:1789117588.236641:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962baea9be00/0xaa253ed19be1f7c1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236765:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f6da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f6e1 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236772:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117588.236777:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f6da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f6e1 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236783:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f6da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f6e1 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236793:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117588.236796:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b813da800/0xaa253ed19be1f6b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f6b7 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236801:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813da800 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117588.236804:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b813da800/0xaa253ed19be1f6b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f6b7 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236811:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b813da800/0xaa253ed19be1f6b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f6b7 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117588.236816:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b813da800/0xaa253ed19be1f6b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f6b7 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117588.236822:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789117588.236834:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b813da800/0xaa253ed19be1f6b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f6b7 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236839:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117588.236850:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b813da800/0xaa253ed19be1f6b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f6b7 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236856:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b813da800/0xaa253ed19be1f6b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f6b7 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.236866:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117588.236868:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117588.236870:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117588.236889:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593075072:0@lo:103: 00000100:00100000:0.0:1789117588.236942:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117588.236979:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87888b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593075584:0@lo:103: 00000100:00100000:0.0:1789117588.237000:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117588.237023:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789117588.237029:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8788a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593075456:0@lo:103: 00000100:00100000:0.0:1789117588.237076:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117588.237118:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593075072 00000100:00100000:0.0:1789117588.237124:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593075072 00010000:00010000:0.0:1789117588.237166:0:7470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b813db600/0xaa253ed19be1f7ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f7a5 expref: 22 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117588.237195:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593075584 00000100:00100000:0.0:1789117588.237199:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593075584 00010000:00010000:0.0:1789117588.237213:0:7470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be1f6e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f6da expref: 23 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117588.237223:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593075456 00000100:00100000:0.0:1789117588.237225:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593075456 00010000:00010000:0.0:1789117588.237233:0:7470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962baea9a600/0xaa253ed19be1f720 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f719 expref: 24 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117588.237260:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789117588.237268:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87888f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3647:x1876025593075072:12345-0@lo:103: 00010000:00010000:0.0:1789117588.237280:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117588.237286:0:7470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b813db600/0xaa253ed19be1f7ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f7a5 expref: 24 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.237298:0:7470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b813db600/0xaa253ed19be1f7ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f7a5 expref: 24 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.237316:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813db600/0xaa253ed19be1f7ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f7a5 expref: 24 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.237328:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117588.237365:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87888f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+23:3647:x1876025593075072:12345-0@lo:103: Request processed in 97us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117588.237373:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789117588.237391:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789117588.237398:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a878883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+22:3647:x1876025593075584:12345-0@lo:103: 00010000:00010000:0.0:1789117588.237406:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117588.237411:0:7470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be1f6e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f6da expref: 22 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.237420:0:7470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be1f6e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f6da expref: 22 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117588.237761:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789117588.237773:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87888000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+22:3647:x1876025593075456:12345-0@lo:103: 00010000:00010000:1.0:1789117588.237782:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117588.237789:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962baea9a600/0xaa253ed19be1f720 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f719 expref: 22 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.237821:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be1f6e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f6da expref: 22 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117588.239382:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593075200:0@lo:103: 00000100:00100000:3.0:1789117588.239481:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117588.239509:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8788b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593075712:0@lo:103: 00000100:00100000:3.0:1789117588.239530:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117588.239552:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117588.239559:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593075328:0@lo:103: 00000100:00100000:3.0:1789117588.239578:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117588.239609:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1789117588.239634:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:3.0:1789117588.239725:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593075200 00000100:00100000:3.0:1789117588.239732:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593075200 00010000:00010000:3.0:1789117588.239770:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962bbf70c000/0xaa253ed19be1f766 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f75f expref: 22 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117588.239794:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1789117588.239799:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593075712 00000100:00100000:3.0:1789117588.239814:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593075712 00010000:00010000:3.0:1789117588.239826:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b813db400/0xaa253ed19be1f6b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f6b0 expref: 23 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117588.239837:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1789117588.239841:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593075328 00000100:00100000:3.0:1789117588.239843:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593075328 00010000:00010000:3.0:1789117588.239852:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962baea9a200/0xaa253ed19be1f73c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f735 expref: 24 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117588.239861:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1789117588.239868:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789117588.239877:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb0938c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593075200:12345-0@lo:103: 00010000:00010000:3.0:1789117588.239893:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117588.239899:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962bbf70c000/0xaa253ed19be1f766 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f75f expref: 24 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.241769:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962baea9a600/0xaa253ed19be1f720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f719 expref: 24 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.241802:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962baea9a600/0xaa253ed19be1f720 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f719 expref: 24 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.241821:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117588.241920:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87888000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+23:3647:x1876025593075456:12345-0@lo:103: Request processed in 4147us (4867us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117588.241931:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789117588.241966:0:6506:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1789117588.241979:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789117588.241993:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+22:3644:x1876025593075712:12345-0@lo:103: 00010000:00010000:1.0:1789117588.242010:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117588.242016:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b813db400/0xaa253ed19be1f6b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f6b0 expref: 22 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.242025:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b813db400/0xaa253ed19be1f6b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f6b0 expref: 22 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.242081:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813db400/0xaa253ed19be1f6b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f6b0 expref: 22 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.242092:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117588.242139:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+21:3644:x1876025593075712:12345-0@lo:103: Request processed in 153us (2607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117588.242146:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789117588.242163:0:6506:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1789117588.242169:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789117588.242176:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+20:3644:x1876025593075328:12345-0@lo:103: 00010000:00010000:1.0:1789117588.242185:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117588.242189:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962baea9a200/0xaa253ed19be1f73c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f735 expref: 20 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.242199:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962baea9a200/0xaa253ed19be1f73c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f735 expref: 20 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.242210:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962baea9a200/0xaa253ed19be1f73c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f735 expref: 20 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.242218:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117588.242242:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+19:3644:x1876025593075328:12345-0@lo:103: Request processed in 68us (2664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117588.242248:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789117588.243667:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593075328:0@lo:103: 00000100:00100000:2.0:1789117588.243683:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8788b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593075712:0@lo:103: 00000100:00100000:2.0:1789117588.246220:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8788a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593075456:0@lo:103: 00000100:00100000:2.0:1789117588.246239:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593075072:0@lo:103: 00010000:00010000:0.0:1789117588.247472:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117588.247646:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a878883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+18:3647:x1876025593075584:12345-0@lo:103: Request processed in 10243us (10639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117588.247658:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789117588.248167:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87888b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593075584:0@lo:103: 00010000:00010000:2.0:1789117588.251442:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117588.251510:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117588.251514:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117588.252448:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f77b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f782 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.252485:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db800 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789117588.252491:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f77b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f782 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.252503:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f77b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f782 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117588.252510:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f77b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f782 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117588.252516:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789117588.252574:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f77b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f782 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.252581:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117588.252613:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f77b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f782 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.252631:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f77b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f782 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.252661:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117588.252662:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593075840:0@lo:103: 00010000:00010000:1.0:1789117588.252664:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117588.252665:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117588.252748:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789117588.252860:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962bbf70c000/0xaa253ed19be1f766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f75f expref: 17 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.252880:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bbf70c000/0xaa253ed19be1f766 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f75f expref: 17 pid: 6514 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.252972:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117588.254463:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593075840 00000100:00100000:0.0:1789117588.254479:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593075840 00010000:00010000:0.0:1789117588.254519:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962baea9aa00/0xaa253ed19be1f782 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f77b expref: 17 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117588.254556:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789117588.254577:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a77840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+17:3645:x1876025593075840:12345-0@lo:103: 00010000:00010000:0.0:1789117588.254595:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117588.254601:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962baea9aa00/0xaa253ed19be1f782 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f77b expref: 17 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.254612:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962baea9aa00/0xaa253ed19be1f782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f77b expref: 17 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.254641:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962baea9aa00/0xaa253ed19be1f782 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f77b expref: 17 pid: 6513 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.254653:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962baea9be00/0xaa253ed19be1f7c1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.254663:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962baea9be00/0xaa253ed19be1f7c1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.254682:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962baea9be00/0xaa253ed19be1f7c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.254689:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962baea9be00/0xaa253ed19be1f7c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.254711:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962baea9be00/0xaa253ed19be1f7c1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.254719:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962baea9be00/0xaa253ed19be1f7c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.254725:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9be00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789117588.254731:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962baea9be00/0xaa253ed19be1f7c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.254740:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962baea9be00/0xaa253ed19be1f7c1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.254759:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962baea9be00/0xaa253ed19be1f7c1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.254771:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117588.254863:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a77840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+16:3645:x1876025593075840:12345-0@lo:103: Request processed in 288us (2114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117588.254871:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789117588.254926:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593075840:0@lo:103: 00000100:00100000:2.0:1789117588.263152:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb0938c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+15:3644:x1876025593075200:12345-0@lo:103: Request processed in 23264us (23659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117588.263171:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789117588.263390:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593075200:0@lo:103: 00010000:00010000:3.0:1789117588.265167:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962baea9be00/0xaa253ed19be1f7c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.265188:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962baea9be00/0xaa253ed19be1f7c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.265222:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962baea9be00/0xaa253ed19be1f7c1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789117588.265246:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789117588.267802:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b904e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+14:9512:x1876025593074048:12345-0@lo:253: Request processed in 67671us (67898us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117588.267820:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789117588.268002:0:9512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593074048:0@lo:253: 10000000:01000000:2.0:1789117588.268020:0:9512:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789117588.268024:0:9512:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789117588.268026:0:9512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789117588.268027:0:9512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789117588.268028:0:9512:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789117588.268030:0:9512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789117588.268031:0:9512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789117588.268033:0:9512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789117588.268035:0:9512:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789117588.268037:0:9512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789117588.268038:0:9512:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789117588.268084:0:9512:0:(tgt_mount.c:101:server_register_mount()) register mount ffff962b872f5000 from lustre-OST0001 10000000:01000000:0.0:1789117588.268203:0:9512:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789117588.268208:0:9512:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789117588.268217:0:9512:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff962b88028000 local copy 10000000:01000000:0.0:1789117588.268222:0:9512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789117588.268262:0:9512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.268274:0:9512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.268290:0:9512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117588.268310:0:9512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87888b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593075968:0@lo:101: 00000100:00100000:0.0:1789117588.268353:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117588.268389:0:9512:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86ab5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789117588.268567:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593075968 00000100:00100000:3.0:1789117588.268574:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593075968 00000100:00100000:3.0:1789117588.268635:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789117588.268646:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+14:9512:x1876025593075968:12345-0@lo:101: 00010000:00010000:3.0:1789117588.268661:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117588.268679:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813db200/0xaa253ed19be1f7cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f7c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.268706:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813db200/0xaa253ed19be1f7cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f7c8 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.268717:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813db200/0xaa253ed19be1f7cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f7c8 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.268727:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813db200, rc 0) 00000100:00100000:3.0:1789117588.268776:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+15:9512:x1876025593075968:12345-0@lo:101: Request processed in 132us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117588.268783:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789117588.269168:0:9512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87888b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593075968:0@lo:101: 00010000:00010000:2.0:1789117588.269183:0:9512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xaa253ed19be1f7cf expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117588.269192:0:9512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xaa253ed19be1f7cf expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117588.269296:0:9512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593076096:0@lo:501: 00000100:00100000:2.0:1789117588.269334:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117588.269367:0:9512:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f2e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117588.269411:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593076096 00000100:00100000:3.0:1789117588.269416:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593076096 00000100:00100000:3.0:1789117588.269448:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789117588.269470:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+15:9512:x1876025593076096:12345-0@lo:501: 00000100:00100000:3.0:1789117588.269533:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+15:9512:x1876025593076096:12345-0@lo:501: Request processed in 66us (198us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789117588.269540:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789117588.269579:0:9512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593076096:0@lo:501: 10000000:01000000:3.0:1789117588.269594:0:9512:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789117588.269613:0:9512:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789117588.269630:0:9512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xaa253ed19be1f7cf expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.269638:0:9512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xaa253ed19be1f7cf expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.269645:0:9512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xaa253ed19be1f7cf expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.269661:0:9512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789117588.269687:0:9512:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff962b872f5000 10000000:01000000:3.0:1789117588.269692:0:9512:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789117588.269697:0:9512:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789117588.269699:0:9512:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789117588.269703:0:9512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789117588.269706:0:9512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789117588.269724:0:9512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1f7d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.269731:0:9512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1f7d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.269749:0:9512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1f7d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117588.269762:0:9512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf81d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593076224:0@lo:101: 00000100:00100000:3.0:1789117588.269791:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117588.269800:0:9512:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf612780 going to sleep for 11 seconds 00000100:00100000:3.0:1789117588.269819:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593076224 00000100:00100000:3.0:1789117588.269823:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593076224 00000100:00100000:3.0:1789117588.269839:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789117588.269844:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+15:9512:x1876025593076224:12345-0@lo:101: 00010000:00010000:3.0:1789117588.269853:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117588.269864:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813db600/0xaa253ed19be1f7dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f7d6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.269881:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813db600/0xaa253ed19be1f7dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f7d6 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.270020:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117588.270025:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813db600/0xaa253ed19be1f7dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f7d6 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.270027:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xaa253ed19be1f7cf expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.270035:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9ba00 already unused, calling callback (ffffffffc13d9c20) 00010000:00010000:3.0:1789117588.270036:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813db600, rc 0) 10000000:00010000:0.0:1789117588.270039:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xaa253ed19be1f7cf expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.270047:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xaa253ed19be1f7cf expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117588.270070:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xaa253ed19be1f7cf expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117588.270076:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789117588.270088:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+16:9512:x1876025593076224:12345-0@lo:101: Request processed in 244us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117588.270095:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00010000:00010000:0.0:1789117588.270096:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xaa253ed19be1f7cf expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.270113:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789117588.270130:0:9512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf81d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593076224:0@lo:101: 00010000:00010000:0.0:1789117588.270130:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xaa253ed19be1f7cf expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.270137:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xaa253ed19be1f7cf expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.270141:0:9512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1f7d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f7dd expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.270155:0:9512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1f7d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f7dd expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.270156:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117588.270158:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117588.270160:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117588.270170:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8788b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593076352:0@lo:103: 00000100:00100000:0.0:1789117588.270201:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117588.270213:0:9512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf81d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593076480:0@lo:501: 00000100:00100000:3.0:1789117588.270237:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117588.270240:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593076352 00000100:00100000:0.0:1789117588.270244:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593076352 00000100:00100000:0.0:1789117588.270257:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593076480 00000100:00100000:3.0:1789117588.270258:0:9512:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbd0c73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117588.270259:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593076480 00000100:00100000:0.0:1789117588.270275:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789117588.270281:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+17:9512:x1876025593076480:12345-0@lo:501: 00000100:00100000:0.0:1789117588.270389:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+17:9512:x1876025593076480:12345-0@lo:501: Request processed in 106us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117588.271991:0:9512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf81d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593076480:0@lo:501: 00000100:00100000:2.0:1789117588.272050:0:9512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593076608:0@lo:503: 00000100:00100000:2.0:1789117588.272146:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117588.272186:0:9512:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f2ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1789117588.272678:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593076608 00000100:00100000:3.0:1789117588.272687:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593076608 00000100:00100000:3.0:1789117588.272744:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789117588.272753:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+18:9512:x1876025593076608:12345-0@lo:503: 00000100:00100000:3.0:1789117588.272881:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+18:9512:x1876025593076608:12345-0@lo:503: Request processed in 129us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117588.272889:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789117588.273232:0:9512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593076608:0@lo:503: 00000040:00080000:2.0:1789117588.273521:0:9512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789117588.273646:0:9512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593076736:0@lo:502: 00000100:00100000:2.0:1789117588.273700:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117588.273722:0:9512:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f2ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789117588.273745:0:6514:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1789117588.273752:0:6514:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:3.0:1789117588.273939:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593076736 00000100:00100000:3.0:1789117588.273944:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593076736 00000100:00100000:3.0:1789117588.273967:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789117588.273974:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+18:9512:x1876025593076736:12345-0@lo:502: 00000100:00100000:3.0:1789117588.274084:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+18:9512:x1876025593076736:12345-0@lo:502: Request processed in 110us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117588.274092:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789117588.275582:0:9512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593076736:0@lo:502: 00000040:00080000:2.0:1789117588.275891:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789117588.276043:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1789117588.276093:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1789117588.276112:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1789117588.276125:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1789117588.276137:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1789117588.276180:0:9512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593076864:0@lo:502: 00000100:00100000:2.0:1789117588.276259:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117588.276308:0:9512:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f2ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1789117588.276412:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593076864 00000100:00100000:3.0:1789117588.276422:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593076864 00000100:00100000:3.0:1789117588.276480:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789117588.276492:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+18:9512:x1876025593076864:12345-0@lo:502: 00000100:00100000:3.0:1789117588.276642:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+18:9512:x1876025593076864:12345-0@lo:502: Request processed in 152us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117588.276660:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789117588.277113:0:9512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593076864:0@lo:502: 00000040:00080000:2.0:1789117588.277178:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789117588.277189:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000100:00100000:3.0:1789117588.279170:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789117588.279187:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8788a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7945443b-b7e4-4157-aee9-c9b2172613e6+17:3646:x1876025593076352:12345-0@lo:103: 00010000:00010000:3.0:1789117588.279205:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117588.279227:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813db200/0xaa253ed19be1f7cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be1f7c8 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.279245:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117588.279328:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8788a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7945443b-b7e4-4157-aee9-c9b2172613e6+16:3646:x1876025593076352:12345-0@lo:103: Request processed in 147us (9125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117588.279336:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:2.0:1789117588.279592:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789117588.279601:0:9526:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1789117588.279607:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117588.279610:0:9526:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789117588.279616:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789117588.279654:0:9526:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff962a878a9a48) 00000020:00000080:2.0:1789117588.279683:0:9526:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789117588.279690:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789117588.279764:0:9526:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962b872f5000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789117588.279772:0:9526:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789117588.279780:0:9526:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xaa253ed19be1f7eb 00000100:00100000:0.0:1789117588.279826:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789117588.279883:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8788b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593076352:0@lo:103: 00010000:00010000:0.0:1789117588.288629:0:9526:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1789117588.288925:0:9526:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1789117588.294417:0:9526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789117588.294870:0:9526:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1789117588.300421:0:9526:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1789117588.300676:0:9526:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1789117588.325176:0:9526:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1789117588.331204:0:9526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789117588.331219:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117588.331227:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117588.331229:0:9526:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789117588.331233:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117588.331238:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117588.331240:0:9526:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789117588.331243:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789117588.331245:0:9526:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789117588.331261:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117588.331264:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117588.331265:0:9526:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789117588.331268:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789117588.331471:0:9512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1789117588.331501:0:9512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789117588.331528:0:9512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1f7d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f7dd expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.331540:0:9512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1f7d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f7dd expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117588.331559:0:9512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962b872f5000 from 1 10000000:01000000:0.0:1789117588.331562:0:9512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789117588.331598:0:9512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.331606:0:9512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.331629:0:9512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117588.331652:0:9512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8788b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593076992:0@lo:101: 00000100:00100000:0.0:1789117588.331725:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117588.331787:0:9512:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86ab5780 going to sleep for 11 seconds 00000100:00100000:2.0:1789117588.340506:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593076992 00000100:00100000:2.0:1789117588.340522:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593076992 00000100:00100000:2.0:1789117588.340585:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789117588.340595:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+15:9512:x1876025593076992:12345-0@lo:101: 00010000:00010000:2.0:1789117588.340613:0:9525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117588.340643:0:9525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b89b69600/0xaa253ed19be1f7f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f7f2 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117588.340672:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b89b69600/0xaa253ed19be1f7f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f7f2 expref: 16 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117588.340683:0:9525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b89b69600/0xaa253ed19be1f7f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f7f2 expref: 16 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117588.340711:0:9525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69600, rc 0) 00000100:00100000:2.0:1789117588.340796:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+16:9512:x1876025593076992:12345-0@lo:101: Request processed in 201us (9070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117588.340804:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789117588.340851:0:9512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8788b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593076992:0@lo:101: 00010000:00010000:2.0:1789117588.340868:0:9512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f7f9 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117588.340878:0:9512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f7f9 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117588.340982:0:9512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593077120:0@lo:501: 00000100:00100000:2.0:1789117588.341017:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117588.341078:0:9512:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f2e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789117588.341095:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593077120 00000100:00100000:2.0:1789117588.341098:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593077120 00000100:00100000:2.0:1789117588.341122:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789117588.341128:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+16:9512:x1876025593077120:12345-0@lo:501: 00000100:00100000:2.0:1789117588.341222:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+16:9512:x1876025593077120:12345-0@lo:501: Request processed in 92us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117588.341229:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789117588.341258:0:9512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593077120:0@lo:501: 00000100:00100000:2.0:1789117588.341284:0:9512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593077248:0@lo:503: 00000100:00100000:2.0:1789117588.341323:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117588.341341:0:9512:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f2e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789117588.341357:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593077248 00000100:00100000:2.0:1789117588.341361:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593077248 00000100:00100000:2.0:1789117588.341377:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789117588.341382:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+16:9512:x1876025593077248:12345-0@lo:503: 00000100:00100000:2.0:1789117588.341454:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+16:9512:x1876025593077248:12345-0@lo:503: Request processed in 71us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117588.341461:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789117588.341500:0:9512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593077248:0@lo:503: 00000040:00080000:2.0:1789117588.341736:0:9512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789117588.341793:0:9512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593077376:0@lo:502: 00000100:00100000:2.0:1789117588.341831:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117588.341846:0:9512:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f2e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789117588.341859:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593077376 00000100:00100000:2.0:1789117588.341863:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593077376 00000100:00100000:2.0:1789117588.341880:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789117588.341886:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+16:9512:x1876025593077376:12345-0@lo:502: 00000100:00100000:2.0:1789117588.341959:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+16:9512:x1876025593077376:12345-0@lo:502: Request processed in 73us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117588.341966:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789117588.342004:0:9512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593077376:0@lo:502: 00000040:00080000:2.0:1789117588.342232:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789117588.342258:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789117588.342279:0:9512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593077504:0@lo:502: 00000100:00100000:2.0:1789117588.342312:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117588.342336:0:9512:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f2e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789117588.342350:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593077504 00000100:00100000:2.0:1789117588.342353:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593077504 00000100:00100000:2.0:1789117588.342378:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789117588.342383:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+16:9512:x1876025593077504:12345-0@lo:502: 00000100:00100000:2.0:1789117588.342447:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+16:9512:x1876025593077504:12345-0@lo:502: Request processed in 63us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117588.342454:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789117588.342491:0:9512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593077504:0@lo:502: 00000040:00080000:2.0:1789117588.342525:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789117588.342533:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789117588.345914:0:9530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789117588.345929:0:9530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117588.345932:0:9530:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789117588.345940:0:9530:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962b872f5000 00000020:00000080:1.0:1789117588.345943:0:9530:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789117588.345967:0:9530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117588.345970:0:9530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117588.345971:0:9530:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789117588.345974:0:9530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789117588.347365:0:9512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789117588.347403:0:9512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789117588.347424:0:9512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f7f9 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.347435:0:9512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f7f9 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117588.347499:0:9512:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789117588.347502:0:9512:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff962b872f5000 10000000:01000000:3.0:1789117588.347506:0:9512:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff962b872f5000 10000000:01000000:3.0:1789117588.347510:0:9512:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789117588.347516:0:9512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962b872f5000 from 1 10000000:01000000:3.0:1789117588.347518:0:9512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789117588.347568:0:9512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be1f800 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.347576:0:9512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be1f800 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.347603:0:9512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be1f800 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117588.347638:0:9512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf81e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593077632:0@lo:101: 00000100:00100000:3.0:1789117588.347731:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117588.347775:0:9512:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf612780 going to sleep for 11 seconds 00000100:00100000:2.0:1789117588.347951:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593077632 00000100:00100000:2.0:1789117588.347960:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593077632 00000100:00100000:2.0:1789117588.348014:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789117588.348025:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+16:9512:x1876025593077632:12345-0@lo:101: 00010000:00010000:2.0:1789117588.348040:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117588.348079:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b89b68a00/0xaa253ed19be1f807 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f800 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117588.348111:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b89b68a00/0xaa253ed19be1f807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f800 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117588.348122:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b89b68a00/0xaa253ed19be1f807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f800 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117588.348131:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b68a00, rc 0) 00000100:00100000:2.0:1789117588.348185:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+17:9512:x1876025593077632:12345-0@lo:101: Request processed in 161us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117588.348192:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789117588.348560:0:9512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf81e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593077632:0@lo:101: 00010000:00010000:1.0:1789117588.348577:0:9512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be1f800 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f807 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.348586:0:9512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be1f800 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f807 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117588.348724:0:9512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593077760:0@lo:501: 00000100:00100000:1.0:1789117588.348766:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117588.348799:0:9512:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5cd4000 going to sleep for 11 seconds 00000100:00100000:3.0:1789117588.349022:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593077760 00000100:00100000:3.0:1789117588.349030:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593077760 00000100:00100000:3.0:1789117588.349097:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789117588.349106:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+17:9512:x1876025593077760:12345-0@lo:501: 00000100:00100000:3.0:1789117588.349232:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+17:9512:x1876025593077760:12345-0@lo:501: Request processed in 127us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117588.349241:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789117588.350195:0:9512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593077760:0@lo:501: 00000100:00100000:1.0:1789117588.350250:0:9512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593077888:0@lo:503: 00000100:00100000:1.0:1789117588.350319:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117588.350352:0:9512:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5cd4000 going to sleep for 11 seconds 00000100:00100000:3.0:1789117588.350678:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593077888 00000100:00100000:3.0:1789117588.350684:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593077888 00000100:00100000:3.0:1789117588.350739:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789117588.350748:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+17:9512:x1876025593077888:12345-0@lo:503: 00000100:00100000:3.0:1789117588.350875:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+17:9512:x1876025593077888:12345-0@lo:503: Request processed in 128us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117588.350882:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789117588.351392:0:9512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593077888:0@lo:503: 00000040:00080000:1.0:1789117588.351698:0:9512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789117588.351793:0:9512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593078016:0@lo:502: 00000100:00100000:1.0:1789117588.351860:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117588.351913:0:9512:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5cd4000 going to sleep for 11 seconds 00000100:00100000:2.0:1789117588.351968:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593078016 00000100:00100000:2.0:1789117588.351974:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593078016 00000100:00100000:2.0:1789117588.352026:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789117588.352035:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+17:9512:x1876025593078016:12345-0@lo:502: 00000100:00100000:2.0:1789117588.352213:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+17:9512:x1876025593078016:12345-0@lo:502: Request processed in 178us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117588.352220:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789117588.352457:0:9512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593078016:0@lo:502: 00000040:00080000:1.0:1789117588.352748:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789117588.352778:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789117588.352792:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789117588.352815:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789117588.352826:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789117588.352836:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789117588.352865:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789117588.352880:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789117588.352909:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789117588.352923:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789117588.352935:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789117588.352947:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789117588.352959:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789117588.352971:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789117588.352983:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789117588.352995:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789117588.353008:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789117588.353020:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789117588.353031:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789117588.353042:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789117588.353202:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789117588.353223:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789117588.353253:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789117588.353268:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789117588.353281:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789117588.353294:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789117588.353306:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789117588.353317:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1789117588.353327:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789117588.353338:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1789117588.353348:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1789117588.353359:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1789117588.353371:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1789117588.353384:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1789117588.353397:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1789117588.353409:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1789117588.353431:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1789117588.353446:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1789117588.353471:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1789117588.353487:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1789117588.353500:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1789117588.353512:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1789117588.353525:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1789117588.353537:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1789117588.353548:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1789117588.353559:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1789117588.353593:0:9512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593078144:0@lo:502: 00000100:00100000:1.0:1789117588.353665:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117588.353704:0:9512:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5cd4000 going to sleep for 11 seconds 00000100:00100000:2.0:1789117588.353816:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593078144 00000100:00100000:2.0:1789117588.353824:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593078144 00000100:00100000:2.0:1789117588.353863:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789117588.353872:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+17:9512:x1876025593078144:12345-0@lo:502: 00000100:00100000:2.0:1789117588.353991:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+17:9512:x1876025593078144:12345-0@lo:502: Request processed in 119us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117588.353998:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789117588.356552:0:9512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593078144:0@lo:502: 00000040:00080000:0.0:1789117588.356685:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1789117588.356701:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:0.0:1789117588.358548:0:9531:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789117588.358576:0:9531:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff962bbf369a48) 00000020:00000080:0.0:1789117588.358611:0:9531:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1789117588.358718:0:9531:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962b872f5000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789117588.358723:0:9531:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962b872f5000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789117588.358725:0:9531:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962b872f5000 3 00010000:00080000:0.0:1789117588.358760:0:9531:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962bbf941000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.130@tcp at head 00010000:00010000:0.0:1789117588.360602:0:9531:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1789117588.360836:0:9531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789117588.360884:0:9531:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789117588.360897:0:9531:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xaa253ed19be1f815 00000100:00080000:0.0:1789117588.360916:0:9531:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789117588.366881:0:9531:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff962bbf941000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789117588.367660:0:9531:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbf81f0c0 x1876025593078272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789117588.367696:0:9531:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789117588.367843:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf81d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593078528:0@lo:400: 00000100:00100000:3.0:1789117588.367919:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117588.367971:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf81e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593079040:0@lo:400: 00000100:00100000:3.0:1789117588.368012:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117588.368042:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789117588.368048:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf81da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593078656:0@lo:400: 00000100:00100000:3.0:1789117588.368090:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117588.368119:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf81de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593079168:0@lo:400: 00000100:00100000:3.0:1789117588.368142:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117588.368177:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593078528 00000100:00100000:3.0:1789117588.368184:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593078528 00000100:00100000:3.0:1789117588.368237:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789117588.368247:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86818780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593078528:12345-0@lo:400: 00000100:00100000:3.0:1789117588.368303:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86818780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593078528:12345-0@lo:400: Request processed in 57us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117588.368312:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789117588.368334:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593079040 00000100:00100000:3.0:1789117588.368337:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593079040 00000100:00100000:0.0:1789117588.368426:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf81c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593078400:0@lo:400: 00000100:00100000:0.0:1789117588.368459:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117588.368541:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf81f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876025593078272:0@lo:38: 00000100:00100000:1.0:1789117588.369730:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf81e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593078784:0@lo:400: 00000100:00100000:1.0:1789117588.369796:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117588.369842:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593079296:0@lo:400: 00000100:00100000:1.0:1789117588.369867:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117588.369916:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593079168 00000100:00100000:1.0:1789117588.369924:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593079168 00000100:00100000:1.0:1789117588.369974:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593079296 00000100:00100000:1.0:1789117588.369976:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593079296 00000100:00100000:1.0:1789117588.370000:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789117588.370010:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593079168:12345-0@lo:400: 00000100:00100000:1.0:1789117588.370091:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593079168:12345-0@lo:400: Request processed in 82us (1946us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117588.370099:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789117588.370115:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789117588.370122:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593079296:12345-0@lo:400: 00000100:00100000:1.0:1789117588.370175:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593079296:12345-0@lo:400: Request processed in 53us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117588.370182:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789117588.370235:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a86818000 x1876025593079296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117588.370251:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593079296:0@lo:400: 00000100:00100000:0.0:1789117588.381009:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf81d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593078912:0@lo:400: 00000100:00080000:1.0:1789117588.382141:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789117588.382151:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789117588.385386:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117588.387029:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593078656 00000100:00100000:3.0:1789117588.387048:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593078656 00000100:00100000:2.0:1789117588.387924:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593078400 00000100:00100000:2.0:1789117588.387935:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593078400 00000100:00100000:2.0:1789117588.387993:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789117588.388006:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593079040:12345-0@lo:400: 00000100:00100000:2.0:1789117588.388138:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593079040:12345-0@lo:400: Request processed in 134us (20124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117588.388146:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789117588.388170:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789117588.388171:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593078784 00000100:00100000:2.0:1789117588.388179:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8788bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593078400:12345-0@lo:400: 00000100:00100000:1.0:1789117588.388179:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593078784 00000100:00100000:1.0:1789117588.388221:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789117588.388222:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8788bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593078400:12345-0@lo:400: Request processed in 44us (19760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117588.388233:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789117588.388236:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593078784:12345-0@lo:400: 00000100:00100000:1.0:1789117588.388310:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593078784:12345-0@lo:400: Request processed in 79us (18512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117588.388317:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789117588.392075:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789117588.392111:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86819a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593078656:12345-0@lo:400: 00000100:00100000:3.0:1789117588.392241:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86819a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593078656:12345-0@lo:400: Request processed in 153us (24148us total) trans 0 rc 0/0 00010000:00080000:0.0:1789117588.393824:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf81c780 x1876025593078400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117588.393843:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf81c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593078400:0@lo:400: 00000100:00100000:0.0:1789117588.393912:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117588.396535:0:6519:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789117588.396558:0:6519:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789117588.404483:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789117588.404508:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593078912 00000100:00100000:2.0:1789117588.404518:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593078912 00000100:00100000:2.0:1789117588.404595:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789117588.404601:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593078272 00000100:00100000:2.0:1789117588.404605:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593078272 00000100:00100000:2.0:1789117588.404614:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789117588.404637:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789117588.404645:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8788a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876025593078272:12345-0@lo:38: 00010000:00080000:2.0:1789117588.404677:0:6521:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000100:00080000:0.0:1789117588.404686:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1789117588.404712:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xaa253ed19be1f81c 00000004:00100000:2.0:1789117588.404728:0:6521:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789117588.404760:0:6521:0:(import.c:65:import_set_state_nolock()) ffff962a87896000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789117588.404856:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8788a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876025593078272:12345-0@lo:38: Request processed in 210us (10942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117588.404864:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789117588.404878:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789117588.404885:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789117588.404891:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a878892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593078912:12345-0@lo:400: 00000100:00100000:2.0:1789117588.404931:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a878892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593078912:12345-0@lo:400: Request processed in 41us (19558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117588.404937:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789117588.404983:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf81e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593078784:0@lo:400: 00010000:00080000:2.0:1789117588.405019:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf81d2c0 x1876025593078912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117588.405030:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf81d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593078912:0@lo:400: 00000100:00100000:3.0:1789117588.405209:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1789117588.405250:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf81da40 x1876025593078656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117588.405260:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf81da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593078656:0@lo:400: 00010000:00080000:3.0:1789117588.405271:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf81de00 x1876025593079168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117588.405287:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf81de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593079168:0@lo:400: 00000100:00100000:3.0:1789117588.405300:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf81d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593078528:0@lo:400: 00010000:00080000:3.0:1789117588.405311:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf81e940 x1876025593079040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117588.405319:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf81e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593079040:0@lo:400: 00010000:00080000:0.0:1789117588.405732:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf81f0c0 x1876025593078272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789117598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117588.405743:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789117588.405751:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789117588.405761:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789117588.405767:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789117588.405771:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbf941000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789117588.405777:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf81f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876025593078272:0@lo:38: 00000020:01000004:0.0:1789117588.406281:0:9531:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789117588.406297:0:9531:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff962bbf368000) 00000020:00000080:0.0:1789117588.406318:0:9531:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:0.0:1789117588.406393:0:9531:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962b872f5000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789117588.406397:0:9531:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962b872f5000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789117588.406400:0:9531:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962b872f5000 3 00010000:00080000:0.0:1789117588.406426:0:9531:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962bbd041800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.130@tcp at head 00000100:00100000:3.0:1789117588.408316:0:9534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9534:1876025593079424:0@lo:901: 00000100:00100000:3.0:1789117588.408413:0:9534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117588.408465:0:9534:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb75036c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117588.410902:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593079424 00000100:00100000:1.0:1789117588.410918:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593079424 00000100:00100000:1.0:1789117588.410999:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789117588.411009:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9534:x1876025593079424:12345-0@lo:901: 00000100:00100000:1.0:1789117588.411211:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9534:x1876025593079424:12345-0@lo:901: Request processed in 203us (2798us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117588.411220:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789117588.411228:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789117588.411274:0:9534:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a8681a1c0 x1876025593079424/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789117604 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117588.411292:0:9534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9534:1876025593079424:0@lo:901: 00010000:00010000:1.0:1789117588.423790:0:9531:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:1.0:1789117588.424012:0:9531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1789117588.424094:0:9531:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789117588.424126:0:9531:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xaa253ed19be1f82a 00000100:00080000:1.0:1789117588.424141:0:9531:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789117588.424149:0:9531:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff962bbd041800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789117588.424200:0:9531:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbf6fe940 x1876025593079552/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789117588.424225:0:9531:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789117588.427294:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876025593079552:0@lo:38: 00000100:00100000:0.0:1789117588.427383:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117588.428217:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593079552 00000100:00100000:3.0:1789117588.428226:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593079552 00000100:00100000:3.0:1789117588.428268:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789117588.428276:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8788b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876025593079552:12345-0@lo:38: 00010000:00080000:3.0:1789117588.428346:0:6521:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:3.0:1789117588.428392:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xaa253ed19be1f831 00000004:00100000:3.0:1789117588.428411:0:6521:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789117588.428459:0:6521:0:(import.c:65:import_set_state_nolock()) ffff962bae859000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789117588.428542:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8788b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876025593079552:12345-0@lo:38: Request processed in 265us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117588.428550:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789117588.436284:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf6fe940 x1876025593079552/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789117598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117588.436302:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789117588.436313:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789117588.436322:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789117588.436327:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789117588.436331:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbd041800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789117588.436337:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876025593079552:0@lo:38: 00000040:00080000:1.0:1789117588.436411:0:9531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1789117588.437695:0:9512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1789117588.437735:0:9512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789117588.437759:0:9512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be1f800 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f807 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.437772:0:9512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be1f800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f807 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789117588.437848:0:9512:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789117588.437851:0:9512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789117588.437852:0:9512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789117588.437853:0:9512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789117588.437854:0:9512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789117588.437856:0:9512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789117588.437858:0:9512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789117588.437860:0:9512:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789117588.437861:0:9512:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789117588.437863:0:9512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789117588.437865:0:9512:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789117588.437869:0:9512:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1789117588.437872:0:9512:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789117588.437873:0:9512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789117588.437874:0:9512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789117588.437875:0:9512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789117588.437876:0:9512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789117588.437878:0:9512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789117588.437879:0:9512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789117588.437880:0:9512:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789117588.437881:0:9512:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789117588.437882:0:9512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789117588.437883:0:9512:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789117588.437913:0:9512:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789117588.437931:0:9512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593079680:0@lo:253: 00000100:00100000:3.0:1789117588.438008:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117588.438047:0:9512:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb7503840 going to sleep for 11 seconds 00000100:00100000:0.0:1789117588.438200:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593079680 00000100:00100000:0.0:1789117588.438209:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593079680 00000100:00100000:0.0:1789117588.438265:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789117588.438276:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+17:9512:x1876025593079680:12345-0@lo:253: 20000000:01000000:0.0:1789117588.438314:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789117588.438344:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789117588.445467:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789117588.445488:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789117588.445942:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+17:9512:x1876025593079680:12345-0@lo:253: Request processed in 7662us (7927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117588.445954:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 20000000:01000000:2.0:1789117588.449372:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789117588.449385:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789117588.449417:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962b89b69a00/0xaa253ed19be1f838 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117588.449460:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962bc20f5a00/0xaa253ed19be1f72e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f727 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117588.449468:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b813dae00/0xaa253ed19be1f774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f76d expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117588.449476:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962b89b69a00/0xaa253ed19be1f838 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117588.449528:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b813dae00/0xaa253ed19be1f774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f76d expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117588.449603:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962b813dae00/0xaa253ed19be1f774 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f76d expref: 16 pid: 6512 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117588.449630:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876025593079808:0@lo:104: 00000100:00100000:2.0:1789117588.449709:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789117588.449770:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962bc20f5a00/0xaa253ed19be1f72e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f727 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117588.449778:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962bc20f5a00/0xaa253ed19be1f72e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f727 expref: 16 pid: 6512 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117588.449786:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a752c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876025593079936:0@lo:104: 00000100:00100000:2.0:1789117588.449807:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117588.449837:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bad82a780 going to sleep for 11 seconds 00000100:00100000:1.0:1789117588.449963:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593079808 00000100:00100000:1.0:1789117588.449973:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593079808 00000100:00100000:1.0:1789117588.450021:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593079936 00000100:00100000:1.0:1789117588.450024:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593079936 00000100:00100000:1.0:1789117588.450039:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789117588.450049:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a77c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+4:6535:x1876025593079808:12345-0@lo:104: 00010000:00010000:1.0:1789117588.450163:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962baea9b600/0xaa253ed19be1f76d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f774 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.450228:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789117588.450235:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a77c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+4:6535:x1876025593079808:12345-0@lo:104: Request processed in 188us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117588.450243:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789117588.450264:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789117588.450270:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+3:6535:x1876025593079936:12345-0@lo:104: 00010000:00010000:1.0:1789117588.450278:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f72e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.450310:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789117588.450315:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+3:6535:x1876025593079936:12345-0@lo:104: Request processed in 46us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117588.450336:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1789117588.450354:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789117588.450362:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962baea9b600/0xaa253ed19be1f76d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f774 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.450370:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9b600 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789117588.450374:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962baea9b600/0xaa253ed19be1f76d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f774 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.450383:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962baea9b600/0xaa253ed19be1f76d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f774 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117588.450391:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962baea9b600/0xaa253ed19be1f76d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f774 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117588.450398:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789117588.450439:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962baea9b600/0xaa253ed19be1f76d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f774 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.450447:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117588.450466:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962baea9b600/0xaa253ed19be1f76d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f774 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.450476:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962baea9b600/0xaa253ed19be1f76d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f774 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.450489:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117588.450492:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f72e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.450507:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9b800 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789117588.450510:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f72e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.450516:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f72e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117588.450522:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f72e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117588.450526:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789117588.450540:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f727 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f72e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.450546:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117588.450575:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f727 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f72e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.450582:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f727 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f72e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117588.450595:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117588.450597:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117588.450599:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117588.450607:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789117588.450632:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593080192:0@lo:103: 00000100:00100000:1.0:1789117588.450667:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117588.450825:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593080192 00000100:00100000:0.0:1789117588.450831:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593080192 00010000:00010000:0.0:1789117588.450858:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962bc20f5a00/0xaa253ed19be1f72e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f727 expref: 17 pid: 6512 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117588.450884:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789117588.450891:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+17:3645:x1876025593080192:12345-0@lo:103: 00010000:00010000:0.0:1789117588.450914:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117588.450922:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962bc20f5a00/0xaa253ed19be1f72e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f727 expref: 17 pid: 6512 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.450931:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962bc20f5a00/0xaa253ed19be1f72e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f727 expref: 17 pid: 6512 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.450952:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117588.450990:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+17:3645:x1876025593080192:12345-0@lo:103: Request processed in 99us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117588.450998:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789117588.451033:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593080192:0@lo:103: 00010000:00010000:2.0:1789117588.451518:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117588.451539:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593080064:0@lo:103: 00000100:00100000:2.0:1789117588.451580:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117588.451670:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876025593079808:0@lo:104: 00010000:00010000:2.0:1789117588.451681:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bc20f5a00/0xaa253ed19be1f72e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f727 expref: 16 pid: 6512 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117588.451694:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a752c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876025593079936:0@lo:104: 00010000:00010000:2.0:1789117588.451711:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962b89b69a00/0xaa253ed19be1f838 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117588.451827:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593080064 00000100:00100000:0.0:1789117588.451833:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593080064 00010000:00010000:0.0:1789117588.451855:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b813dae00/0xaa253ed19be1f774 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f76d expref: 16 pid: 6512 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117588.451891:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789117588.451898:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+16:3647:x1876025593080064:12345-0@lo:103: 00010000:00010000:0.0:1789117588.451910:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117588.451913:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b813dae00/0xaa253ed19be1f774 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f76d expref: 16 pid: 6512 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.451924:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b813dae00/0xaa253ed19be1f774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f76d expref: 16 pid: 6512 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.451940:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813dae00/0xaa253ed19be1f774 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f76d expref: 16 pid: 6512 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.451965:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962b89b69a00/0xaa253ed19be1f838 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.451974:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b89b69a00/0xaa253ed19be1f838 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789117588.451987:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004560801s 00010000:00010000:0.0:1789117588.451992:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962b89b69a00/0xaa253ed19be1f838 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.451999:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962b89b69a00/0xaa253ed19be1f838 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.452007:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962b89b69a00/0xaa253ed19be1f838 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.452014:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962b89b69a00/0xaa253ed19be1f838 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.452020:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69a00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789117588.452025:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962b89b69a00/0xaa253ed19be1f838 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.452033:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962b89b69a00/0xaa253ed19be1f838 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.452050:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962b89b69a00/0xaa253ed19be1f838 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.452077:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117588.452136:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+15:3647:x1876025593080064:12345-0@lo:103: Request processed in 239us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117588.452143:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1789117588.452163:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962b89b69a00/0xaa253ed19be1f838 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.452170:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962b89b69a00/0xaa253ed19be1f838 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117588.452176:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b89b69a00/0xaa253ed19be1f838 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117588.452457:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593080064:0@lo:103: 00000100:00100000:3.0:1789117588.453860:0:9512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7945443b-b7e4-4157-aee9-c9b2172613e6:9512:1876025593079680:0@lo:253: 10000000:01000000:3.0:1789117588.453894:0:9512:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789117588.453897:0:9512:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789117588.453898:0:9512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789117588.453900:0:9512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789117588.453901:0:9512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789117588.453902:0:9512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789117588.453903:0:9512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789117588.453905:0:9512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789117588.453907:0:9512:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789117588.453908:0:9512:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789117588.453910:0:9512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789117588.453911:0:9512:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789117588.453937:0:9512:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789117588.462050:0:9512:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1789117588.462270:0:9512:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789117588.462487:0:9512:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1789117588.462713:0:9512:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789117588.462915:0:9512:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1789117588.463901:0:9512:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:3.0:1789117588.464197:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1789117588.466975:0:9512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789117588.485264:0:9512:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789117588.485292:0:9512:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789117588.485341:0:9512:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789117588.485385:0:9512:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.130@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789117588.485407:0:9512:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1789117588.485426:0:9512:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1789117588.489849:0:9512:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789117588.490121:0:9512:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:1.0:1789117589.359528:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789117589.360494:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593080320:0@lo:41: 00000100:00100000:1.0:1789117589.361338:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117589.362247:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593080320 00000100:00100000:0.0:1789117589.362259:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593080320 00000100:00100000:0.0:1789117589.362319:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789117589.362329:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593080320:12345-0@lo:41: 00000004:00000024:0.0:1789117589.362383:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789117589.362460:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593080320:12345-0@lo:41: Request processed in 133us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117589.362467:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789117589.362737:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593080320:0@lo:41: 00010000:00010000:1.0:1789117589.479403:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789117589.812224:0:9589:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789117589.812565:0:9589:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789117590.501419:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117591.404624:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593080448:0@lo:13: 00000100:00100000:1.0:1789117591.404725:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117591.405480:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593080448 00000100:00100000:1.0:1789117591.405492:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593080448 00000100:00100000:1.0:1789117591.405557:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789117591.405581:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593080448:12345-0@lo:13: 00002000:00000024:1.0:1789117591.405619:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117591.405682:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593080448:12345-0@lo:13: Request processed in 103us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117591.405689:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1789117591.405712:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789117591.405746:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf6fed00 x1876025593080448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117607 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117591.405766:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593080448:0@lo:13: 00000100:00100000:1.0:1789117591.407755:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87888780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593080576:0@lo:13: 00000100:00100000:1.0:1789117591.407829:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117591.407934:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593080576 00000100:00100000:0.0:1789117591.407941:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593080576 00000100:00080000:1.0:1789117591.407978:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117591.407990:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789117591.408003:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593080576:12345-0@lo:13: 00002000:00000024:0.0:1789117591.408026:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117591.408095:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593080576:12345-0@lo:13: Request processed in 98us (266us total) trans 0 rc 0/0 00010000:00080000:1.0:1789117591.409683:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87888780 x1876025593080576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117607 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117591.409711:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87888780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593080576:0@lo:13: 00000100:00100000:0.0:1789117591.417160:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1789117591.527907:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117591.913764:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789117591.913793:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593080704:0@lo:41: 00000100:00100000:1.0:1789117591.913884:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117591.913951:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593080704 00000100:00100000:3.0:1789117591.913959:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593080704 00000100:00100000:3.0:1789117591.914016:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789117591.914026:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593080704:12345-0@lo:41: 00000004:00000024:3.0:1789117591.914091:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1789117591.914155:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593080704:12345-0@lo:41: Request processed in 131us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117591.914162:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789117591.914725:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593080704:0@lo:41: 00010000:00010000:3.0:1789117592.556390:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117593.447641:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593080832:0@lo:400: 00000100:00100000:3.0:1789117593.447727:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117593.447781:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593081344:0@lo:400: 00000100:00100000:3.0:1789117593.447807:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117593.447835:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593081856:0@lo:400: 00000100:00100000:3.0:1789117593.447858:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117593.447885:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789117593.447891:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593081216:0@lo:400: 00000100:00100000:1.0:1789117593.447893:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593081344 00000100:00100000:1.0:1789117593.447901:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593081344 00000100:00100000:3.0:1789117593.447915:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117593.447934:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593081728:0@lo:400: 00000100:00100000:3.0:1789117593.447953:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117593.447953:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789117593.447982:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593080960:0@lo:400: 00000100:00100000:3.0:1789117593.448006:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117593.448024:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593081472:0@lo:400: 00000100:00100000:3.0:1789117593.448045:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117593.448097:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593081984:0@lo:400: 00000100:00100000:3.0:1789117593.448119:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117593.448137:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789117593.448143:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593081088:0@lo:400: 00000100:00100000:3.0:1789117593.448162:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117593.448170:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593081600:0@lo:400: 00000100:00100000:3.0:1789117593.448186:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117593.448194:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593082112:0@lo:400: 00000100:00100000:1.0:1789117593.448201:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593081344:12345-0@lo:400: 00000100:00100000:3.0:1789117593.448216:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117593.448240:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593081856 00000100:00100000:3.0:1789117593.448244:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593081856 00000100:00100000:1.0:1789117593.448267:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593081344:12345-0@lo:400: Request processed in 305us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117593.448275:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789117593.448287:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593081728 00000100:00100000:3.0:1789117593.448290:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593081728 00000100:00100000:1.0:1789117593.448290:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593081088 00000100:00100000:1.0:1789117593.448292:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593081088 00000100:00100000:1.0:1789117593.448305:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789117593.448307:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789117593.448311:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593081088:12345-0@lo:400: 00000100:00100000:3.0:1789117593.448312:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e14b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593081856:12345-0@lo:400: 00000100:00100000:3.0:1789117593.448339:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e14b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593081856:12345-0@lo:400: Request processed in 27us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117593.448340:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593081088:12345-0@lo:400: Request processed in 30us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117593.448347:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789117593.448347:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789117593.448358:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789117593.448364:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e14f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593081728:12345-0@lo:400: 00000100:00100000:1.0:1789117593.448364:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593081216 00000100:00100000:1.0:1789117593.448367:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593081216 00000100:00100000:1.0:1789117593.448383:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593080960 00000100:00100000:1.0:1789117593.448385:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593080960 00000100:00100000:3.0:1789117593.448387:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e14f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593081728:12345-0@lo:400: Request processed in 25us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117593.448393:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789117593.448397:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593081472 00000100:00100000:1.0:1789117593.448398:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593081472 00000100:00100000:3.0:1789117593.448408:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593081984 00000100:00100000:3.0:1789117593.448410:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593081984 00000100:00100000:1.0:1789117593.448419:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593081600 00000100:00100000:3.0:1789117593.448421:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593082112 00000100:00100000:3.0:1789117593.448422:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593082112 00000100:00100000:1.0:1789117593.448422:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593081600 00000100:00100000:1.0:1789117593.448434:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789117593.448440:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593081216:12345-0@lo:400: 00000100:00100000:0.0:1789117593.448494:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593080832 00000100:00100000:0.0:1789117593.448503:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593080832 00000100:00100000:0.0:1789117593.448548:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789117593.448555:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+15:3645:x1876025593080832:12345-0@lo:400: 00000100:00100000:0.0:1789117593.448589:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+15:3645:x1876025593080832:12345-0@lo:400: Request processed in 37us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117593.448595:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789117593.448674:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593081216:12345-0@lo:400: Request processed in 234us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117593.448980:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789117593.448991:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593080960:12345-0@lo:400: 00000100:00100000:3.0:1789117593.449037:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593080960:12345-0@lo:400: Request processed in 50us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117593.449043:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789117593.449076:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789117593.449083:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593081472:12345-0@lo:400: 00000100:00100000:3.0:1789117593.449110:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593081472:12345-0@lo:400: Request processed in 28us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117593.449116:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789117593.449128:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789117593.449135:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593081984:12345-0@lo:400: 00000100:00100000:3.0:1789117593.449173:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593081984:12345-0@lo:400: Request processed in 39us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117593.449180:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789117593.449192:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789117593.449198:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593082112:12345-0@lo:400: 00000100:00100000:3.0:1789117593.449224:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593082112:12345-0@lo:400: Request processed in 27us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117593.449230:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789117593.449240:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789117593.449246:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593081600:12345-0@lo:400: 00000100:00100000:3.0:1789117593.449269:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593081600:12345-0@lo:400: Request processed in 23us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117593.449275:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1789117593.449313:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789117593.449318:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789117593.449321:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789117593.449365:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593081088:0@lo:400: 00010000:00080000:3.0:1789117593.449381:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbfd17840 x1876025593081600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117593.449392:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593081600:0@lo:400: 00010000:00080000:3.0:1789117593.449403:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e15e00 x1876025593082112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117593.449411:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593082112:0@lo:400: 00010000:00080000:3.0:1789117593.449421:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbfd17c00 x1876025593080960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117593.449438:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593080960:0@lo:400: 00010000:00080000:3.0:1789117593.449449:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbfd161c0 x1876025593081472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117593.449456:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593081472:0@lo:400: 00010000:00080000:3.0:1789117593.449464:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e16d00 x1876025593081984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117593.449472:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593081984:0@lo:400: 00010000:00080000:3.0:1789117593.449511:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbfd152c0 x1876025593081216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117593.449519:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593081216:0@lo:400: 00010000:00080000:3.0:1789117593.449543:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbfd170c0 x1876025593081728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117593.449550:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593081728:0@lo:400: 00000100:00100000:3.0:1789117593.449559:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593080832:0@lo:400: 00000100:00100000:1.0:1789117593.450120:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789117593.452278:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593081344:0@lo:400: 00010000:00080000:3.0:1789117593.452337:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbfd16580 x1876025593081856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117593.452351:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593081856:0@lo:400: 00010000:00010000:0.0:1789117593.578017:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117594.470205:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789117594.470234:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593082240:0@lo:41: 00000100:00100000:1.0:1789117594.470318:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117594.470522:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593082240 00000100:00100000:0.0:1789117594.470532:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593082240 00000100:00100000:0.0:1789117594.470600:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789117594.470612:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593082240:12345-0@lo:41: 00000004:00000024:0.0:1789117594.470656:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789117594.470724:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593082240:12345-0@lo:41: Request processed in 115us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117594.470733:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789117594.470864:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593082240:0@lo:41: 00010000:00010000:0.0:1789117594.603985:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117595.622130:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789117596.292624:0:9879:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789117596.517409:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789117596.517436:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593082368:0@lo:13: 00000100:00100000:0.0:1789117596.517521:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117596.517597:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593082368 00000100:00100000:0.0:1789117596.517604:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593082368 00000100:00100000:0.0:1789117596.517661:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789117596.517671:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87889a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593082368:12345-0@lo:13: 00002000:00000024:0.0:1789117596.517723:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117596.517768:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87889a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593082368:12345-0@lo:13: Request processed in 100us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117596.517776:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789117596.517819:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b98a6c000 x1876025593082368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117596.517845:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593082368:0@lo:13: 00000100:00100000:3.0:1789117596.517936:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789117596.517947:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87889680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593082496:0@lo:13: 00000100:00100000:3.0:1789117596.517981:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789117596.518020:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117596.518138:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593082496 00000100:00100000:0.0:1789117596.518143:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593082496 00000100:00100000:0.0:1789117596.518179:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789117596.518186:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e16d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593082496:12345-0@lo:13: 00002000:00000024:0.0:1789117596.518198:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117596.518228:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e16d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593082496:12345-0@lo:13: Request processed in 42us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117596.518233:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1789117596.518337:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789117596.518356:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87889680 x1876025593082496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117596.518368:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87889680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593082496:0@lo:13: 00010000:00010000:0.0:1789117596.660699:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117597.031432:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593082624:0@lo:41: 00000100:00100000:3.0:1789117597.031515:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.031596:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593082624 00000100:00100000:3.0:1789117597.031605:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593082624 00000100:00100000:3.0:1789117597.031651:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789117597.031660:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593082624:12345-0@lo:41: 00000004:00000024:3.0:1789117597.031697:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1789117597.031743:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593082624:12345-0@lo:41: Request processed in 83us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.031750:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789117597.031797:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593082624:0@lo:41: 10000000:01000000:0.0:1789117597.033686:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789117597.033698:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962bbf4b3000 from 39 10000000:01000000:0.0:1789117597.033705:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789117597.033769:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f83f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117597.033782:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f83f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117597.033794:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f83f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117597.033819:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8788ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593082752:0@lo:101: 00000100:00100000:0.0:1789117597.033890:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117597.033931:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b880d7900 going to sleep for 11 seconds 00000100:00100000:3.0:1789117597.034129:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593082752 00000100:00100000:3.0:1789117597.034137:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593082752 00000100:00100000:3.0:1789117597.034264:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789117597.034350:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+15:6517:x1876025593082752:12345-0@lo:101: 00010000:00010000:3.0:1789117597.034363:0:9525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117597.034375:0:9525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813da800/0xaa253ed19be1f846 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f83f expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.034399:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813da800/0xaa253ed19be1f846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f83f expref: 16 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.034423:0:9525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813da800/0xaa253ed19be1f846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f83f expref: 16 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.034432:0:9525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813da800, rc 0) 00000100:00100000:3.0:1789117597.034481:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+16:6517:x1876025593082752:12345-0@lo:101: Request processed in 134us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.034487:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789117597.036407:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8788ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593082752:0@lo:101: 00010000:00010000:0.0:1789117597.036436:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f83f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f846 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117597.036473:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f83f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f846 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117597.036563:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8788ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593082880:0@lo:501: 00000100:00100000:0.0:1789117597.036619:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117597.036663:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b880d7900 going to sleep for 11 seconds 00000100:00100000:3.0:1789117597.036967:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593082880 00000100:00100000:3.0:1789117597.036973:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593082880 00000100:00100000:3.0:1789117597.037014:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789117597.037023:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+16:6517:x1876025593082880:12345-0@lo:501: 00000100:00100000:3.0:1789117597.037375:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+16:6517:x1876025593082880:12345-0@lo:501: Request processed in 352us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.037382:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789117597.037754:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8788ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593082880:0@lo:501: 00000100:00100000:0.0:1789117597.037793:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8788ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593083008:0@lo:503: 00000100:00100000:0.0:1789117597.037852:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117597.037881:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b880d7900 going to sleep for 11 seconds 00000100:00100000:3.0:1789117597.037925:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593083008 00000100:00100000:3.0:1789117597.037928:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593083008 00000100:00100000:3.0:1789117597.037957:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789117597.037964:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+16:6517:x1876025593083008:12345-0@lo:503: 00000100:00100000:3.0:1789117597.038080:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+16:6517:x1876025593083008:12345-0@lo:503: Request processed in 115us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.038086:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789117597.038169:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8788ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593083008:0@lo:503: 00000100:00100000:2.0:1789117597.038650:0:9912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:9912:1876025593083136:0@lo:502: 00000100:00100000:2.0:1789117597.038694:0:9912:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117597.038720:0:9912:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86da99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117597.038766:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593083136 00000100:00100000:3.0:1789117597.038771:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593083136 00000100:00100000:3.0:1789117597.038807:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789117597.038815:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+16:9912:x1876025593083136:12345-0@lo:502: 00000100:00100000:3.0:1789117597.038907:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+16:9912:x1876025593083136:12345-0@lo:502: Request processed in 93us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.038919:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789117597.039109:0:9912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:9912:1876025593083136:0@lo:502: 00000100:00100000:2.0:1789117597.039165:0:9912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:9912:1876025593083264:0@lo:502: 00000100:00100000:2.0:1789117597.039195:0:9912:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117597.039210:0:9912:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86da99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117597.039395:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593083264 00000100:00100000:3.0:1789117597.039400:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593083264 00000100:00100000:3.0:1789117597.039430:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789117597.039436:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+16:9912:x1876025593083264:12345-0@lo:502: 00000100:00100000:3.0:1789117597.039511:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+16:9912:x1876025593083264:12345-0@lo:502: Request processed in 75us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.039518:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789117597.039732:0:9912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:9912:1876025593083264:0@lo:502: 00000040:00080000:2.0:1789117597.039765:0:9912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1789117597.039940:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789117597.039965:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789117597.039975:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f83f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f846 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.039985:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f83f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f846 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117597.039993:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789117597.039995:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1789117597.039998:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789117597.040025:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f84d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.040033:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f84d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.040041:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f84d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117597.040100:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e15e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593083392:0@lo:101: 00000100:00100000:3.0:1789117597.040141:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.040174:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86ab5240 going to sleep for 11 seconds 00000100:00100000:2.0:1789117597.040404:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593083392 00000100:00100000:2.0:1789117597.040410:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593083392 00000100:00100000:2.0:1789117597.040444:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789117597.040471:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+16:6517:x1876025593083392:12345-0@lo:101: 00010000:00010000:2.0:1789117597.040481:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117597.040495:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b89b68200/0xaa253ed19be1f854 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f84d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117597.040518:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b89b68200/0xaa253ed19be1f854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f84d expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117597.040528:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b89b68200/0xaa253ed19be1f854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f84d expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117597.040536:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b68200, rc 0) 00000100:00100000:2.0:1789117597.040568:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593083392:12345-0@lo:101: Request processed in 99us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117597.040575:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789117597.040643:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e15e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593083392:0@lo:101: 00010000:00010000:0.0:1789117597.040655:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f84d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f854 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117597.040663:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f84d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f854 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117597.040711:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87889e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593083520:0@lo:501: 00000100:00100000:0.0:1789117597.040735:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117597.040772:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b880d76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117597.040964:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593083520 00000100:00100000:2.0:1789117597.040969:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593083520 00000100:00100000:2.0:1789117597.041002:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789117597.041008:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593083520:12345-0@lo:501: 00000100:00100000:2.0:1789117597.041153:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593083520:12345-0@lo:501: Request processed in 144us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117597.041160:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789117597.041540:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87889e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593083520:0@lo:501: 00000100:00100000:0.0:1789117597.041576:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87889e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593083648:0@lo:503: 00000100:00100000:0.0:1789117597.041637:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117597.041666:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b880d76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117597.041687:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593083648 00000100:00100000:0.0:1789117597.041691:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593083648 00000100:00100000:0.0:1789117597.041729:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789117597.041736:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593083648:12345-0@lo:503: 00000100:00100000:0.0:1789117597.041834:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593083648:12345-0@lo:503: Request processed in 98us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117597.041840:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789117597.041877:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87889e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593083648:0@lo:503: 00000100:00100000:0.0:1789117597.042130:0:9913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87889e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:9913:1876025593083776:0@lo:502: 00000100:00100000:0.0:1789117597.042177:0:9913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117597.042189:0:9913:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b880d7900 going to sleep for 11 seconds 00000100:00100000:3.0:1789117597.043402:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593083776 00000100:00100000:3.0:1789117597.043414:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593083776 00000100:00100000:3.0:1789117597.043467:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789117597.043477:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+17:9913:x1876025593083776:12345-0@lo:502: 00000100:00100000:3.0:1789117597.043622:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+17:9913:x1876025593083776:12345-0@lo:502: Request processed in 146us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.043628:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789117597.045036:0:9913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87889e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:9913:1876025593083776:0@lo:502: 00000020:01000000:0.0:1789117597.045145:0:9913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117597.046154:0:9913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117597.046157:0:9913:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789117597.046167:0:9913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789117597.046169:0:9913:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789117597.046214:0:9913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87889e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:9913:1876025593083904:0@lo:502: 00000100:00100000:0.0:1789117597.046310:0:9913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117597.046358:0:9913:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b880d7900 going to sleep for 11 seconds 00000100:00100000:2.0:1789117597.048534:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593083904 00000100:00100000:2.0:1789117597.048546:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593083904 00000100:00100000:2.0:1789117597.048606:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789117597.048617:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+17:9913:x1876025593083904:12345-0@lo:502: 00000100:00100000:2.0:1789117597.048791:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+17:9913:x1876025593083904:12345-0@lo:502: Request processed in 176us (2481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117597.048809:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789117597.049433:0:9913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87889e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:9913:1876025593083904:0@lo:502: 00000020:01000000:0.0:1789117597.049482:0:9913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117597.049491:0:9913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117597.049494:0:9913:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789117597.049499:0:9913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1789117597.049878:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1789117597.049909:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789117597.049921:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f84d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f854 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.049933:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f84d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f854 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117597.049944:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789117597.049947:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962bbcf27000 from 39 10000000:01000000:3.0:1789117597.049950:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789117597.049988:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be1f85b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.049996:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be1f85b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.050005:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be1f85b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117597.050028:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e170c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593084032:0@lo:101: 00000100:00100000:3.0:1789117597.050119:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.050161:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8168e780 going to sleep for 11 seconds 00000100:00100000:2.0:1789117597.050532:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593084032 00000100:00100000:2.0:1789117597.050538:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593084032 00000100:00100000:2.0:1789117597.050578:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789117597.050586:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593084032:12345-0@lo:101: 00010000:00010000:2.0:1789117597.050598:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117597.050612:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b89b68c00/0xaa253ed19be1f862 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f85b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117597.050636:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b89b68c00/0xaa253ed19be1f862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f85b expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117597.050647:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b89b68c00/0xaa253ed19be1f862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f85b expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117597.050656:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b68c00, rc 0) 00000100:00100000:2.0:1789117597.050702:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593084032:12345-0@lo:101: Request processed in 116us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117597.050709:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789117597.050865:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e170c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593084032:0@lo:101: 00010000:00010000:1.0:1789117597.050879:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be1f85b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f862 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117597.050887:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be1f85b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f862 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117597.050949:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593084160:0@lo:501: 00000100:00100000:1.0:1789117597.050980:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117597.051010:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b89ad8840 going to sleep for 11 seconds 00000100:00100000:0.0:1789117597.051167:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593084160 00000100:00100000:0.0:1789117597.051172:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593084160 00000100:00100000:0.0:1789117597.051206:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789117597.051226:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593084160:12345-0@lo:501: 00000100:00100000:0.0:1789117597.051530:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593084160:12345-0@lo:501: Request processed in 305us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117597.051539:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789117597.051602:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593084160:0@lo:501: 00000100:00100000:3.0:1789117597.051637:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e14780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593084288:0@lo:503: 00000100:00100000:3.0:1789117597.051679:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.051701:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8168e780 going to sleep for 11 seconds 00000100:00100000:2.0:1789117597.052254:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593084288 00000100:00100000:2.0:1789117597.052261:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593084288 00000100:00100000:2.0:1789117597.052307:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789117597.052315:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593084288:12345-0@lo:503: 00000100:00100000:2.0:1789117597.052415:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593084288:12345-0@lo:503: Request processed in 101us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117597.052422:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789117597.052476:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e14780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593084288:0@lo:503: 00000100:00100000:3.0:1789117597.053834:0:9914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e15680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:9914:1876025593084416:0@lo:502: 00000100:00100000:3.0:1789117597.053920:0:9914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.053968:0:9914:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb75039c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117597.054122:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593084416 00000100:00100000:0.0:1789117597.054130:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593084416 00000100:00100000:0.0:1789117597.054184:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789117597.054195:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:9914:x1876025593084416:12345-0@lo:502: 00000100:00100000:0.0:1789117597.054548:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:9914:x1876025593084416:12345-0@lo:502: Request processed in 354us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117597.054556:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789117597.054651:0:9914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e15680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:9914:1876025593084416:0@lo:502: 00000100:00100000:3.0:1789117597.054700:0:9914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e15680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:9914:1876025593084544:0@lo:502: 00000100:00100000:3.0:1789117597.054738:0:9914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.054896:0:9914:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbd0c70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117597.055597:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593084544 00000100:00100000:2.0:1789117597.055607:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593084544 00000100:00100000:2.0:1789117597.055653:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789117597.055662:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+18:9914:x1876025593084544:12345-0@lo:502: 00000100:00100000:2.0:1789117597.055795:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+18:9914:x1876025593084544:12345-0@lo:502: Request processed in 134us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117597.055801:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789117597.056408:0:9914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e15680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:9914:1876025593084544:0@lo:502: 00000040:00080000:3.0:1789117597.056448:0:9914:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1789117597.056813:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1789117597.056840:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789117597.056852:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be1f85b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f862 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117597.056863:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be1f85b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f862 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117597.056886:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789117597.056888:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962bbcf27000 from 6 10000000:01000000:1.0:1789117597.056890:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789117597.056924:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70ce00/0xaa253ed19be1f869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117597.056931:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962bbf70ce00/0xaa253ed19be1f869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117597.056941:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962bbf70ce00/0xaa253ed19be1f869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117597.056960:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593084672:0@lo:101: 00000100:00100000:1.0:1789117597.057014:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117597.057088:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b89ad8840 going to sleep for 11 seconds 00000100:00100000:3.0:1789117597.057224:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593084672 00000100:00100000:3.0:1789117597.057230:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593084672 00000100:00100000:3.0:1789117597.057285:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789117597.057297:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593084672:12345-0@lo:101: 00010000:00010000:3.0:1789117597.057313:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117597.057330:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813dae00/0xaa253ed19be1f870 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f869 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.057353:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813dae00/0xaa253ed19be1f870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f869 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.057373:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813dae00/0xaa253ed19be1f870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f869 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.057381:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813dae00, rc 0) 00000100:00100000:3.0:1789117597.057421:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+19:6517:x1876025593084672:12345-0@lo:101: Request processed in 127us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.057427:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789117597.057475:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593084672:0@lo:101: 00010000:00010000:3.0:1789117597.057488:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962bbf70ce00/0xaa253ed19be1f869 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f870 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.057496:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962bbf70ce00/0xaa253ed19be1f869 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f870 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117597.057543:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e15680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593084800:0@lo:256: 00000100:00100000:3.0:1789117597.057573:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.057589:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbd0c70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117597.057600:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593084800 00000100:00100000:3.0:1789117597.057604:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593084800 00000100:00100000:3.0:1789117597.057626:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789117597.057632:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+19:6517:x1876025593084800:12345-0@lo:256: 20000000:01000000:3.0:1789117597.057645:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789117597.057661:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789117597.057664:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789117597.057733:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+19:6517:x1876025593084800:12345-0@lo:256: Request processed in 100us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.057739:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789117597.057913:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e15680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593084800:0@lo:256: 10000000:01000000:3.0:1789117597.057954:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789117597.057960:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70ce00/0xaa253ed19be1f869 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f870 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.057968:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962bbf70ce00/0xaa253ed19be1f869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f870 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117597.057976:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789117597.057978:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1789117597.057980:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789117597.057996:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f877 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.058003:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f877 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.058010:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f877 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117597.058022:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e15680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593084928:0@lo:101: 00000100:00100000:3.0:1789117597.058045:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.058083:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbd0c70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117597.058096:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593084928 00000100:00100000:3.0:1789117597.058099:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593084928 00000100:00100000:3.0:1789117597.058120:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789117597.058126:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+19:6517:x1876025593084928:12345-0@lo:101: 00010000:00010000:3.0:1789117597.058133:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117597.058141:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b80031a00/0xaa253ed19be1f87e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f877 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.058161:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b80031a00/0xaa253ed19be1f87e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f877 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.058169:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b80031a00/0xaa253ed19be1f87e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f877 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.058174:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b80031a00, rc 0) 00000100:00100000:3.0:1789117597.058202:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+20:6517:x1876025593084928:12345-0@lo:101: Request processed in 76us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.058207:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789117597.058236:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e15680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593084928:0@lo:101: 00010000:00010000:3.0:1789117597.058246:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f877 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f87e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.058253:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f877 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f87e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117597.058489:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e15680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593085056:0@lo:501: 00000100:00100000:3.0:1789117597.058515:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.058528:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c64300 going to sleep for 11 seconds 00000100:00100000:3.0:1789117597.058540:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593085056 00000100:00100000:3.0:1789117597.058543:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593085056 00000100:00100000:3.0:1789117597.058564:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789117597.058570:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+20:6517:x1876025593085056:12345-0@lo:501: 00000100:00100000:3.0:1789117597.058676:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+20:6517:x1876025593085056:12345-0@lo:501: Request processed in 106us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.058682:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789117597.058719:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e15680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593085056:0@lo:501: 00000100:00100000:3.0:1789117597.058761:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e15680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593085184:0@lo:503: 00000100:00100000:3.0:1789117597.058798:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.058811:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c64300 going to sleep for 11 seconds 00000100:00100000:3.0:1789117597.058821:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593085184 00000100:00100000:3.0:1789117597.058825:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593085184 00000100:00100000:3.0:1789117597.058846:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789117597.058851:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+20:6517:x1876025593085184:12345-0@lo:503: 00000100:00100000:3.0:1789117597.058923:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+20:6517:x1876025593085184:12345-0@lo:503: Request processed in 70us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.058929:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789117597.058967:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e15680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593085184:0@lo:503: 00000100:00100000:3.0:1789117597.060229:0:9915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e15680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:9915:1876025593085312:0@lo:502: 00000100:00100000:3.0:1789117597.060324:0:9915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.060474:0:9915:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b858b0600 going to sleep for 11 seconds 00000100:00100000:1.0:1789117597.062948:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593085312 00000100:00100000:1.0:1789117597.062968:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593085312 00000100:00100000:3.0:1789117597.063120:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789117597.063131:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba1a92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+20:9915:x1876025593085312:12345-0@lo:502: 00000100:00100000:3.0:1789117597.063424:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba1a92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+20:9915:x1876025593085312:12345-0@lo:502: Request processed in 294us (3100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.063432:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789117597.063563:0:9915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e15680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:9915:1876025593085312:0@lo:502: 00000020:01000000:2.0:1789117597.063605:0:9915:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789117597.063615:0:9915:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789117597.063624:0:9915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117597.063626:0:9915:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789117597.063631:0:9915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789117597.063635:0:9915:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:01000000:2.0:1789117597.063659:0:9915:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789117597.063662:0:9915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789117597.063681:0:9915:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff962a878a8000) 00000020:00000080:2.0:1789117597.063710:0:9915:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1789117597.063716:0:9915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789117597.063817:0:9915:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789117597.063825:0:9915:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789117597.063832:0:9915:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xaa253ed19be1f88c 00010000:00080000:2.0:1789117597.063864:0:9915:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962a87895000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.130@tcp at head 00010000:00010000:2.0:1789117597.064122:0:9915:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1789117597.066090:0:9915:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789117597.066118:0:9915:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789117597.066461:0:9915:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789117597.066601:0:9915:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789117597.067225:0:9915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789117597.067395:0:9915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789117597.076324:0:9916:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789117597.076332:0:9916:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789117597.078230:0:9915:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789117597.078248:0:9915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789117597.078301:0:9915:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789117597.078330:0:9915:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xaa253ed19be1f893 00000100:00080000:2.0:1789117597.078342:0:9915:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789117597.078348:0:9915:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff962a87895000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789117597.078385:0:9915:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bc1a74780 x1876025593085440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789117597.078411:0:9915:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1789117597.078441:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593085440:0@lo:8: 00000020:01000000:2.0:1789117597.078477:0:9915:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117597.078483:0:9915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117597.078485:0:9915:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789117597.078489:0:9915:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117597.078493:0:9915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117597.078495:0:9915:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789117597.078499:0:9915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789117597.078501:0:9915:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789117597.078530:0:9915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a75680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:9915:1876025593085568:0@lo:502: 00000100:00100000:0.0:1789117597.078547:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117597.079010:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593085696:0@lo:400: 00000100:00100000:2.0:1789117597.079167:0:9915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117597.079193:0:9915:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8168e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117597.079204:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593085440 00000100:00100000:0.0:1789117597.079212:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593085440 00000100:00100000:0.0:1789117597.079265:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789117597.079274:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87889e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876025593085440:12345-0@lo:8: 00010000:00080000:0.0:1789117597.079303:0:8437:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:0.0:1789117597.079331:0:8437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xaa253ed19be1f89a 00002000:00100000:0.0:1789117597.079349:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff962a87e99800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398c ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1789117597.079353:0:8437:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1789117597.079358:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789117597.079431:0:8437:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1789117597.079497:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593085824:0@lo:400: 00000100:00100000:3.0:1789117597.079537:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.079561:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593086336:0@lo:400: 00000100:00100000:3.0:1789117597.079591:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.079613:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789117597.079630:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593086208:0@lo:400: 00000100:00100000:3.0:1789117597.079662:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.079686:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593086720:0@lo:400: 00000100:00100000:3.0:1789117597.079717:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1789117597.079753:0:8437:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00100000:3.0:1789117597.079763:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593085952:0@lo:400: 00000100:00080000:0.0:1789117597.079789:0:8437:0:(import.c:65:import_set_state_nolock()) ffff962a87e9e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789117597.079798:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.079817:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593086464:0@lo:400: 00000100:00100000:3.0:1789117597.079839:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.079856:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789117597.079862:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593086080:0@lo:400: 00000100:00100000:3.0:1789117597.079884:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.079902:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593086592:0@lo:400: 00000100:00100000:3.0:1789117597.079935:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.079965:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593085824 00000100:00100000:3.0:1789117597.079969:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593085824 00000100:00100000:3.0:1789117597.079997:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593086208 00000100:00100000:3.0:1789117597.080000:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593086208 00000100:00100000:3.0:1789117597.080021:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593086720 00000100:00100000:3.0:1789117597.080024:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593086720 00000100:00100000:3.0:1789117597.080037:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593086080 00000100:00100000:3.0:1789117597.080039:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593086080 00000100:00100000:3.0:1789117597.080050:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593086592 00000100:00100000:3.0:1789117597.080080:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593086592 00000100:00100000:3.0:1789117597.080101:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789117597.080110:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593085824:12345-0@lo:400: 00000100:00100000:0.0:1789117597.080143:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87889e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3643:x1876025593085440:12345-0@lo:8: Request processed in 867us (1596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117597.080160:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789117597.080164:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593085824:12345-0@lo:400: Request processed in 54us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.080174:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789117597.080181:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593086336 00000100:00100000:0.0:1789117597.080186:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593086336 00000100:00100000:3.0:1789117597.080207:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789117597.080212:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593086464 00000100:00100000:0.0:1789117597.080217:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593086464 00000100:00100000:3.0:1789117597.080218:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593086208:12345-0@lo:400: 00000100:00100000:0.0:1789117597.080250:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789117597.080258:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593086208:12345-0@lo:400: Request processed in 43us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117597.080261:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593086336:12345-0@lo:400: 00000100:00100000:3.0:1789117597.080268:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789117597.080283:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789117597.080291:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593086720:12345-0@lo:400: 00000100:00100000:0.0:1789117597.080307:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593086336:12345-0@lo:400: Request processed in 50us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117597.080315:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789117597.080332:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789117597.080333:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593086720:12345-0@lo:400: Request processed in 41us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117597.080340:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593086464:12345-0@lo:400: 00000100:00100000:3.0:1789117597.080344:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789117597.080363:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789117597.080371:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593086080:12345-0@lo:400: 00000100:00100000:0.0:1789117597.080386:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593086464:12345-0@lo:400: Request processed in 46us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117597.080394:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789117597.080410:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593086080:12345-0@lo:400: Request processed in 39us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.080418:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789117597.080434:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789117597.080441:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593086592:12345-0@lo:400: 00010000:00080000:0.0:1789117597.080469:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e170c0 x1876025593086080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117597.080482:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593086592:12345-0@lo:400: Request processed in 41us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117597.080488:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593086080:0@lo:400: 00000100:00100000:3.0:1789117597.080492:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1789117597.080509:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbfd16580 x1876025593086592/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117597.080519:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593086592:0@lo:400: 00000100:00100000:3.0:1789117597.080532:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593085952 00000100:00100000:3.0:1789117597.080536:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593085952 00000100:00100000:3.0:1789117597.080565:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789117597.080572:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593085952:12345-0@lo:400: 00000100:00100000:3.0:1789117597.080607:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593085952:12345-0@lo:400: Request processed in 35us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.080623:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1789117597.080641:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf6ede00 x1876025593086464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789117597.080647:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117597.080652:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593086464:0@lo:400: 00000100:00080000:3.0:1789117597.080653:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789117597.080679:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e15e00 x1876025593086208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117597.080691:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593085952:0@lo:400: 00000100:00100000:3.0:1789117597.080692:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593086208:0@lo:400: 00010000:00080000:3.0:1789117597.080709:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbfd15a40 x1876025593086720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117597.080719:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593086720:0@lo:400: 00000100:00100000:2.0:1789117597.081586:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593085568 00000100:00100000:2.0:1789117597.081597:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593085568 00000100:00100000:2.0:1789117597.081652:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789117597.081661:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba1a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+20:9915:x1876025593085568:12345-0@lo:502: 00010000:00080000:3.0:1789117597.081695:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e15680 x1876025593085824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117597.081713:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593085824:0@lo:400: 00010000:00080000:0.0:1789117597.082165:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a74780 x1876025593085440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789117607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117597.082176:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789117597.082183:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789117597.082193:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789117597.082199:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789117597.082204:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a87895000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789117597.082222:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789117597.082228:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593085440:0@lo:8: 00000004:00080000:0.0:1789117597.082278:0:9916:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1789117597.082351:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789117597.082367:0:9916:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 249365311582ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789117597.082376:0:9916:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1789117597.082465:0:9917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fe940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9917:1876025593086848:0@lo:700: 00000100:00100000:1.0:1789117597.082515:0:9917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117597.082543:0:9917:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b89ad8e40 going to sleep for 11 seconds 00010000:00080000:3.0:1789117597.082616:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a8681a1c0 x1876025593086336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117597.082627:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593086336:0@lo:400: 00000100:00100000:0.0:1789117597.082910:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593086848 00000100:00100000:0.0:1789117597.082916:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593086848 00000100:00100000:0.0:1789117597.083071:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789117597.083083:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9917:x1876025593086848:12345-0@lo:700: 00000100:00100000:0.0:1789117597.083126:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8788ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8444:1876025593086976:0@lo:700: 00000100:00100000:0.0:1789117597.083165:0:8444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117597.083187:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b880d76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117597.083210:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593086976 00000100:00100000:0.0:1789117597.083214:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593086976 00000100:00100000:0.0:1789117597.083247:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789117597.083253:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87889680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8444:x1876025593086976:12345-0@lo:700: 00000100:00080000:1.0:1789117597.083420:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117597.083753:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba1a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+20:9915:x1876025593085568:12345-0@lo:502: Request processed in 2089us (4583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117597.083775:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789117597.085621:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593085696 00000100:00100000:1.0:1789117597.085634:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593085696 00000100:00100000:1.0:1789117597.085702:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789117597.085713:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593085696:12345-0@lo:400: 00010000:00080000:2.0:1789117597.086500:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e15a40 x1876025593085696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117597.086518:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593085696:0@lo:400: 00000100:00100000:1.0:1789117597.087033:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593085696:12345-0@lo:400: Request processed in 341us (3701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117597.087101:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789117597.087549:0:9915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a75680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:9915:1876025593085568:0@lo:502: 00000020:01000000:0.0:1789117597.087591:0:9915:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117597.087600:0:9915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117597.087610:0:9915:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789117597.087617:0:9915:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:3.0:1789117597.088133:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1789117597.088156:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789117597.088168:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f877 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f87e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.088179:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f87e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117597.088190:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789117597.088193:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962b9832f800 from 39 10000000:01000000:3.0:1789117597.088203:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789117597.088235:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be1f8a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.088242:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be1f8a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.088251:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be1f8a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117597.088270:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d81a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593087104:0@lo:101: 00000100:00100000:3.0:1789117597.088334:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.088367:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b90019c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117597.088656:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593087104 00000100:00100000:1.0:1789117597.088664:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593087104 00000100:00100000:1.0:1789117597.088712:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789117597.088721:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba1a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+20:6517:x1876025593087104:12345-0@lo:101: 00010000:00010000:1.0:1789117597.088734:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117597.088756:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbf70d600/0xaa253ed19be1f8a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f8a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117597.088780:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbf70d600/0xaa253ed19be1f8a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f8a1 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117597.088791:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbf70d600/0xaa253ed19be1f8a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f8a1 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117597.088800:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70d600, rc 0) 00000100:00100000:1.0:1789117597.088845:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba1a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593087104:12345-0@lo:101: Request processed in 125us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117597.088852:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789117597.088982:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d81a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593087104:0@lo:101: 00010000:00010000:0.0:1789117597.088996:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be1f8a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f8a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117597.089005:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be1f8a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f8a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117597.089087:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87888780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593087232:0@lo:501: 00000100:00100000:0.0:1789117597.089116:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117597.089134:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b9166c240 going to sleep for 11 seconds 00000100:00100000:3.0:1789117597.089194:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593087232 00000100:00100000:3.0:1789117597.089198:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593087232 00000100:00100000:3.0:1789117597.089233:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789117597.089239:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90434450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593087232:12345-0@lo:501: 00000100:00100000:3.0:1789117597.089359:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90434450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593087232:12345-0@lo:501: Request processed in 120us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.089365:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789117597.089390:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87888780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593087232:0@lo:501: 00000100:00100000:3.0:1789117597.089417:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593087360:0@lo:503: 00000100:00100000:3.0:1789117597.089467:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.089486:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bae4ac9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117597.089496:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593087360 00000100:00100000:3.0:1789117597.089499:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593087360 00000100:00100000:3.0:1789117597.089519:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789117597.089525:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593087360:12345-0@lo:503: 00000100:00100000:3.0:1789117597.089599:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593087360:12345-0@lo:503: Request processed in 74us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.089605:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789117597.089638:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593087360:0@lo:503: 00000100:00100000:3.0:1789117597.089847:0:9918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:9918:1876025593087488:0@lo:502: 00000100:00100000:3.0:1789117597.089878:0:9918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.089896:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593087488 00000100:00100000:3.0:1789117597.089900:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593087488 00000100:00100000:3.0:1789117597.089918:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789117597.089923:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:9918:x1876025593087488:12345-0@lo:502: 00000100:00100000:3.0:1789117597.089986:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:9918:x1876025593087488:12345-0@lo:502: Request processed in 62us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.089993:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789117597.090019:0:9918:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b89697840 going to sleep for 11 seconds 00000100:00100000:3.0:1789117597.090029:0:9918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:9918:1876025593087488:0@lo:502: 00000100:00100000:3.0:1789117597.090097:0:9918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:9918:1876025593087616:0@lo:502: 00000100:00100000:3.0:1789117597.090126:0:9918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.090144:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593087616 00000100:00100000:3.0:1789117597.090147:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593087616 00000100:00100000:3.0:1789117597.090166:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789117597.090171:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90434050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:9918:x1876025593087616:12345-0@lo:502: 00000100:00100000:3.0:1789117597.090223:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90434050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:9918:x1876025593087616:12345-0@lo:502: Request processed in 51us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.090229:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789117597.090257:0:9918:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf629600 going to sleep for 11 seconds 00000100:00100000:3.0:1789117597.090273:0:9918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:9918:1876025593087616:0@lo:502: 00000040:00080000:3.0:1789117597.090289:0:9918:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1789117597.090333:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789117597.090350:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789117597.090358:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be1f8a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f8a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.090367:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be1f8a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f8a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117597.090376:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789117597.090377:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962b9832f800 from 6 10000000:01000000:3.0:1789117597.090380:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789117597.090403:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b80030800/0xaa253ed19be1f8af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.090409:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b80030800/0xaa253ed19be1f8af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.090417:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b80030800/0xaa253ed19be1f8af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117597.090429:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593087744:0@lo:101: 00000100:00100000:3.0:1789117597.090465:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.090477:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf629600 going to sleep for 11 seconds 00000100:00100000:3.0:1789117597.090488:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593087744 00000100:00100000:3.0:1789117597.090491:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593087744 00000100:00100000:3.0:1789117597.090510:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789117597.090515:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90436450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593087744:12345-0@lo:101: 00010000:00010000:3.0:1789117597.090523:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117597.090540:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b80031000/0xaa253ed19be1f8b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f8af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.090562:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b80031000/0xaa253ed19be1f8b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f8af expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.090571:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b80031000/0xaa253ed19be1f8b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f8af expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.090578:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b80031000, rc 0) 00000100:00100000:3.0:1789117597.090603:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90436450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593087744:12345-0@lo:101: Request processed in 88us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.090608:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789117597.090634:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593087744:0@lo:101: 00010000:00010000:3.0:1789117597.090644:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b80030800/0xaa253ed19be1f8af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f8b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.090651:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b80030800/0xaa253ed19be1f8af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f8b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117597.090688:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593087872:0@lo:256: 00000100:00100000:3.0:1789117597.090715:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.090727:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf629600 going to sleep for 11 seconds 00000100:00100000:3.0:1789117597.090739:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593087872 00000100:00100000:3.0:1789117597.090742:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593087872 00000100:00100000:3.0:1789117597.090761:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789117597.090766:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90436050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593087872:12345-0@lo:256: 20000000:01000000:3.0:1789117597.090778:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789117597.090795:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789117597.090801:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789117597.090874:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90436050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593087872:12345-0@lo:256: Request processed in 107us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.090881:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789117597.090909:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593087872:0@lo:256: 10000000:01000000:3.0:1789117597.090952:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789117597.090957:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b80030800/0xaa253ed19be1f8af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f8b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.090963:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b80030800/0xaa253ed19be1f8af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f8b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117597.090970:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789117597.090972:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1789117597.090974:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789117597.090989:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be1f8bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.090995:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be1f8bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.091002:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be1f8bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117597.091013:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593088000:0@lo:101: 00000100:00100000:3.0:1789117597.091036:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.091048:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf629600 going to sleep for 11 seconds 00000100:00100000:3.0:1789117597.091087:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593088000 00000100:00100000:3.0:1789117597.091090:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593088000 00000100:00100000:3.0:1789117597.091112:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789117597.091123:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90434c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593088000:12345-0@lo:101: 00010000:00010000:3.0:1789117597.091130:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117597.091138:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b80030c00/0xaa253ed19be1f8c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f8bd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.091152:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b80030c00/0xaa253ed19be1f8c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f8bd expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.091161:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b80030c00/0xaa253ed19be1f8c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f8bd expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.091168:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b80030c00, rc 0) 00000100:00100000:3.0:1789117597.091196:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90434c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593088000:12345-0@lo:101: Request processed in 74us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.091201:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789117597.091230:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593088000:0@lo:101: 00010000:00010000:3.0:1789117597.091240:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be1f8bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f8c4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.091247:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be1f8bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f8c4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117597.091291:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593088128:0@lo:501: 00000100:00100000:3.0:1789117597.091316:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.091335:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf629600 going to sleep for 11 seconds 00000100:00100000:3.0:1789117597.091345:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593088128 00000100:00100000:3.0:1789117597.091347:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593088128 00000100:00100000:3.0:1789117597.091368:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789117597.091373:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593088128:12345-0@lo:501: 00000100:00100000:3.0:1789117597.091504:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593088128:12345-0@lo:501: Request processed in 130us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.091511:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789117597.091551:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593088128:0@lo:501: 00000100:00100000:3.0:1789117597.091573:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593088256:0@lo:503: 00000100:00100000:3.0:1789117597.091610:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.091622:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf629600 going to sleep for 11 seconds 00000100:00100000:3.0:1789117597.091634:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593088256 00000100:00100000:3.0:1789117597.091637:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593088256 00000100:00100000:3.0:1789117597.091655:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789117597.091661:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90437c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593088256:12345-0@lo:503: 00000100:00100000:3.0:1789117597.091735:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90437c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593088256:12345-0@lo:503: Request processed in 74us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.091742:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789117597.091781:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593088256:0@lo:503: 40000000:02000000:0.0:1789117597.095148:0:6526:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000004:00080000:2.0:1789117597.102800:0:7451:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1789117597.117652:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87889680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8444:x1876025593086976:12345-0@lo:700: Request processed in 34390us (34478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117597.117670:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789117597.117813:0:9919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8788b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:9919:1876025593088384:0@lo:502: 00000100:00100000:0.0:1789117597.117880:0:9919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117597.117913:0:9919:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b9166ccc0 going to sleep for 11 seconds 00010000:00080000:3.0:1789117597.118120:0:8444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a8788ad00 x1876025593086976/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789117613 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117597.118138:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8788ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8444:1876025593086976:0@lo:700: 40000000:02000000:3.0:1789117597.118150:0:8444:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:1.0:1789117597.119859:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593088384 00000100:00100000:1.0:1789117597.119873:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593088384 00000100:00100000:1.0:1789117597.119947:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789117597.119958:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:9919:x1876025593088384:12345-0@lo:502: 00000100:00100000:1.0:1789117597.120180:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:9919:x1876025593088384:12345-0@lo:502: Request processed in 224us (2300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117597.120188:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789117597.121116:0:9919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8788b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:9919:1876025593088384:0@lo:502: 00000020:01000000:0.0:1789117597.121159:0:9919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789117597.121167:0:9919:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789117597.121174:0:9919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117597.121176:0:9919:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789117597.121182:0:9919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789117597.121186:0:9919:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:01000000:0.0:1789117597.121213:0:9919:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789117597.121216:0:9919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789117597.121248:0:9919:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff962a87e21a48) 00000020:00000080:0.0:1789117597.121275:0:9919:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:0.0:1789117597.121282:0:9919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789117597.121376:0:9919:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789117597.121381:0:9919:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:0.0:1789117597.121388:0:9919:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa253ed19be1f8d2 00010000:00080000:0.0:1789117597.121417:0:9919:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962a87e9a000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.130@tcp at head 00010000:00010000:0.0:1789117597.121656:0:9919:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:0.0:1789117597.121806:0:9919:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789117597.121820:0:9919:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789117597.126602:0:9919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789117597.128231:0:9919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789117597.128373:0:9919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789117597.128506:0:9919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1789117597.137027:0:9921:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789117597.137034:0:9921:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000001:00100000:2.0:1789117597.139811:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789117597.140033:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9917:x1876025593086848:12345-0@lo:700: Request processed in 56945us (57509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117597.140082:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789117597.140254:0:9917:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf6fe940 x1876025593086848/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789117613 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117597.140271:0:9917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fe940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9917:1876025593086848:0@lo:700: 00000020:00000080:2.0:1789117597.144729:0:9919:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789117597.144748:0:9919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789117597.144798:0:9919:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789117597.144830:0:9919:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa253ed19be1f8d9 00000100:00080000:2.0:1789117597.144842:0:9919:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789117597.144848:0:9919:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff962a87e9a000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789117597.144889:0:9919:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bc1a75a40 x1876025593088512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789117597.144920:0:9919:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789117597.144990:0:9919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117597.144994:0:9919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117597.144996:0:9919:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789117597.144999:0:9919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117597.145003:0:9919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117597.145004:0:9919:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789117597.145008:0:9919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789117597.145009:0:9919:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789117597.145036:0:9919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a76d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:9919:1876025593088640:0@lo:502: 00000100:00100000:2.0:1789117597.145150:0:9919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117597.145185:0:9919:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8168e780 going to sleep for 11 seconds 00000100:00100000:0.0:1789117597.145435:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593088512:0@lo:8: 00000100:00100000:0.0:1789117597.145482:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117597.145531:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593088640 00000100:00100000:0.0:1789117597.145536:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593088640 00000100:00100000:0.0:1789117597.145584:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789117597.145595:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90437050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+23:9919:x1876025593088640:12345-0@lo:502: 00000100:00100000:0.0:1789117597.145723:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90437050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+23:9919:x1876025593088640:12345-0@lo:502: Request processed in 130us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117597.145731:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789117597.146976:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593088512 00000100:00100000:3.0:1789117597.146986:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593088512 00000100:00100000:3.0:1789117597.147028:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789117597.147035:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8788b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876025593088512:12345-0@lo:8: 00010000:00080000:3.0:1789117597.147083:0:8437:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:3.0:1789117597.147121:0:8437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa253ed19be1f8e0 00002000:00100000:3.0:1789117597.147136:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff962a87eb4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789117597.147141:0:8437:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789117597.147144:0:8437:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789117597.147227:0:8437:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789117597.147255:0:8437:0:(import.c:65:import_set_state_nolock()) ffff962a87eb0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789117597.147333:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8788b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1876025593088512:12345-0@lo:8: Request processed in 297us (1849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.147340:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789117597.147393:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a75a40 x1876025593088512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789117607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117597.147404:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789117597.147413:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789117597.147420:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789117597.147426:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789117597.147428:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a87e9a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789117597.147442:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789117597.147447:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593088512:0@lo:8: 00000004:00080000:3.0:1789117597.147484:0:9921:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789117597.147539:0:9921:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 249430484222ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789117597.147546:0:9921:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789117597.158819:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1789117597.159108:0:9919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a76d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:9919:1876025593088640:0@lo:502: 00000020:01000000:2.0:1789117597.159152:0:9919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117597.159160:0:9919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117597.159163:0:9919:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789117597.159167:0:9919:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000004:00080000:1.0:1789117597.161269:0:9917:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789117597.161303:0:9917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8680ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9917:1876025593088896:0@lo:7: 00000100:00100000:1.0:1789117597.161383:0:9917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117597.161423:0:9917:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d2ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789117597.161461:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593088896 00000100:00100000:1.0:1789117597.161468:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593088896 00000100:00100000:1.0:1789117597.161517:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789117597.161526:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9917:x1876025593088896:12345-0@lo:7: 00000100:00100000:2.0:1789117597.162131:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593088768:0@lo:13: 00000100:00100000:2.0:1789117597.162176:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117597.162234:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593088768 00000100:00100000:2.0:1789117597.162238:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593088768 00000100:00100000:2.0:1789117597.162269:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789117597.162277:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a76d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876025593088768:12345-0@lo:13: 00002000:00000024:2.0:1789117597.162300:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923939328 avail 3692417024 00000100:00100000:2.0:1789117597.162348:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a76d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876025593088768:12345-0@lo:13: Request processed in 71us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117597.162356:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789117597.162400:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a86808000 x1876025593088768/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117597.162418:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593088768:0@lo:13: 00000020:01000000:3.0:1789117597.166544:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1789117597.166584:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789117597.166598:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be1f8bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f8c4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.166610:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be1f8bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f8c4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117597.166629:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789117597.166632:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff962b88028000 from 1 10000000:01000000:3.0:1789117597.166634:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789117597.166672:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be1f8e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.166680:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be1f8e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117597.166690:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be1f8e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117597.166726:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593089024:0@lo:101: 00000100:00100000:3.0:1789117597.166798:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.166846:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4f240 going to sleep for 11 seconds 00000100:00100000:2.0:1789117597.167133:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593089024 00000100:00100000:2.0:1789117597.167142:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593089024 00000100:00100000:2.0:1789117597.167192:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789117597.167201:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593089024:12345-0@lo:101: 00010000:00010000:2.0:1789117597.167214:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117597.167227:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b89b69c00/0xaa253ed19be1f8ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f8e7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117597.167260:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b89b69c00/0xaa253ed19be1f8ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f8e7 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117597.167271:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b89b69c00/0xaa253ed19be1f8ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f8e7 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117597.167281:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69c00, rc 0) 00000100:00100000:2.0:1789117597.167327:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593089024:12345-0@lo:101: Request processed in 127us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117597.167334:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789117597.167383:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593089024:0@lo:101: 00010000:00010000:2.0:1789117597.167397:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be1f8e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f8ee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117597.167405:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be1f8e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f8ee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117597.167473:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a75e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593089152:0@lo:501: 00000100:00100000:2.0:1789117597.167502:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117597.167524:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8168e780 going to sleep for 11 seconds 00000100:00100000:2.0:1789117597.167538:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593089152 00000100:00100000:2.0:1789117597.167541:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593089152 00000100:00100000:2.0:1789117597.167562:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789117597.167568:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90434850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593089152:12345-0@lo:501: 00000100:00100000:2.0:1789117597.167639:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90434850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593089152:12345-0@lo:501: Request processed in 71us (136us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789117597.167655:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789117597.167686:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a75e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593089152:0@lo:501: 10000000:01000000:2.0:1789117597.167712:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789117597.167717:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be1f8e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f8ee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117597.167725:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be1f8e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f8ee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117597.173383:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87888f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593089280:0@lo:13: 00000100:00100000:3.0:1789117597.173488:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789117597.173564:0:9922:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789117597.173592:0:9922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87888000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9922:1876025593089408:0@lo:7: 00000100:00100000:2.0:1789117597.176096:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593089280 00000100:00100000:2.0:1789117597.176115:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593089280 00000100:00100000:2.0:1789117597.176221:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789117597.176234:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d81e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876025593089280:12345-0@lo:13: 00002000:00000024:2.0:1789117597.176277:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923939328 avail 3692417024 00002000:00080000:1.0:1789117597.177701:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1789117597.177709:0:8433:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789117597.177796:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9917:x1876025593088896:12345-0@lo:7: Request processed in 16268us (16410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117597.177807:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1789117597.177888:0:9917:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a8680ad00 x1876025593088896/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789117613 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117597.177903:0:9917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8680ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9917:1876025593088896:0@lo:7: 00000004:00080000:1.0:1789117597.177920:0:9917:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789117597.177966:0:9917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8680ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9917:1876025593089536:0@lo:5: 00000100:00100000:1.0:1789117597.178001:0:9917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117597.178032:0:9917:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84f40e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789117597.178093:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593089536 00000100:00100000:1.0:1789117597.178100:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593089536 00000100:00100000:1.0:1789117597.178140:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789117597.178149:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86808f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9917:x1876025593089536:12345-0@lo:5: 00002000:00080000:1.0:1789117597.178184:0:8437:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1789117597.178216:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86808f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9917:x1876025593089536:12345-0@lo:5: Request processed in 68us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117597.178223:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1789117597.178269:0:9917:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a8680ad00 x1876025593089536/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789117613 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117597.178278:0:9917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8680ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9917:1876025593089536:0@lo:5: 00000004:00080000:1.0:1789117597.178286:0:9917:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789117597.178310:0:9917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8680ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9917:1876025593089664:0@lo:5: 00000100:00100000:1.0:1789117597.178331:0:9917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117597.178349:0:9917:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84f40e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789117597.178883:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d81e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876025593089280:12345-0@lo:13: Request processed in 2648us (5391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117597.178893:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789117597.178921:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117597.178954:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593089664 00000100:00100000:2.0:1789117597.178959:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593089664 00000100:00100000:2.0:1789117597.178994:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789117597.179001:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9917:x1876025593089664:12345-0@lo:5: 00002000:00080000:2.0:1789117597.179035:0:8434:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1789117597.181495:0:9922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117597.181554:0:9922:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b9166cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117597.182110:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593089408 00000100:00100000:1.0:1789117597.182120:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593089408 00000100:00100000:1.0:1789117597.182181:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789117597.182192:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a878883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9922:x1876025593089408:12345-0@lo:7: 00000100:00100000:2.0:1789117597.186555:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9917:x1876025593089664:12345-0@lo:5: Request processed in 7545us (8213us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789117597.186574:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789117597.188905:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87888f00 x1876025593089280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117597.189076:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87888f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593089280:0@lo:13: 00010000:00080000:3.0:1789117597.191486:0:9917:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a8680ad00 x1876025593089664/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789117613 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117597.191509:0:9917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8680ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9917:1876025593089664:0@lo:5: 00000004:00080000:3.0:1789117597.191526:0:9917:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789117597.191583:0:9917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d82940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9917:1876025593089792:0@lo:900: 00000100:00100000:3.0:1789117597.191665:0:9917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117597.191706:0:9917:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4f780 going to sleep for 11 seconds 00000100:00100000:1.0:1789117597.192184:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593089792 00000100:00100000:1.0:1789117597.192193:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593089792 00000100:00100000:1.0:1789117597.194602:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789117597.194622:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9917:x1876025593089792:12345-0@lo:900: 00000100:00100000:1.0:1789117597.194757:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9917:x1876025593089792:12345-0@lo:900: Request processed in 141us (3090us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117597.194765:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00002000:00080000:0.0:1789117597.199097:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1789117597.199107:0:8437:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789117597.199217:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a878883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9922:x1876025593089408:12345-0@lo:7: Request processed in 17023us (17722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117597.199230:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1789117597.199298:0:9922:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87888000 x1876025593089408/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789117613 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117597.199313:0:9922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87888000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9922:1876025593089408:0@lo:7: 00000004:00080000:0.0:1789117597.199328:0:9922:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789117597.199371:0:9922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87888000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9922:1876025593089920:0@lo:5: 00000100:00100000:0.0:1789117597.199407:0:9922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117597.199438:0:9922:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b9166cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789117597.200082:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593089920 00000100:00100000:2.0:1789117597.200095:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593089920 00000100:00100000:2.0:1789117597.200142:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789117597.200151:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8788a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9922:x1876025593089920:12345-0@lo:5: 00002000:00080000:2.0:1789117597.200181:0:8434:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789117597.200185:0:8434:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00010000:00080000:0.0:1789117597.200566:0:9917:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87d82940 x1876025593089792/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789117613 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117597.200852:0:9917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d82940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9917:1876025593089792:0@lo:900: 00000001:00080000:0.0:1789117597.207480:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:0.0:1789117597.207503:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1789117597.207510:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789117597.211261:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8788a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9922:x1876025593089920:12345-0@lo:5: Request processed in 11099us (11842us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789117597.211276:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789117597.211652:0:9922:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87888000 x1876025593089920/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789117613 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117597.211666:0:9922:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789117597.211673:0:9922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87888000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9922:1876025593089920:0@lo:5: 00000004:00080000:0.0:1789117597.211688:0:9922:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789117597.211740:0:9922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87888000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9922:1876025593090048:0@lo:700: 00000100:00100000:0.0:1789117597.211798:0:9922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117597.211899:0:9922:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b9166cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789117597.215773:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593090048 00000100:00100000:2.0:1789117597.215786:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593090048 00000100:00100000:2.0:1789117597.215841:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789117597.215854:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8788b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9922:x1876025593090048:12345-0@lo:700: 00000100:00100000:3.0:1789117597.240419:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8788b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9922:x1876025593090048:12345-0@lo:700: Request processed in 24558us (28610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117597.240435:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789117597.240543:0:9922:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87888000 x1876025593090048/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789117613 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117597.240568:0:9922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87888000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9922:1876025593090048:0@lo:700: 00000004:02000040:0.0:1789117597.246149:0:9922:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1789117597.254030:0:9922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87888000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9922:1876025593090176:0@lo:5: 00000100:00100000:0.0:1789117597.254137:0:9922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117597.254182:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593090176 00000100:00100000:0.0:1789117597.254190:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593090176 00000100:00100000:0.0:1789117597.254242:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789117597.254251:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87888f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9922:x1876025593090176:12345-0@lo:5: 00000100:00100000:1.0:1789117597.257114:0:9922:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b9166cc00 going to sleep for 11 seconds 00002000:00080000:0.0:1789117597.263753:0:8833:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1789117597.263779:0:8833:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1789117597.267031:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87888f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9922:x1876025593090176:12345-0@lo:5: Request processed in 12774us (12887us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789117597.267045:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789117597.269368:0:9922:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87888000 x1876025593090176/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789117613 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117597.269388:0:9922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87888000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9922:1876025593090176:0@lo:5: 00000004:00080000:3.0:1789117597.269404:0:9922:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000020:00000004:2.0:1789117597.316911:0:9941:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789117597.317378:0:9941:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789117597.679025:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789117598.263820:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:3.0:1789117598.693316:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117599.590563:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789117599.590604:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593090304:0@lo:41: 00000100:00100000:0.0:1789117599.590707:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117599.590978:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593090304 00000100:00100000:1.0:1789117599.590989:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593090304 00000100:00100000:1.0:1789117599.591078:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789117599.591090:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87888780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593090304:12345-0@lo:41: 00000004:00000024:1.0:1789117599.591153:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789117599.591225:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87888780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593090304:12345-0@lo:41: Request processed in 138us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117599.591233:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789117599.591399:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593090304:0@lo:41: 00010000:00010000:1.0:1789117599.717328:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789117600.412050:0:10042:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789117600.412339:0:10042:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789117600.741440:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789117601.391657:0:10090:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789117601.391667:0:10090:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1789117601.637321:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789117601.637350:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8788ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593090432:0@lo:13: 00000100:00100000:3.0:1789117601.637438:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117601.637573:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593090432 00000100:00100000:0.0:1789117601.637581:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593090432 00000100:00100000:0.0:1789117601.637648:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789117601.637658:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593090432:12345-0@lo:13: 00002000:00000024:0.0:1789117601.637688:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117601.637734:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593090432:12345-0@lo:13: Request processed in 78us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117601.637742:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789117601.637800:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a8788ad00 x1876025593090432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117601.637831:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8788ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593090432:0@lo:13: 00000100:00080000:3.0:1789117601.637968:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117601.638146:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593090560:0@lo:13: 00000100:00100000:0.0:1789117601.638176:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117601.638575:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593090560 00000100:00100000:1.0:1789117601.638581:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593090560 00000100:00100000:1.0:1789117601.638629:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789117601.638636:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8788ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593090560:12345-0@lo:13: 00002000:00000024:1.0:1789117601.638650:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117601.638699:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8788ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593090560:12345-0@lo:13: Request processed in 63us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117601.638706:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789117601.638761:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789117601.638828:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a86808000 x1876025593090560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117601.638858:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593090560:0@lo:13: 00010000:00010000:3.0:1789117601.770296:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117602.024122:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117602.024382:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572065408 00000100:00100000:2.0:1789117602.024398:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572065408 00000100:00100000:2.0:1789117602.024463:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 183 00000100:00100000:2.0:1789117602.024472:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2403:x1876025572065408:12345-192.168.204.30@tcp:250: 00010000:00080000:2.0:1789117602.024501:0:6513:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 6b51ebb8-b89b-4376-982e-072902ca33a8@192.168.204.30@tcp t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:2.0:1789117602.024545:0:6513:0:(genops.c:1385:class_connect()) connect: client 6b51ebb8-b89b-4376-982e-072902ca33a8, cookie 0xaa253ed19be1f8f5 00000100:00080000:2.0:1789117602.024687:0:6513:0:(import.c:65:import_set_state_nolock()) ffff962bc1aef800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789117602.024766:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+5:2403:x1876025572065408:12345-192.168.204.30@tcp:250: Request processed in 292us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117602.024774:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 183 00000100:00100000:1.0:1789117602.031265:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117602.031405:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572065536 00000100:00100000:2.0:1789117602.031419:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572065536 00000100:00100000:2.0:1789117602.031511:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 184 00000100:00100000:2.0:1789117602.031524:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+5:6166:x1876025572065536:12345-192.168.204.30@tcp:101: 00010000:00010000:2.0:1789117602.031548:0:9525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117602.031574:0:9525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b89b68e00/0xaa253ed19be1f8fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ecba expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117602.031614:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b89b68e00/0xaa253ed19be1f8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecba expref: 6 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117602.031628:0:9525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b89b68e00/0xaa253ed19be1f8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecba expref: 6 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117602.031640:0:9525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b68e00, rc 0) 00000100:00100000:2.0:1789117602.031718:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+6:6166:x1876025572065536:12345-192.168.204.30@tcp:101: Request processed in 197us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117602.031726:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 184 00000100:00100000:1.0:1789117602.035217:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117602.039013:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572065664 00000100:00100000:0.0:1789117602.039034:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572065664 00000100:00100000:0.0:1789117602.039147:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 185 00000100:00100000:0.0:1789117602.039160:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+6:6166:x1876025572065664:12345-192.168.204.30@tcp:501: 00000100:00100000:0.0:1789117602.039326:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+6:6166:x1876025572065664:12345-192.168.204.30@tcp:501: Request processed in 168us (4123us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789117602.039336:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 185 00000100:00100000:1.0:1789117602.056591:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117602.059781:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572065792 00000100:00100000:2.0:1789117602.059849:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572065792 00000100:00100000:2.0:1789117602.059940:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 186 00000100:00100000:2.0:1789117602.059953:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+6:6166:x1876025572065792:12345-192.168.204.30@tcp:101: 00010000:00010000:2.0:1789117602.059975:0:9525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117602.060002:0:9525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b89b69a00/0xaa253ed19be1f903 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ecc1 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117602.060041:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b89b69a00/0xaa253ed19be1f903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecc1 expref: 7 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117602.060070:0:9525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b89b69a00/0xaa253ed19be1f903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecc1 expref: 7 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117602.060104:0:9525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69a00, rc 0) 00000100:00100000:2.0:1789117602.060251:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+7:6166:x1876025572065792:12345-192.168.204.30@tcp:101: Request processed in 300us (3672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117602.060258:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 186 00000100:00100000:1.0:1789117602.067270:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117602.067386:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572065920 00000100:00100000:0.0:1789117602.067400:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572065920 00000100:00100000:0.0:1789117602.067473:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 187 00000100:00100000:0.0:1789117602.067485:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83ada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+7:6166:x1876025572065920:12345-192.168.204.30@tcp:501: 00000100:00100000:0.0:1789117602.067703:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83ada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+8:6166:x1876025572065920:12345-192.168.204.30@tcp:501: Request processed in 219us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117602.067713:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 187 00000100:00100000:1.0:1789117602.073209:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117602.073395:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572066048 00000100:00100000:2.0:1789117602.073408:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572066048 00000100:00100000:2.0:1789117602.073511:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 188 00000100:00100000:2.0:1789117602.073522:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b904e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+8:6166:x1876025572066048:12345-192.168.204.30@tcp:503: 00000100:00100000:2.0:1789117602.073715:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b904e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+8:6166:x1876025572066048:12345-192.168.204.30@tcp:503: Request processed in 194us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117602.073724:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 188 00000100:00100000:1.0:1789117602.094721:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117602.095182:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572066176 00000100:00100000:0.0:1789117602.095196:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572066176 00000100:00100000:0.0:1789117602.095279:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 189 00000100:00100000:0.0:1789117602.095292:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b904eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+8:6184:x1876025572066176:12345-192.168.204.30@tcp:502: 00000100:00100000:0.0:1789117602.095535:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b904eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+8:6184:x1876025572066176:12345-192.168.204.30@tcp:502: Request processed in 244us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117602.095554:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 189 00000100:00100000:1.0:1789117602.131550:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117602.131760:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572066304 00000100:00100000:3.0:1789117602.131774:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572066304 00000100:00100000:3.0:1789117602.131852:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 190 00000100:00100000:3.0:1789117602.131884:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b904eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+8:6184:x1876025572066304:12345-192.168.204.30@tcp:502: 00000100:00100000:3.0:1789117602.132149:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b904eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+8:6184:x1876025572066304:12345-192.168.204.30@tcp:502: Request processed in 267us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117602.132158:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 190 00000100:00100000:1.0:1789117602.141401:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117602.141517:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572066432 00000100:00100000:0.0:1789117602.141529:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572066432 00000100:00100000:0.0:1789117602.141600:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 191 00000100:00100000:0.0:1789117602.141611:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b904e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+8:6166:x1876025572066432:12345-192.168.204.30@tcp:101: 00010000:00010000:0.0:1789117602.141632:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117602.141666:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962baea9b200/0xaa253ed19be1f90a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ecf2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117602.141704:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962baea9b200/0xaa253ed19be1f90a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecf2 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117602.141717:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962baea9b200/0xaa253ed19be1f90a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecf2 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117602.141729:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962baea9b200, rc 0) 00000100:00100000:0.0:1789117602.141798:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b904e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+9:6166:x1876025572066432:12345-192.168.204.30@tcp:101: Request processed in 189us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117602.141805:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 191 00000100:00100000:3.0:1789117602.149401:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789117602.149448:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593090688:0@lo:41: 00000100:00100000:3.0:1789117602.149563:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117602.149745:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593090688 00000100:00100000:1.0:1789117602.149756:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593090688 00000100:00100000:1.0:1789117602.149824:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789117602.149837:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593090688:12345-0@lo:41: 00000004:00000024:1.0:1789117602.149886:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789117602.149891:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593090944:0@lo:400: 00000100:00100000:2.0:1789117602.149941:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117602.150212:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593090944 00000100:00100000:3.0:1789117602.150217:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593090944 00000100:00100000:3.0:1789117602.150260:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789117602.150271:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593090944:12345-0@lo:400: 00000100:00100000:0.0:1789117602.150895:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593091200:0@lo:400: 00000100:00100000:2.0:1789117602.152900:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593091456:0@lo:400: 00000100:00100000:2.0:1789117602.153125:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117602.153233:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593091968:0@lo:400: 00000100:00100000:2.0:1789117602.153277:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117602.156236:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593090688:12345-0@lo:41: Request processed in 6387us (6659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117602.156277:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789117602.156345:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593091456 00000100:00100000:1.0:1789117602.156364:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593091456 00000100:00100000:1.0:1789117602.157178:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593091968 00000100:00100000:1.0:1789117602.157184:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593091968 00000100:00100000:1.0:1789117602.157207:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789117602.157217:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593091456:12345-0@lo:400: 00000100:00100000:1.0:1789117602.157327:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593091456:12345-0@lo:400: Request processed in 112us (4203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117602.157335:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789117602.157349:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789117602.157365:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593091968:12345-0@lo:400: 00000100:00080000:3.0:1789117602.157427:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789117602.157467:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593090816:0@lo:400: 00000100:00100000:1.0:1789117602.158799:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593091968:12345-0@lo:400: Request processed in 1435us (5513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117602.158811:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789117602.159409:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117602.159455:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572066560 00000100:00100000:1.0:1789117602.159463:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572066560 00000100:00100000:1.0:1789117602.159509:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 192 00000100:00100000:1.0:1789117602.159517:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+9:6166:x1876025572066560:12345-192.168.204.30@tcp:256: 20000000:01000000:1.0:1789117602.159547:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789117602.159578:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789117602.159583:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789117602.159586:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789117602.159589:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789117602.159592:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789117602.161791:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117602.161856:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593091712:0@lo:400: 00000100:00100000:0.0:1789117602.161907:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117602.161937:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593092224:0@lo:400: 00010000:00080000:2.0:1789117602.162184:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a74000 x1876025593091968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117602.162205:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593091968:0@lo:400: 00010000:00080000:2.0:1789117602.162255:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a74780 x1876025593091456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117602.162332:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593091456:0@lo:400: 00000100:00100000:2.0:1789117602.162373:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789117602.162386:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593091072:0@lo:400: 00000100:00100000:2.0:1789117602.162422:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117602.162456:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593091584:0@lo:400: 00000100:00100000:1.0:1789117602.162490:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593091200 00000100:00100000:1.0:1789117602.162505:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593091200 00000100:00100000:1.0:1789117602.162555:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789117602.162565:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87888b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593091200:12345-0@lo:400: 00000100:00100000:1.0:1789117602.162629:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87888b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593091200:12345-0@lo:400: Request processed in 66us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117602.162722:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789117602.162725:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117602.162761:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593092096:0@lo:400: 00000100:00100000:2.0:1789117602.162788:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117602.162841:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117602.162843:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593091072 00000100:00100000:2.0:1789117602.162849:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593091072 00000100:00100000:0.0:1789117602.162893:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593091200:0@lo:400: 00000100:00100000:2.0:1789117602.162894:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789117602.162905:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593091072:12345-0@lo:400: 00000100:00100000:0.0:1789117602.162938:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593091712 00000100:00100000:2.0:1789117602.162953:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593091072:12345-0@lo:400: Request processed in 51us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117602.162961:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789117602.162981:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593091584 00000100:00100000:2.0:1789117602.162985:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593091584 00000100:00100000:2.0:1789117602.163005:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593092096 00000100:00100000:2.0:1789117602.163008:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593092096 00000100:00100000:2.0:1789117602.163036:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593092224 00000100:00100000:2.0:1789117602.163038:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593092224 00000100:00100000:2.0:1789117602.163073:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789117602.163080:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593091584:12345-0@lo:400: 00000100:00100000:2.0:1789117602.163115:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593091584:12345-0@lo:400: Request processed in 36us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117602.163122:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789117602.163135:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789117602.163141:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593092096:12345-0@lo:400: 00000100:00100000:2.0:1789117602.163184:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593092096:12345-0@lo:400: Request processed in 42us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117602.163191:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789117602.163211:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789117602.163251:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593091712 00000100:00100000:1.0:1789117602.163293:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593092224:12345-0@lo:400: 00000100:00100000:1.0:1789117602.163337:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593092224:12345-0@lo:400: Request processed in 47us (497us total) trans 0 rc 0/0 00000100:00080000:2.0:1789117602.163949:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789117602.163985:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a75e00 x1876025593091072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117602.163998:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593091072:0@lo:400: 00010000:00080000:2.0:1789117602.164012:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a76580 x1876025593091584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117602.164021:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593091584:0@lo:400: 00010000:00080000:2.0:1789117602.164032:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a74f00 x1876025593092096/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117602.164039:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789117602.164082:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593092096:0@lo:400: 00000100:00100000:2.0:1789117602.164165:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593090944:12345-0@lo:400: Request processed in 13897us (14224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117602.164174:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1789117602.164210:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a76940 x1876025593090944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117602.164221:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593090944:0@lo:400: 00010000:00080000:2.0:1789117602.164309:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a77480 x1876025593092224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117602.164317:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1789117602.164330:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593092224:0@lo:400: 00000100:00100000:2.0:1789117602.166192:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789117602.166222:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593091712:12345-0@lo:400: 00000100:00100000:2.0:1789117602.166351:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593091712:12345-0@lo:400: Request processed in 145us (4441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117602.166370:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789117602.166431:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a752c0 x1876025593091712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117602.166448:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593091712:0@lo:400: 00000100:00100000:3.0:1789117602.166682:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117602.166955:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a75680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593091328:0@lo:400: 00000100:00100000:3.0:1789117602.167010:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117602.167042:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876025593091840:0@lo:400: 00000100:00100000:3.0:1789117602.167096:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117602.167097:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593091328 00000100:00100000:2.0:1789117602.167106:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593091328 00000100:00100000:3.0:1789117602.167145:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593090688:0@lo:41: 00000100:00100000:2.0:1789117602.167164:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593091840 00000100:00100000:2.0:1789117602.167168:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593091840 00000100:00100000:3.0:1789117602.167187:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789117602.167198:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593091328:12345-0@lo:400: 00000100:00100000:0.0:1789117602.167242:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593090816 00000100:00100000:3.0:1789117602.167247:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593091328:12345-0@lo:400: Request processed in 51us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117602.167248:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593090816 00000100:00100000:0.0:1789117602.167282:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789117602.167290:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3647:x1876025593090816:12345-0@lo:400: 00000100:00100000:0.0:1789117602.167326:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3647:x1876025593090816:12345-0@lo:400: Request processed in 38us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117602.167334:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789117602.167455:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+9:6166:x1876025572066560:12345-192.168.204.30@tcp:256: Request processed in 7936us (8508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117602.167464:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 192 00000100:00100000:2.0:1789117602.167497:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789117602.167506:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876025593091840:12345-0@lo:400: 00000100:00100000:2.0:1789117602.167546:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876025593091840:12345-0@lo:400: Request processed in 42us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117602.167554:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1789117602.167580:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117602.167779:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593090816:0@lo:400: 00010000:00080000:2.0:1789117602.167794:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a75680 x1876025593091328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117602.167805:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a75680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593091328:0@lo:400: 00010000:00080000:2.0:1789117602.167822:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a743c0 x1876025593091840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117602.167830:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876025593091840:0@lo:400: 00000100:00100000:1.0:1789117602.170322:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789117602.170989:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789117602.176883:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117602.177595:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572066688 00000100:00100000:2.0:1789117602.177611:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572066688 00000100:00100000:2.0:1789117602.178015:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 194 00000100:00100000:2.0:1789117602.178030:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+9:6166:x1876025572066688:12345-192.168.204.30@tcp:101: 00010000:00010000:2.0:1789117602.178073:0:9525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117602.178101:0:9525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b89b69000/0xaa253ed19be1f911 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ecf9 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117602.178141:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b89b69000/0xaa253ed19be1f911 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecf9 expref: 10 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117602.178155:0:9525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b89b69000/0xaa253ed19be1f911 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecf9 expref: 10 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117602.178166:0:9525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69000, rc 0) 00000100:00100000:2.0:1789117602.178259:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+10:6166:x1876025572066688:12345-192.168.204.30@tcp:101: Request processed in 231us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117602.178268:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 194 00000100:00100000:1.0:1789117602.182791:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117602.184002:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572066816 00000100:00100000:0.0:1789117602.184018:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572066816 00000100:00100000:0.0:1789117602.184141:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 195 00000100:00100000:0.0:1789117602.184154:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:6166:x1876025572066816:12345-192.168.204.30@tcp:501: 00000100:00100000:0.0:1789117602.184386:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:6166:x1876025572066816:12345-192.168.204.30@tcp:501: Request processed in 233us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117602.184395:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 195 00000100:00100000:1.0:1789117602.190680:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117602.190927:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572066944 00000100:00100000:0.0:1789117602.190940:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572066944 00000100:00100000:0.0:1789117602.191015:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 196 00000100:00100000:0.0:1789117602.191028:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+10:6166:x1876025572066944:12345-192.168.204.30@tcp:503: 00000100:00100000:0.0:1789117602.191345:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+10:6166:x1876025572066944:12345-192.168.204.30@tcp:503: Request processed in 319us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117602.191366:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 196 00000100:00100000:2.0:1789117602.224246:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117602.224353:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572067072 00000100:00100000:0.0:1789117602.224377:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572067072 00000100:00100000:0.0:1789117602.224454:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 197 00000100:00100000:0.0:1789117602.224467:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:6186:x1876025572067072:12345-192.168.204.30@tcp:502: 00000100:00100000:0.0:1789117602.224710:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:6186:x1876025572067072:12345-192.168.204.30@tcp:502: Request processed in 244us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117602.224718:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 197 00000100:00100000:1.0:1789117602.232564:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117602.232744:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572067200 00000100:00100000:0.0:1789117602.232757:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572067200 00000100:00100000:0.0:1789117602.232834:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 198 00000100:00100000:0.0:1789117602.232845:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+10:6186:x1876025572067200:12345-192.168.204.30@tcp:502: 00000100:00100000:0.0:1789117602.233098:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+10:6186:x1876025572067200:12345-192.168.204.30@tcp:502: Request processed in 254us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117602.233108:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 198 00000100:00100000:2.0:1789117602.239664:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117602.239724:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117602.240034:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572067328 00000100:00100000:3.0:1789117602.240111:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572067328 00000100:00100000:3.0:1789117602.240166:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572067584 00000100:00100000:3.0:1789117602.240169:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572067584 00000100:00100000:3.0:1789117602.240191:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:3.0:1789117602.240212:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1876025572067328:12345-192.168.204.30@tcp:38: 00010000:00080000:3.0:1789117602.240249:0:9533:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp t0 exp 0000000000000000 cur 254 last 0 00000100:00100000:2.0:1789117602.240271:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:2.0:1789117602.240280:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1876025572067584:12345-192.168.204.30@tcp:38: 00010000:00080000:2.0:1789117602.240302:0:6520:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:3.0:1789117602.240315:0:9533:0:(genops.c:1385:class_connect()) connect: client 35e670b1-2cce-4394-8cb4-d5255c6a6a93, cookie 0xaa253ed19be1f918 00000020:00000080:2.0:1789117602.240346:0:6520:0:(genops.c:1385:class_connect()) connect: client 35e670b1-2cce-4394-8cb4-d5255c6a6a93, cookie 0xaa253ed19be1f91f 00000004:00100000:3.0:1789117602.240350:0:9533:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000004:00100000:2.0:1789117602.240375:0:6520:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789117602.240749:0:9533:0:(import.c:65:import_set_state_nolock()) ffff962a87eb1000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1789117602.240749:0:6520:0:(import.c:65:import_set_state_nolock()) ffff962a87e9f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789117602.242441:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2403:x1876025572067584:12345-192.168.204.30@tcp:38: Request processed in 2145us (2701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117602.242460:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:3.0:1789117602.242661:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2403:x1876025572067328:12345-192.168.204.30@tcp:38: Request processed in 2447us (3009us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117602.242671:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:2.0:1789117602.661817:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8680ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593092352:0@lo:13: 00000100:00100000:2.0:1789117602.661922:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117602.662159:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593092480:0@lo:13: 00000100:00100000:1.0:1789117602.663275:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593092352 00000100:00100000:1.0:1789117602.663287:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593092352 00000100:00100000:1.0:1789117602.663408:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789117602.663422:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a74b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593092352:12345-0@lo:13: 00002000:00000024:1.0:1789117602.663462:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117602.663538:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a74b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593092352:12345-0@lo:13: Request processed in 119us (1616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117602.663546:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789117602.663620:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a8680ad00 x1876025593092352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117602.663645:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8680ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593092352:0@lo:13: 00000100:00100000:3.0:1789117602.663900:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117602.664404:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593092480 00000100:00100000:0.0:1789117602.664410:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593092480 00000100:00100000:0.0:1789117602.664454:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789117602.664463:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593092480:12345-0@lo:13: 00002000:00000024:0.0:1789117602.664479:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117602.664533:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593092480:12345-0@lo:13: Request processed in 72us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117602.664541:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1789117602.664617:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbfd16580 x1876025593092480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117602.664635:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593092480:0@lo:13: 00010000:00010000:1.0:1789117602.791987:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117603.247178:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117603.247623:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572067456 00000100:00100000:3.0:1789117603.247637:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572067456 00000100:00100000:3.0:1789117603.247746:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:3.0:1789117603.247759:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:0:x1876025572067456:12345-192.168.204.30@tcp:41: 00000004:00000024:3.0:1789117603.247812:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789117603.247915:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:0:x1876025572067456:12345-192.168.204.30@tcp:41: Request processed in 159us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117603.247924:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00080000:2.0:1789117603.249035:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117603.251612:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117603.251741:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117603.252181:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572067840 00000100:00100000:3.0:1789117603.252214:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572067840 00000100:00100000:3.0:1789117603.252285:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572067712 00000100:00100000:3.0:1789117603.252289:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572067712 00000100:00100000:3.0:1789117603.252348:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:3.0:1789117603.252360:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:6166:x1876025572067840:12345-192.168.204.30@tcp:41: 00000004:00000024:3.0:1789117603.252404:0:9533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789117603.252406:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:0.0:1789117603.252417:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:0:x1876025572067712:12345-192.168.204.30@tcp:41: 00000004:00000024:0.0:1789117603.252441:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789117603.252480:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:0:x1876025572067712:12345-192.168.204.30@tcp:41: Request processed in 67us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117603.252495:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00080000:0.0:1789117603.252520:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789117603.252943:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:6166:x1876025572067840:12345-192.168.204.30@tcp:41: Request processed in 584us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117603.252950:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:1.0:1789117603.255207:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117603.255518:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572067968 00000100:00100000:3.0:1789117603.255531:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572067968 00000100:00100000:3.0:1789117603.255603:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:3.0:1789117603.255616:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9277e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:6166:x1876025572067968:12345-192.168.204.30@tcp:40: 00000100:00100000:3.0:1789117603.255963:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9277e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:6166:x1876025572067968:12345-192.168.204.30@tcp:40: Request processed in 349us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117603.255972:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:1.0:1789117603.261196:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117603.261293:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117603.261385:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117603.261440:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572068352 00000100:00100000:3.0:1789117603.261452:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572068352 00000100:00100000:3.0:1789117603.261543:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:3.0:1789117603.261556:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf777840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:6166:x1876025572068352:12345-192.168.204.30@tcp:900: 00000100:00100000:3.0:1789117603.261674:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf777840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:6166:x1876025572068352:12345-192.168.204.30@tcp:900: Request processed in 120us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117603.261682:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:1.0:1789117603.263071:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117603.263170:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572068480 00000100:00100000:0.0:1789117603.263179:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572068480 00000100:00100000:0.0:1789117603.263237:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 199 00000100:00100000:0.0:1789117603.263248:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2404:x1876025572068480:12345-192.168.204.30@tcp:400: 00000100:00100000:0.0:1789117603.263965:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2404:x1876025572068480:12345-192.168.204.30@tcp:400: Request processed in 717us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117603.263975:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 199 00000100:00100000:2.0:1789117603.264360:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572068096 00000100:00100000:2.0:1789117603.264369:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572068096 00000100:00100000:2.0:1789117603.264403:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572068224 00000100:00100000:2.0:1789117603.264407:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572068224 00000100:00100000:2.0:1789117603.264433:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:2.0:1789117603.264440:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2403:x1876025572068096:12345-192.168.204.30@tcp:8: 00010000:00080000:2.0:1789117603.264475:0:8833:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:2.0:1789117603.264515:0:8833:0:(genops.c:1385:class_connect()) connect: client 35e670b1-2cce-4394-8cb4-d5255c6a6a93, cookie 0xaa253ed19be1f926 00002000:00100000:2.0:1789117603.264529:0:8833:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 35e670b1-2cce-4394-8cb4-d5255c6a6a93/ffff962a87e9a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789117603.264551:0:8833:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789117603.264723:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:1.0:1789117603.264730:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2403:x1876025572068224:12345-192.168.204.30@tcp:8: 00010000:00080000:1.0:1789117603.264777:0:8437:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:1.0:1789117603.264797:0:8437:0:(genops.c:1385:class_connect()) connect: client 35e670b1-2cce-4394-8cb4-d5255c6a6a93, cookie 0xaa253ed19be1f92d 00002000:00100000:1.0:1789117603.264803:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 35e670b1-2cce-4394-8cb4-d5255c6a6a93/ffff962bbf947800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789117603.264810:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789117603.265010:0:8437:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789117603.265048:0:8437:0:(import.c:65:import_set_state_nolock()) ffff962bbf944000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789117603.265120:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2403:x1876025572068224:12345-192.168.204.30@tcp:8: Request processed in 388us (3734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117603.265129:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 17 00002000:00080000:2.0:1789117603.265378:0:8833:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789117603.265397:0:8833:0:(import.c:65:import_set_state_nolock()) ffff962a87e9b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789117603.265421:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2403:x1876025572068096:12345-192.168.204.30@tcp:8: Request processed in 982us (4128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117603.265429:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:1.0:1789117603.268505:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117603.268706:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572068608 00000100:00100000:2.0:1789117603.268718:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572068608 00000100:00100000:2.0:1789117603.268943:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:2.0:1789117603.268956:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:6166:x1876025572068608:12345-192.168.204.30@tcp:33: 00000004:00080000:2.0:1789117603.300085:0:6522:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 30977us 00000004:00200000:3.0:1789117603.324943:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789117603.325080:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:6166:x1876025572068608:12345-192.168.204.30@tcp:33: Request processed in 56122us (56583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117603.325096:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:0.0:1789117603.510736:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117603.510829:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572068736 00000100:00100000:2.0:1789117603.510840:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572068736 00000100:00100000:2.0:1789117603.510955:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:2.0:1789117603.510966:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:6205:x1876025572068736:12345-192.168.204.30@tcp:101: 00010000:00010000:2.0:1789117603.510988:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117603.511113:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68000/0xaa253ed19be1f934 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ed2a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117603.511182:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1f93b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117603.511195:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1f93b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117603.511210:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1f93b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117603.511255:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789117603.511259:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789117603.511276:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1f93b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117603.511303:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68000/0xaa253ed19be1f934 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed2a expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117603.511321:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1f93b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed2a expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117603.511355:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b95c57f00) 00010000:00010000:2.0:1789117603.511358:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789117603.511362:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69400, rc 0) 00000100:00100000:2.0:1789117603.511429:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:6205:x1876025572068736:12345-192.168.204.30@tcp:101: Request processed in 465us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117603.511435:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 13 00010000:00010000:0.0:1789117603.813304:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117604.709483:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117604.709509:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf774f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593092608:0@lo:41: 00000100:00100000:2.0:1789117604.709596:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117604.709724:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593092608 00000100:00100000:1.0:1789117604.709732:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593092608 00000100:00100000:1.0:1789117604.709788:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789117604.709799:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593092608:12345-0@lo:41: 00000004:00000024:1.0:1789117604.709834:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789117604.709886:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593092608:12345-0@lo:41: Request processed in 89us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117604.709893:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789117604.709943:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf774f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593092608:0@lo:41: 00010000:00010000:3.0:1789117604.839975:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117605.651149:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117605.651256:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572068864 00000100:00100000:0.0:1789117605.651266:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572068864 00000100:00100000:0.0:1789117605.651360:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:0.0:1789117605.651371:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:6257:x1876025572068864:12345-192.168.204.30@tcp:41: 00000004:00000024:0.0:1789117605.651423:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789117605.651504:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:6257:x1876025572068864:12345-192.168.204.30@tcp:41: Request processed in 134us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117605.651512:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00080000:2.0:1789117605.651879:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117605.656079:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117605.656179:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572068992 00000100:00100000:3.0:1789117605.656253:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572068992 00000100:00080000:2.0:1789117605.656414:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789117605.656914:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:3.0:1789117605.656928:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf777c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:6257:x1876025572068992:12345-192.168.204.30@tcp:41: 00000004:00000024:3.0:1789117605.656966:0:9533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789117605.657039:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf777c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:6257:x1876025572068992:12345-192.168.204.30@tcp:41: Request processed in 116us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117605.657047:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:1.0:1789117605.665009:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117605.665127:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572069120 00000100:00100000:0.0:1789117605.665139:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572069120 00000100:00080000:2.0:1789117605.665520:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117605.665958:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:0.0:1789117605.665974:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:6257:x1876025572069120:12345-192.168.204.30@tcp:13: 00002000:00000024:0.0:1789117605.666011:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117605.666139:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:6257:x1876025572069120:12345-192.168.204.30@tcp:13: Request processed in 169us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117605.666148:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:1.0:1789117605.670579:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117605.671514:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572069248 00000100:00100000:0.0:1789117605.671527:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572069248 00000100:00100000:0.0:1789117605.671671:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:0.0:1789117605.671685:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf775a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:6257:x1876025572069248:12345-192.168.204.30@tcp:13: 00002000:00000024:0.0:1789117605.671732:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117605.671848:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf775a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:6257:x1876025572069248:12345-192.168.204.30@tcp:13: Request processed in 166us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117605.671857:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00080000:2.0:1789117605.681271:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789117605.861395:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117606.758418:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593092736:0@lo:13: 00000100:00100000:3.0:1789117606.758525:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117606.758605:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593092736 00000100:00100000:0.0:1789117606.758618:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593092736 00000100:00100000:0.0:1789117606.758762:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789117606.758775:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d82580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593092736:12345-0@lo:13: 00002000:00000024:0.0:1789117606.758819:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117606.758899:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d82580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593092736:12345-0@lo:13: Request processed in 127us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117606.758907:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1789117606.760142:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a77480 x1876025593092736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117606.760171:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593092736:0@lo:13: 00000100:00100000:0.0:1789117606.760447:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789117606.760461:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593092864:0@lo:13: 00000100:00100000:0.0:1789117606.760528:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117606.760587:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593092864 00000100:00100000:0.0:1789117606.760594:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593092864 00000100:00080000:2.0:1789117606.762910:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117606.765584:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789117606.765608:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593092864:12345-0@lo:13: 00002000:00000024:0.0:1789117606.765683:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117606.765831:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593092864:12345-0@lo:13: Request processed in 215us (5286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117606.765848:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1789117606.766180:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e15a40 x1876025593092864/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117606.766209:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593092864:0@lo:13: 00000001:00100000:0.0:1789117606.771013:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35e670b1-2cce-4394-8cb4-d5255c6a6a93 00010000:00010000:0.0:1789117606.885925:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117607.271588:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593092992:0@lo:400: 00000100:00100000:0.0:1789117607.271703:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117607.275117:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593092992 00000100:00100000:2.0:1789117607.275135:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593092992 00000100:00100000:2.0:1789117607.275242:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789117607.275255:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593092992:12345-0@lo:400: 00000100:00100000:0.0:1789117607.276464:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593093504:0@lo:400: 00000100:00100000:0.0:1789117607.276546:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117607.281719:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593093120:0@lo:41: 00000100:00100000:1.0:1789117607.281840:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117607.282078:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593093120 00000100:00100000:1.0:1789117607.282088:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593093120 00000100:00100000:1.0:1789117607.282154:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789117607.282165:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf774780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593093120:12345-0@lo:41: 00000004:00000024:1.0:1789117607.282222:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789117607.282302:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf774780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593093120:12345-0@lo:41: Request processed in 138us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117607.282310:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789117607.282364:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593093120:0@lo:41: 00000100:00100000:1.0:1789117607.282428:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593093248:0@lo:400: 00000100:00100000:1.0:1789117607.282460:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117607.282485:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117607.282491:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593093376:0@lo:400: 00000100:00100000:1.0:1789117607.282513:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117607.282535:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593093504 00000100:00100000:1.0:1789117607.282539:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593093504 00000100:00100000:1.0:1789117607.282565:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593093248 00000100:00100000:1.0:1789117607.282568:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593093248 00000100:00100000:1.0:1789117607.282594:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789117607.282600:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593093504:12345-0@lo:400: 00000100:00100000:1.0:1789117607.282635:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593093504:12345-0@lo:400: Request processed in 35us (6090us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117607.282660:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789117607.282672:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789117607.282678:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593093248:12345-0@lo:400: 00000100:00100000:1.0:1789117607.282711:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593093248:12345-0@lo:400: Request processed in 34us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117607.282717:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789117607.283089:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593092992:12345-0@lo:400: Request processed in 7834us (11384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117607.283100:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789117607.283141:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593093376 00000100:00100000:2.0:1789117607.283145:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593093376 00000100:00100000:2.0:1789117607.283165:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789117607.283171:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf774f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593093376:12345-0@lo:400: 00000100:00100000:2.0:1789117607.283202:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf774f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593093376:12345-0@lo:400: Request processed in 32us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117607.283214:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789117607.287769:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593092992:0@lo:400: 00000100:00100000:0.0:1789117607.287840:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593093504:0@lo:400: 00000100:00100000:3.0:1789117607.288250:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593093760:0@lo:400: 00000100:00100000:3.0:1789117607.288362:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117607.288399:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593094272:0@lo:400: 00000100:00100000:3.0:1789117607.288426:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117607.288458:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593093376:0@lo:400: 00000100:00100000:3.0:1789117607.288472:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593093248:0@lo:400: 00000100:00100000:3.0:1789117607.288491:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789117607.288497:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593093888:0@lo:400: 00000100:00100000:3.0:1789117607.288521:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117607.288534:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593094400:0@lo:400: 00000100:00100000:3.0:1789117607.288566:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117607.288617:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593093760 00000100:00100000:3.0:1789117607.288623:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593093760 00000100:00100000:3.0:1789117607.288677:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593093888 00000100:00100000:3.0:1789117607.288681:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593093888 00000100:00100000:3.0:1789117607.288702:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789117607.288713:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593093760:12345-0@lo:400: 00000100:00100000:3.0:1789117607.288765:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593093760:12345-0@lo:400: Request processed in 54us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117607.288773:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789117607.288789:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789117607.288795:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593093888:12345-0@lo:400: 00000100:00100000:3.0:1789117607.288821:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593093888:12345-0@lo:400: Request processed in 26us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117607.288828:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1789117607.288843:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789117607.288848:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789117607.288865:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87d83c00 x1876025593093888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117607.288875:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593093888:0@lo:400: 00000100:00100000:3.0:1789117607.289191:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593093760:0@lo:400: 00000100:00100000:3.0:1789117607.289216:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593093632:0@lo:400: 00000100:00100000:3.0:1789117607.289245:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117607.289276:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593094144:0@lo:400: 00000100:00100000:3.0:1789117607.289297:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117607.289315:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789117607.289329:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593094016:0@lo:400: 00000100:00100000:3.0:1789117607.289352:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117607.289371:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593094144 00000100:00100000:3.0:1789117607.289375:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593094144 00000100:00100000:3.0:1789117607.289399:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593094016 00000100:00100000:3.0:1789117607.289402:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593094016 00000100:00100000:3.0:1789117607.289417:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789117607.289424:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593094144:12345-0@lo:400: 00000100:00100000:3.0:1789117607.289458:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593094144:12345-0@lo:400: Request processed in 35us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117607.289464:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789117607.289475:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789117607.289482:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593094016:12345-0@lo:400: 00000100:00100000:3.0:1789117607.289509:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593094016:12345-0@lo:400: Request processed in 28us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117607.289515:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1789117607.289528:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789117607.289531:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789117607.289546:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593094016:0@lo:400: 00010000:00080000:3.0:1789117607.289556:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87d82d00 x1876025593094144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117607.289566:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593094144:0@lo:400: 00000100:00100000:3.0:1789117607.289598:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593094272 00000100:00100000:3.0:1789117607.289602:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593094272 00000100:00100000:3.0:1789117607.289631:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593094400 00000100:00100000:3.0:1789117607.289633:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593094400 00000100:00100000:3.0:1789117607.289651:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789117607.289658:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593094272:12345-0@lo:400: 00000100:00100000:3.0:1789117607.289698:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593094272:12345-0@lo:400: Request processed in 41us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117607.289705:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789117607.289717:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789117607.289722:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593094400:12345-0@lo:400: 00000100:00100000:3.0:1789117607.291467:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593094400:12345-0@lo:400: Request processed in 1738us (2894us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117607.291737:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1789117607.291780:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789117607.291823:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a8681a1c0 x1876025593094400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117607.291838:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593094400:0@lo:400: 00010000:00080000:3.0:1789117607.291856:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87d81a40 x1876025593094272/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117607.291865:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593094272:0@lo:400: 00000100:00100000:2.0:1789117607.296748:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593093632 00000100:00100000:2.0:1789117607.296761:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593093632 00000100:00100000:2.0:1789117607.297017:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789117607.297028:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593093632:12345-0@lo:400: 00000100:00100000:2.0:1789117607.297160:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593093632:12345-0@lo:400: Request processed in 134us (7912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117607.297168:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789117607.297254:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593093632:0@lo:400: 00000001:00100000:2.0:1789117607.783788:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 35e670b1-2cce-4394-8cb4-d5255c6a6a93 00000100:00100000:3.0:1789117607.788138:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789117607.788192:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593094528:0@lo:13: 00000100:00100000:3.0:1789117607.788348:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117607.788481:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593094656:0@lo:13: 00000100:00100000:3.0:1789117607.788511:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117607.789019:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593094528 00000100:00100000:0.0:1789117607.789036:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593094528 00000100:00100000:1.0:1789117607.789101:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593094656 00000100:00100000:1.0:1789117607.789113:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593094656 00000100:00100000:1.0:1789117607.789209:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789117607.789227:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593094656:12345-0@lo:13: 00002000:00000024:1.0:1789117607.789381:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117607.789523:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593094656:12345-0@lo:13: Request processed in 300us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117607.789534:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1789117607.792428:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7dc3c0 x1876025593094656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117607.792478:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593094656:0@lo:13: 00000001:00100000:2.0:1789117607.794119:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 35e670b1-2cce-4394-8cb4-d5255c6a6a93 00000100:00100000:0.0:1789117607.798010:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789117607.798044:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593094528:12345-0@lo:13: 00002000:00000024:0.0:1789117607.798100:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117607.799421:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593094528:12345-0@lo:13: Request processed in 1390us (11065us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117607.799434:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1789117607.799518:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7dcf00 x1876025593094528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117607.799554:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593094528:0@lo:13: 00010000:00010000:3.0:1789117607.910147:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117608.296988:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117608.297045:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117608.297144:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117608.297184:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117608.297210:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117608.297257:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572069376 00000100:00100000:1.0:1789117608.297272:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572069376 00000100:00100000:1.0:1789117608.297344:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 201 00000100:00100000:1.0:1789117608.297354:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2406:x1876025572069376:12345-192.168.204.30@tcp:400: 00000100:00100000:1.0:1789117608.297448:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2406:x1876025572069376:12345-192.168.204.30@tcp:400: Request processed in 95us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117608.297457:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 201 00000100:00100000:1.0:1789117608.297524:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572069504 00000100:00100000:1.0:1789117608.297528:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572069504 00000100:00100000:1.0:1789117608.297580:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572069632 00000100:00100000:1.0:1789117608.297584:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572069632 00000100:00100000:1.0:1789117608.297613:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00100000:1.0:1789117608.297621:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572069504:12345-192.168.204.30@tcp:400: 00000100:00100000:1.0:1789117608.297656:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572069504:12345-192.168.204.30@tcp:400: Request processed in 36us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117608.297663:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00100000:1.0:1789117608.297676:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 68 00000100:00100000:1.0:1789117608.297682:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572069632:12345-192.168.204.30@tcp:400: 00000100:00100000:1.0:1789117608.297706:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572069632:12345-192.168.204.30@tcp:400: Request processed in 24us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117608.297713:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 68 00000100:00100000:0.0:1789117608.298134:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572069760 00000100:00100000:0.0:1789117608.298141:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572069760 00000100:00100000:0.0:1789117608.298215:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572069888 00000100:00100000:0.0:1789117608.298220:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572069888 00000100:00100000:0.0:1789117608.298263:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:0.0:1789117608.298273:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572069760:12345-192.168.204.30@tcp:400: 00000100:00100000:0.0:1789117608.298319:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572069760:12345-192.168.204.30@tcp:400: Request processed in 47us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117608.298326:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:0.0:1789117608.298340:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:0.0:1789117608.298346:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572069888:12345-192.168.204.30@tcp:400: 00000100:00100000:0.0:1789117608.298372:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572069888:12345-192.168.204.30@tcp:400: Request processed in 27us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117608.298379:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00080000:3.0:1789117608.298709:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789117608.298716:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789117608.298719:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789117608.298723:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1789117608.814855:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 35e670b1-2cce-4394-8cb4-d5255c6a6a93 00010000:00010000:3.0:1789117608.933239:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789117608.973891:0:10188:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789117609.829508:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789117609.829536:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593094784:0@lo:41: 00000100:00100000:2.0:1789117609.829614:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117609.829769:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593094784 00000100:00100000:1.0:1789117609.829778:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593094784 00000100:00100000:1.0:1789117609.829829:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789117609.829839:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593094784:12345-0@lo:41: 00000004:00000024:1.0:1789117609.829876:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789117609.829935:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593094784:12345-0@lo:41: Request processed in 97us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117609.829943:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789117609.830085:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593094784:0@lo:41: 00010000:00010000:0.0:1789117609.958354:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117610.992371:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117611.877273:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593094912:0@lo:13: 00000100:00100000:0.0:1789117611.877388:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117611.877507:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593094912 00000100:00100000:0.0:1789117611.877517:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593094912 00000100:00100000:0.0:1789117611.877603:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789117611.877616:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593094912:12345-0@lo:13: 00002000:00000024:0.0:1789117611.877673:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117611.877734:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593094912:12345-0@lo:13: Request processed in 121us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117611.877743:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1789117611.877797:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e14780 x1876025593094912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117611.877844:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593094912:0@lo:13: 00000100:00080000:3.0:1789117611.878806:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789117611.881542:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593095040:0@lo:13: 00000100:00100000:2.0:1789117611.881913:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117611.886416:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593095040 00000100:00100000:0.0:1789117611.886439:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593095040 00000100:00100000:0.0:1789117611.886534:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789117611.886546:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593095040:12345-0@lo:13: 00002000:00000024:0.0:1789117611.886586:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117611.886792:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593095040:12345-0@lo:13: Request processed in 247us (4878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117611.886802:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1789117611.886836:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789117611.887318:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e14780 x1876025593095040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117611.887351:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593095040:0@lo:13: 00010000:00010000:2.0:1789117612.008292:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117612.390600:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593095168:0@lo:400: 00000100:00100000:1.0:1789117612.390706:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117612.390770:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593095680:0@lo:400: 00000100:00100000:1.0:1789117612.390817:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117612.390839:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593096192:0@lo:400: 00000100:00100000:1.0:1789117612.390889:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117612.390916:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789117612.390921:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593095552:0@lo:400: 00000100:00100000:1.0:1789117612.390951:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117612.390973:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593096064:0@lo:400: 00000100:00100000:1.0:1789117612.390995:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117612.391034:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593095680 00000100:00100000:1.0:1789117612.391045:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593095680 00000100:00100000:1.0:1789117612.391148:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789117612.391160:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593095680:12345-0@lo:400: 00000100:00100000:1.0:1789117612.391248:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593095680:12345-0@lo:400: Request processed in 89us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117612.391257:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789117612.391291:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593096192 00000100:00100000:1.0:1789117612.391295:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593096192 00000100:00100000:1.0:1789117612.391334:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593095552 00000100:00100000:1.0:1789117612.391337:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593095552 00000100:00100000:1.0:1789117612.391350:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593096064 00000100:00100000:1.0:1789117612.391352:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593096064 00000100:00100000:1.0:1789117612.391367:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789117612.391373:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593096192:12345-0@lo:400: 00000100:00100000:1.0:1789117612.391404:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593096192:12345-0@lo:400: Request processed in 31us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117612.391410:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789117612.391423:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789117612.391428:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593095552:12345-0@lo:400: 00000100:00100000:1.0:1789117612.391464:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593095552:12345-0@lo:400: Request processed in 36us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117612.391471:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789117612.391481:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789117612.391487:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593096064:12345-0@lo:400: 00000100:00100000:1.0:1789117612.391506:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593096064:12345-0@lo:400: Request processed in 20us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117612.391512:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789117612.391554:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593095552:0@lo:400: 00000100:00100000:1.0:1789117612.391565:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593096064:0@lo:400: 00000100:00100000:1.0:1789117612.391573:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593095680:0@lo:400: 00010000:00080000:1.0:1789117612.391584:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7de1c0 x1876025593096192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117612.391595:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593096192:0@lo:400: 00000100:00100000:2.0:1789117612.392197:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593095168 00000100:00100000:2.0:1789117612.392206:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593095168 00000100:00100000:3.0:1789117612.392579:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf83d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593096576:0@lo:41: 00000100:00100000:3.0:1789117612.392636:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117612.392686:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593096576 00000100:00100000:3.0:1789117612.392690:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593096576 00000100:00100000:3.0:1789117612.392721:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789117612.392729:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593096576:12345-0@lo:41: 00000004:00000024:3.0:1789117612.392770:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789117612.392819:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593096576:12345-0@lo:41: Request processed in 90us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117612.392825:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789117612.392865:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf83d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593096576:0@lo:41: 00000100:00100000:2.0:1789117612.392929:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789117612.392939:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593095168:12345-0@lo:400: 00000100:00100000:2.0:1789117612.392990:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593095168:12345-0@lo:400: Request processed in 53us (2285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117612.392996:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789117612.395253:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593095168:0@lo:400: 00000100:00100000:3.0:1789117612.396179:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593095424:0@lo:400: 00000100:00100000:3.0:1789117612.396280:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117612.396326:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876025593095936:0@lo:400: 00000100:00100000:3.0:1789117612.396354:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117612.396386:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593096448:0@lo:400: 00000100:00100000:3.0:1789117612.396412:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117612.397193:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789117612.397205:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593095296:0@lo:400: 00000100:00100000:3.0:1789117612.397236:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117612.397252:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593095808:0@lo:400: 00000100:00100000:3.0:1789117612.397271:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117612.397280:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593096320:0@lo:400: 00000100:00100000:3.0:1789117612.397304:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117612.397354:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593096448 00000100:00100000:3.0:1789117612.397362:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593096448 00000100:00100000:3.0:1789117612.397432:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593096320 00000100:00100000:3.0:1789117612.397436:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593096320 00000100:00100000:3.0:1789117612.397463:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789117612.397473:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593096448:12345-0@lo:400: 00000100:00100000:3.0:1789117612.397535:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593096448:12345-0@lo:400: Request processed in 63us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117612.397543:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789117612.397562:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789117612.397568:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593096320:12345-0@lo:400: 00000100:00100000:3.0:1789117612.397591:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593096320:12345-0@lo:400: Request processed in 24us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117612.397597:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789117612.397614:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593095936 00000100:00100000:3.0:1789117612.397617:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593095936 00000100:00100000:3.0:1789117612.397641:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593095296 00000100:00100000:3.0:1789117612.397643:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593095296 00000100:00100000:3.0:1789117612.397654:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593095808 00000100:00100000:3.0:1789117612.397663:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593095808 00000100:00100000:3.0:1789117612.397682:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789117612.397688:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876025593095936:12345-0@lo:400: 00000100:00100000:3.0:1789117612.397718:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876025593095936:12345-0@lo:400: Request processed in 30us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117612.397723:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789117612.397734:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789117612.397740:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593095296:12345-0@lo:400: 00000100:00100000:3.0:1789117612.397766:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593095296:12345-0@lo:400: Request processed in 26us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117612.397772:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789117612.397783:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789117612.397789:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593095808:12345-0@lo:400: 00000100:00100000:3.0:1789117612.397814:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593095808:12345-0@lo:400: Request processed in 26us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117612.397820:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789117612.397869:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593095296:0@lo:400: 00000100:00100000:3.0:1789117612.397878:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593095808:0@lo:400: 00010000:00080000:3.0:1789117612.397888:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7df0c0 x1876025593096320/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117612.397898:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593096320:0@lo:400: 00010000:00080000:3.0:1789117612.397907:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7df480 x1876025593095936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117612.397915:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876025593095936:0@lo:400: 00010000:00080000:3.0:1789117612.397937:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7dc000 x1876025593096448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117612.397946:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593096448:0@lo:400: 00000100:00100000:1.0:1789117612.398552:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593095424 00000100:00100000:1.0:1789117612.398574:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593095424 00000100:00100000:1.0:1789117612.398637:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789117612.398646:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593095424:12345-0@lo:400: 00000100:00100000:1.0:1789117612.398821:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593095424:12345-0@lo:400: Request processed in 176us (2540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117612.398848:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789117612.398922:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593095424:0@lo:400: 00000100:00080000:1.0:1789117612.400278:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789117612.400300:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789117612.400351:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789117612.904480:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593096704:0@lo:13: 00000100:00100000:0.0:1789117612.904606:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117612.904735:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593096704 00000100:00100000:0.0:1789117612.904744:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593096704 00000100:00100000:0.0:1789117612.904797:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789117612.904808:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593096704:12345-0@lo:13: 00002000:00000024:0.0:1789117612.904852:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117612.904906:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593096704:12345-0@lo:13: Request processed in 99us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117612.904914:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1789117612.904965:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a8681a1c0 x1876025593096704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117612.904989:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593096704:0@lo:13: 00000100:00100000:2.0:1789117612.906072:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789117612.906092:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593096832:0@lo:13: 00000100:00100000:2.0:1789117612.906166:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117612.906812:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593096832 00000100:00100000:0.0:1789117612.906824:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593096832 00000100:00100000:0.0:1789117612.906907:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789117612.906918:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593096832:12345-0@lo:13: 00002000:00000024:0.0:1789117612.907082:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117612.907149:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593096832:12345-0@lo:13: Request processed in 233us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117612.907170:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789117612.907716:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e15e00 x1876025593096832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117612.907740:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593096832:0@lo:13: 00010000:00010000:0.0:1789117613.033035:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117613.408119:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117613.409431:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572070016 00000100:00100000:0.0:1789117613.409447:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572070016 00000100:00100000:0.0:1789117613.409510:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 203 00000100:00100000:0.0:1789117613.409521:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2406:x1876025572070016:12345-192.168.204.30@tcp:400: 00000100:00100000:0.0:1789117613.409621:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2406:x1876025572070016:12345-192.168.204.30@tcp:400: Request processed in 100us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117613.409629:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 203 00000100:00100000:0.0:1789117613.419624:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117613.419698:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572070144 00000100:00100000:3.0:1789117613.419708:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572070144 00000100:00100000:3.0:1789117613.419786:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 75 00000100:00100000:3.0:1789117613.419797:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572070144:12345-192.168.204.30@tcp:400: 00000100:00100000:3.0:1789117613.419876:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572070144:12345-192.168.204.30@tcp:400: Request processed in 81us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117613.419884:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 75 00000100:00080000:0.0:1789117613.426103:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117613.451683:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117613.451865:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117613.451900:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572070400 00000100:00100000:1.0:1789117613.451905:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117613.451914:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572070400 00000100:00100000:1.0:1789117613.451935:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572070272 00000100:00100000:1.0:1789117613.451941:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572070272 00000100:00100000:0.0:1789117613.451998:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572070528 00000100:00100000:0.0:1789117613.452002:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572070528 00000100:00100000:1.0:1789117613.452005:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 76 00000100:00100000:1.0:1789117613.452018:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572070272:12345-192.168.204.30@tcp:400: 00000100:00100000:0.0:1789117613.452034:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:0.0:1789117613.452045:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572070400:12345-192.168.204.30@tcp:400: 00000100:00100000:1.0:1789117613.452119:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572070272:12345-192.168.204.30@tcp:400: Request processed in 104us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117613.452128:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 76 00000100:00100000:1.0:1789117613.452496:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:1.0:1789117613.452505:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572070528:12345-192.168.204.30@tcp:400: 00000100:00100000:0.0:1789117613.468037:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572070400:12345-192.168.204.30@tcp:400: Request processed in 15979us (16367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117613.468069:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00080000:0.0:1789117613.468112:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789117613.468119:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789117613.468135:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789117613.472989:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572070528:12345-192.168.204.30@tcp:400: Request processed in 20470us (21070us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117613.473010:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 23 00000020:00000080:3.0:1789117613.578287:0:10336:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce4dfab70 20000000:00000080:3.0:1789117613.578310:0:10336:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff962bbf7a0000 uarg=0000000000000000 20000000:01000000:3.0:1789117613.578384:0:10336:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789117613.578387:0:10336:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789117613.578390:0:10336:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789117613.578395:0:10336:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789117613.578399:0:10336:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1789117613.578470:0:10336:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789117613.578473:0:10336:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789117613.586045:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1789117613.586939:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1789117613.586986:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1789117613.587002:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1789117613.587020:0:10336:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789117613.587023:0:10336:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789117613.588543:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1789117613.588915:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1789117613.588950:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1789117613.588965:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:3.0:1789117613.588978:0:10336:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789117613.588981:0:10336:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789117613.589623:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1789117613.589810:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1789117613.589876:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1789117613.589963:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:3.0:1789117613.589977:0:10336:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789117613.589980:0:10336:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789117613.590571:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1789117613.590761:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1789117613.590784:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1789117613.590800:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1789117613.590809:0:10336:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789117613.590811:0:10336:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789117613.591754:0:10341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1789117613.591935:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1789117613.591958:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1789117613.591974:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 10000000:01000000:3.0:1789117613.591988:0:10336:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789117613.592010:0:10336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962a87d93200/0xaa253ed19be1f942 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117613.592031:0:10336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b813db600/0xaa253ed19be1f7dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f7d6 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117613.592040:0:10336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b89b68a00/0xaa253ed19be1f807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f800 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117613.592047:0:10336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b813da800/0xaa253ed19be1f846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f83f expref: 23 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117613.592124:0:10336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b89b68200/0xaa253ed19be1f854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f84d expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117613.592132:0:10336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b89b68c00/0xaa253ed19be1f862 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f85b expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117613.592150:0:10336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b80031a00/0xaa253ed19be1f87e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f877 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117613.592158:0:10336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962bbf70d600/0xaa253ed19be1f8a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f8a1 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117613.592177:0:10336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b80030c00/0xaa253ed19be1f8c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f8bd expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117613.592186:0:10336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b89b69c00/0xaa253ed19be1f8ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f8e7 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117613.592195:0:10336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b89b68e00/0xaa253ed19be1f8fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecba expref: 9 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117613.592202:0:10336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b89b69a00/0xaa253ed19be1f903 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecc1 expref: 9 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117613.592218:0:10336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962a87d93200/0xaa253ed19be1f942 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117613.592263:0:10336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b89b69a00/0xaa253ed19be1f903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecc1 expref: 9 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117613.592291:0:10336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962b89b69a00/0xaa253ed19be1f903 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecc1 expref: 9 pid: 9525 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117613.592310:0:10336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1876025593096960:192.168.204.30@tcp:104: 00010000:00010000:3.0:1789117613.592613:0:10336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b89b68e00/0xaa253ed19be1f8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecba expref: 9 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117613.592621:0:10336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962b89b68e00/0xaa253ed19be1f8fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecba expref: 9 pid: 9525 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117613.592631:0:10336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d80780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1876025593097088:192.168.204.30@tcp:104: 00010000:00010000:3.0:1789117613.592671:0:10336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b89b69c00/0xaa253ed19be1f8ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f8e7 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117613.592679:0:10336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962b89b69c00/0xaa253ed19be1f8ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f8e7 expref: 23 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117613.592688:0:10336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d81a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1876025593097216:0@lo:104: 00000100:00100000:3.0:1789117613.592728:0:10336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789117613.593447:0:10336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b80030c00/0xaa253ed19be1f8c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f8bd expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117613.593459:0:10336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962b80030c00/0xaa253ed19be1f8c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f8bd expref: 23 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117613.593470:0:10336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d82940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1876025593097344:0@lo:104: 00000100:00100000:3.0:1789117613.593504:0:10336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789117613.596684:0:10336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962bbf70d600/0xaa253ed19be1f8a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f8a1 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117613.596705:0:10336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962bbf70d600/0xaa253ed19be1f8a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f8a1 expref: 23 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117613.596723:0:10336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d83c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1876025593097472:0@lo:104: 00000100:00100000:0.0:1789117613.598469:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593097216 00000100:00100000:0.0:1789117613.598483:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593097216 00000100:00100000:0.0:1789117613.598542:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593097344 00000100:00100000:0.0:1789117613.598545:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593097344 00000100:00100000:0.0:1789117613.598563:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789117613.598572:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d82d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+4:10336:x1876025593097216:12345-0@lo:104: 00010000:00010000:0.0:1789117613.598588:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be1f8e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f8ee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117613.600127:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117613.600245:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117613.600281:0:10336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789117613.600509:0:10336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b80031a00/0xaa253ed19be1f87e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f877 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117613.600526:0:10336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962b80031a00/0xaa253ed19be1f87e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f877 expref: 23 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117613.600564:0:10336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d821c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1876025593097600:0@lo:104: 00000100:00100000:3.0:1789117613.600832:0:10336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789117613.600866:0:10336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b89b68c00/0xaa253ed19be1f862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f85b expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117613.600874:0:10336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962b89b68c00/0xaa253ed19be1f862 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f85b expref: 23 pid: 6512 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117613.600882:0:10336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1876025593097728:0@lo:104: 00010000:00010000:3.0:1789117613.600905:0:10336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b89b68200/0xaa253ed19be1f854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f84d expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117613.600912:0:10336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962b89b68200/0xaa253ed19be1f854 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f84d expref: 23 pid: 6512 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117613.600918:0:10336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1876025593097856:0@lo:104: 00010000:00010000:3.0:1789117613.600943:0:10336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b813da800/0xaa253ed19be1f846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f83f expref: 23 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117613.600951:0:10336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962b813da800/0xaa253ed19be1f846 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f83f expref: 23 pid: 9525 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117613.600957:0:10336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef4780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1876025593097984:0@lo:104: 00010000:00010000:3.0:1789117613.600976:0:10336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b89b68a00/0xaa253ed19be1f807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f800 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117613.600983:0:10336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962b89b68a00/0xaa253ed19be1f807 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f800 expref: 23 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117613.600998:0:10336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1876025593098112:0@lo:104: 00010000:00010000:3.0:1789117613.601022:0:10336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b813db600/0xaa253ed19be1f7dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f7d6 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117613.601030:0:10336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962b813db600/0xaa253ed19be1f7dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f7d6 expref: 23 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117613.601037:0:10336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef5a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1876025593098240:0@lo:104: 00000100:00100000:3.0:1789117613.601091:0:10336:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e46c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117613.601118:0:10336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1876025593096960:192.168.204.30@tcp:104: 00000100:00100000:3.0:1789117613.601126:0:10336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d80780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1876025593097088:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117613.601246:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789117613.601256:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d82d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+4:10336:x1876025593097216:12345-0@lo:104: Request processed in 2684us (8526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117613.601266:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789117613.601306:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789117613.601334:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117613.601347:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117613.601353:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117613.601359:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117613.601366:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117613.601373:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593097472 00000100:00100000:0.0:1789117613.601378:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593097472 00000100:00100000:0.0:1789117613.601403:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593097600 00000100:00100000:0.0:1789117613.601405:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593097600 00000100:00100000:0.0:1789117613.601416:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593097728 00000100:00100000:0.0:1789117613.601418:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593097728 00000100:00100000:0.0:1789117613.601427:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593097856 00000100:00100000:0.0:1789117613.601429:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593097856 00000100:00100000:0.0:1789117613.601436:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593097984 00000100:00100000:0.0:1789117613.601438:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593097984 00000100:00100000:0.0:1789117613.601447:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593098112 00000100:00100000:0.0:1789117613.601455:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593098112 00000100:00100000:0.0:1789117613.601466:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593098240 00000100:00100000:0.0:1789117613.601468:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593098240 00000100:00100000:0.0:1789117613.601480:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789117613.601488:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d830c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+10:10336:x1876025593097344:12345-0@lo:104: 00010000:00010000:0.0:1789117613.601499:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be1f8bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f8c4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.601540:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789117613.601545:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d830c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+10:10336:x1876025593097344:12345-0@lo:104: Request processed in 58us (8042us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117613.601551:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789117613.601562:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789117613.601568:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d812c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+9:10336:x1876025593097472:12345-0@lo:104: 00010000:00010000:0.0:1789117613.601574:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be1f8a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f8a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.601604:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789117613.601608:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d812c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+9:10336:x1876025593097472:12345-0@lo:104: Request processed in 41us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117613.601614:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789117613.601625:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789117613.601631:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87867050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+8:10336:x1876025593097600:12345-0@lo:104: 00010000:00010000:0.0:1789117613.601638:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f87e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.601664:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789117613.601669:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87867050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+8:10336:x1876025593097600:12345-0@lo:104: Request processed in 39us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117613.601682:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789117613.601716:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789117613.601722:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+7:10336:x1876025593097728:12345-0@lo:104: 00010000:00010000:0.0:1789117613.601730:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be1f85b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f862 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.601756:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1789117613.601761:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+7:10336:x1876025593097728:12345-0@lo:104: Request processed in 40us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117613.601766:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789117613.601776:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789117613.601782:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+6:10336:x1876025593097856:12345-0@lo:104: 00010000:00010000:0.0:1789117613.601789:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f84d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f854 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.601811:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1789117613.601815:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+6:10336:x1876025593097856:12345-0@lo:104: Request processed in 35us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117613.601820:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789117613.601830:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789117613.601836:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+5:10336:x1876025593097984:12345-0@lo:104: 00010000:00010000:0.0:1789117613.601842:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f83f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f846 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.601866:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1789117613.601870:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+5:10336:x1876025593097984:12345-0@lo:104: Request processed in 35us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117613.601882:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789117613.601896:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789117613.601901:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+4:10336:x1876025593098112:12345-0@lo:104: 00010000:00010000:0.0:1789117613.601909:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be1f800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f807 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.601933:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:0.0:1789117613.601937:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+4:10336:x1876025593098112:12345-0@lo:104: Request processed in 37us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117613.601943:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789117613.601954:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789117613.601960:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+3:10336:x1876025593098240:12345-0@lo:104: 00000100:00100000:1.0:1789117613.605740:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572070656 00000100:00100000:1.0:1789117613.605761:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572070656 00000100:00100000:2.0:1789117613.605800:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572070784 00000100:00100000:2.0:1789117613.605804:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572070784 00010000:00010000:2.0:1789117613.605821:0:9524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b89b68e00/0xaa253ed19be1f8fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecba expref: 11 pid: 9525 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117613.605821:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b89b69a00/0xaa253ed19be1f903 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecc1 expref: 11 pid: 9525 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117613.605864:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:1.0:1789117613.605870:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:2.0:1789117613.605873:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a75e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6b51ebb8-b89b-4376-982e-072902ca33a8+11:2406:x1876025572070784:12345-192.168.204.30@tcp:103: 00000100:00100000:1.0:1789117613.605875:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb093b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b51ebb8-b89b-4376-982e-072902ca33a8+11:2407:x1876025572070656:12345-192.168.204.30@tcp:103: 00010000:00010000:2.0:1789117613.605887:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117613.605887:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117613.605892:0:9524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b89b68e00/0xaa253ed19be1f8fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecba expref: 11 pid: 9525 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117613.605892:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b89b69a00/0xaa253ed19be1f903 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecc1 expref: 11 pid: 9525 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117613.605917:0:9524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b89b68e00/0xaa253ed19be1f8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecba expref: 11 pid: 9525 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117613.605929:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b89b69a00/0xaa253ed19be1f903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecc1 expref: 11 pid: 9525 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.605972:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1f7d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f7dd expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.605996:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1789117613.606003:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be1f8e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f8ee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606011:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b80030000 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117613.606016:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be1f8e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f8ee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606024:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be1f8e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f8ee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117613.606031:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be1f8e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f8ee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117613.606044:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789117613.606093:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be1f8e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f8ee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606200:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117613.606227:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be1f8e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f8ee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606236:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be1f8e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f8ee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606253:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1789117613.606257:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be1f8bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f8c4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606263:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b80031600 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117613.606278:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be1f8bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f8c4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606287:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be1f8bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f8c4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117613.606293:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be1f8bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f8c4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117613.606298:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789117613.606344:0:10336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d81a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1876025593097216:0@lo:104: 00000100:00100000:3.0:1789117613.606354:0:10336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d82940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1876025593097344:0@lo:104: 00000100:00100000:3.0:1789117613.606361:0:10336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d83c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1876025593097472:0@lo:104: 00000100:00100000:3.0:1789117613.606368:0:10336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d821c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1876025593097600:0@lo:104: 00010000:00010000:0.0:1789117613.606388:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be1f8bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f8c4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606393:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117613.606411:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be1f8bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f8c4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606417:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be1f8bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f8c4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606426:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1789117613.606429:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be1f8a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f8a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606434:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b80030a00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117613.606437:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be1f8a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f8a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606443:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be1f8a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f8a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117613.606448:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be1f8a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f8a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117613.606453:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789117613.606464:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be1f8a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f8a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606468:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117613.606472:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be1f8a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f8a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606478:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be1f8a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f8a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606485:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789117613.606492:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f87e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606497:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db800 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117613.606500:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f87e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606505:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f87e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117613.606510:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f87e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117613.606515:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789117613.606524:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f877 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f87e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606529:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117613.606533:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f877 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f87e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606539:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be1f877 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f87e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606546:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789117613.606548:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be1f85b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f862 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606553:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db400 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117613.606556:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be1f85b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f862 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606569:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be1f85b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f862 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117613.606574:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be1f85b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f862 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117613.606579:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789117613.606587:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be1f85b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f862 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606591:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117613.606595:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be1f85b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f862 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606601:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be1f85b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f862 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606609:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789117613.606612:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f84d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f854 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606618:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dbe00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117613.606621:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f84d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f854 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606632:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f84d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f854 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117613.606639:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f84d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f854 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117613.606650:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789117613.606665:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f84d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f854 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606671:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117613.606675:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f84d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f854 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606681:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b813dbe00/0xaa253ed19be1f84d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f854 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606695:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789117613.606698:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f83f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f846 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606703:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9ac00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117613.606706:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f83f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f846 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606713:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f83f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f846 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117613.606719:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f83f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f846 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117613.606724:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789117613.606734:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f83f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f846 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606739:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117613.606748:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f83f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f846 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606754:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f83f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f846 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606763:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117613.606766:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be1f800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f807 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606771:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db200 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117613.606774:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be1f800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f807 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606779:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be1f800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f807 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117613.606786:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be1f800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f807 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117613.606791:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789117613.606817:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be1f800 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f807 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606823:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117613.606827:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be1f800 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f807 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606832:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be1f800 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f807 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.606841:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117613.606847:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117613.606848:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117613.606857:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117613.606863:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117613.606876:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf81cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593098368:0@lo:103: 00000100:00100000:3.0:1789117613.606923:0:10336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1876025593097728:0@lo:104: 00010000:00010000:1.0:1789117613.606997:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b89b69a00/0xaa253ed19be1f903 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecc1 expref: 11 pid: 9525 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117613.606999:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789117613.607018:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117613.607049:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593098880:0@lo:103: 00000100:00100000:3.0:1789117613.607092:0:10336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1876025593097856:0@lo:104: 00000100:00100000:0.0:1789117613.607104:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117613.607105:0:10336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef4780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1876025593097984:0@lo:104: 00000100:00100000:3.0:1789117613.607114:0:10336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1876025593098112:0@lo:104: 00010000:00010000:2.0:1789117613.607180:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b89b68e00/0xaa253ed19be1f8fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecba expref: 10 pid: 9525 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117613.607192:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117613.607933:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a75e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6b51ebb8-b89b-4376-982e-072902ca33a8+9:2406:x1876025572070784:12345-192.168.204.30@tcp:103: Request processed in 2056us (7683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117613.607945:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:2.0:1789117613.607972:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593098368 00000100:00100000:2.0:1789117613.607979:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593098368 00010000:00010000:2.0:1789117613.608009:0:9524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b89b69c00/0xaa253ed19be1f8ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f8e7 expref: 24 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117613.608025:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593098880 00000100:00100000:2.0:1789117613.608028:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593098880 00010000:00010000:2.0:1789117613.608040:0:9524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b89b68c00/0xaa253ed19be1f862 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f85b expref: 25 pid: 6512 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117613.608077:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789117613.608085:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e4b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7945443b-b7e4-4157-aee9-c9b2172613e6+25:3647:x1876025593098368:12345-0@lo:103: 00010000:00010000:2.0:1789117613.608097:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117613.608101:0:9524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b89b69c00/0xaa253ed19be1f8ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f8e7 expref: 25 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117613.609353:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789117613.609376:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf81c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593098752:0@lo:103: 00000100:00100000:0.0:1789117613.609454:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117613.609482:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593099264:0@lo:103: 00000100:00100000:0.0:1789117613.609526:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117613.609556:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf81d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593098496:0@lo:103: 00000100:00100000:0.0:1789117613.609576:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117613.609586:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593099008:0@lo:103: 00000100:00100000:0.0:1789117613.609605:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117613.609615:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789117613.609620:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf81e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593098624:0@lo:103: 00000100:00100000:0.0:1789117613.609636:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117613.609645:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593099136:0@lo:103: 00000100:00100000:0.0:1789117613.609659:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117613.609684:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593098752 00000100:00100000:0.0:1789117613.609690:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593098752 00010000:00010000:0.0:1789117613.609721:0:7470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b80031a00/0xaa253ed19be1f87e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f877 expref: 26 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117613.609751:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593099264 00000100:00100000:0.0:1789117613.609754:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593099264 00010000:00010000:0.0:1789117613.609765:0:7470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b89b68a00/0xaa253ed19be1f807 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f800 expref: 27 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117613.609774:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593098496 00000100:00100000:0.0:1789117613.609776:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593098496 00010000:00010000:0.0:1789117613.609783:0:7470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b80030c00/0xaa253ed19be1f8c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f8bd expref: 28 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117613.609792:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593099008 00000100:00100000:0.0:1789117613.609794:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593099008 00010000:00010000:0.0:1789117613.609802:0:7470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b89b68200/0xaa253ed19be1f854 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f84d expref: 29 pid: 6512 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117613.609812:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593098624 00000100:00100000:0.0:1789117613.609814:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593098624 00010000:00010000:0.0:1789117613.609824:0:7470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962bbf70d600/0xaa253ed19be1f8a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f8a1 expref: 30 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117613.609839:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593099136 00000100:00100000:0.0:1789117613.609842:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593099136 00010000:00010000:0.0:1789117613.609853:0:7470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b813da800/0xaa253ed19be1f846 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f83f expref: 31 pid: 9525 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117613.609871:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789117613.609880:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e4a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+31:3647:x1876025593098880:12345-0@lo:103: 00010000:00010000:0.0:1789117613.609892:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117613.609896:0:7470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b89b68c00/0xaa253ed19be1f862 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f85b expref: 31 pid: 6512 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117613.609912:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb093b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b51ebb8-b89b-4376-982e-072902ca33a8+8:2407:x1876025572070656:12345-192.168.204.30@tcp:103: Request processed in 4031us (9801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117613.609923:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 25 00010000:00010000:2.0:1789117613.610948:0:9524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b89b69c00/0xaa253ed19be1f8ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f8e7 expref: 31 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.611209:0:7470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b89b68c00/0xaa253ed19be1f862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f85b expref: 31 pid: 6512 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.611236:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b89b68c00/0xaa253ed19be1f862 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f85b expref: 31 pid: 6512 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.611261:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117613.611353:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e4a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+30:3647:x1876025593098880:12345-0@lo:103: Request processed in 1472us (4245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117613.611363:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789117613.611409:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789117613.611423:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+29:3647:x1876025593098752:12345-0@lo:103: 00010000:00010000:0.0:1789117613.611440:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117613.611445:0:7470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b80031a00/0xaa253ed19be1f87e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f877 expref: 29 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.611454:0:7470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b80031a00/0xaa253ed19be1f87e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f877 expref: 29 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.611465:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b80031a00/0xaa253ed19be1f87e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f877 expref: 29 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.611475:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117613.611496:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+28:3647:x1876025593098752:12345-0@lo:103: Request processed in 79us (2042us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117613.611501:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789117613.611513:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789117613.611518:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e492c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+27:3647:x1876025593099264:12345-0@lo:103: 00010000:00010000:0.0:1789117613.611531:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117613.611535:0:7470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b89b68a00/0xaa253ed19be1f807 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f800 expref: 27 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.611543:0:7470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b89b68a00/0xaa253ed19be1f807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f800 expref: 27 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.611552:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b89b68a00/0xaa253ed19be1f807 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f800 expref: 27 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.611558:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117613.611576:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e492c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+26:3647:x1876025593099264:12345-0@lo:103: Request processed in 58us (2050us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117613.611581:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789117613.611591:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789117613.611595:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+25:3644:x1876025593098496:12345-0@lo:103: 00010000:00010000:0.0:1789117613.611602:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117613.611606:0:7470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b80030c00/0xaa253ed19be1f8c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f8bd expref: 25 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.611614:0:7470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b80030c00/0xaa253ed19be1f8c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f8bd expref: 25 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.611622:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b80030c00/0xaa253ed19be1f8c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f8bd expref: 25 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.611630:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117613.611650:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593098496:12345-0@lo:103: Request processed in 55us (2073us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117613.611663:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789117613.611673:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789117613.611678:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb0939c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+23:3644:x1876025593099008:12345-0@lo:103: 00010000:00010000:0.0:1789117613.611697:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117613.611701:0:7470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b89b68200/0xaa253ed19be1f854 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f84d expref: 23 pid: 6512 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.611709:0:7470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b89b68200/0xaa253ed19be1f854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f84d expref: 23 pid: 6512 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.611718:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b89b68200/0xaa253ed19be1f854 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f84d expref: 23 pid: 6512 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.611725:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117613.611742:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb0939c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+22:3644:x1876025593099008:12345-0@lo:103: Request processed in 64us (2136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117613.611747:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789117613.611757:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789117613.611762:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+21:3644:x1876025593098624:12345-0@lo:103: 00010000:00010000:0.0:1789117613.611768:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117613.611771:0:7470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962bbf70d600/0xaa253ed19be1f8a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f8a1 expref: 21 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.611778:0:7470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962bbf70d600/0xaa253ed19be1f8a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f8a1 expref: 21 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.611786:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bbf70d600/0xaa253ed19be1f8a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f8a1 expref: 21 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.611803:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117613.611820:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+20:3644:x1876025593098624:12345-0@lo:103: Request processed in 59us (2183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117613.611826:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789117613.611835:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789117613.611840:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e48780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+19:3644:x1876025593099136:12345-0@lo:103: 00010000:00010000:0.0:1789117613.611846:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117613.611849:0:7470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b813da800/0xaa253ed19be1f846 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f83f expref: 19 pid: 9525 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.611856:0:7470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b813da800/0xaa253ed19be1f846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f83f expref: 19 pid: 9525 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.611864:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813da800/0xaa253ed19be1f846 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f83f expref: 19 pid: 9525 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.611873:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117613.611890:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e48780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+18:3644:x1876025593099136:12345-0@lo:103: Request processed in 50us (2230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117613.611896:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789117613.611991:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf81c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593098752:0@lo:103: 00000100:00100000:0.0:1789117613.612004:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593099264:0@lo:103: 00000100:00100000:0.0:1789117613.612012:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593098880:0@lo:103: 00000100:00100000:0.0:1789117613.612048:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf81e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593098624:0@lo:103: 00000100:00100000:0.0:1789117613.612083:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593099136:0@lo:103: 00000100:00100000:0.0:1789117613.612100:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf81d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593098496:0@lo:103: 00000100:00100000:0.0:1789117613.612106:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593099008:0@lo:103: 00010000:00010000:0.0:1789117613.612211:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789117613.612219:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+3:10336:x1876025593098240:12345-0@lo:104: Request processed in 10259us (10850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117613.612229:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1789117613.612255:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117613.612262:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1f7d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f7dd expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.612271:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813daa00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117613.612276:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1f7d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f7dd expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.612286:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1f7d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f7dd expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117613.612295:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1f7d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f7dd expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117613.612302:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789117613.612333:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1f7d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f7dd expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.612340:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117613.612368:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1f7d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f7dd expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.612376:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1f7d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f7dd expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.612396:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117613.612398:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117613.612400:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117613.612408:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789117613.612420:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593099392:0@lo:103: 00000100:00100000:0.0:1789117613.612453:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117613.612487:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593099392 00000100:00100000:0.0:1789117613.612492:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593099392 00010000:00010000:0.0:1789117613.612510:0:7470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b813db600/0xaa253ed19be1f7dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f7d6 expref: 18 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117613.612530:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789117613.612536:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e49680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+18:3646:x1876025593099392:12345-0@lo:103: 00010000:00010000:0.0:1789117613.612543:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117613.612547:0:7470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b813db600/0xaa253ed19be1f7dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f7d6 expref: 18 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.612555:0:7470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b813db600/0xaa253ed19be1f7dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f7d6 expref: 18 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117613.612565:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117613.612588:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e49680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+18:3646:x1876025593099392:12345-0@lo:103: Request processed in 51us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117613.612593:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789117613.612615:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593099392:0@lo:103: 00010000:00010000:2.0:1789117613.613160:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b89b69c00/0xaa253ed19be1f8ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f8e7 expref: 17 pid: 6513 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117613.613178:0:9524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962a87d93200/0xaa253ed19be1f942 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117613.613187:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d93200/0xaa253ed19be1f942 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117613.613208:0:9524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962a87d93200/0xaa253ed19be1f942 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117613.613216:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962a87d93200/0xaa253ed19be1f942 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117613.613224:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962a87d93200/0xaa253ed19be1f942 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117613.613230:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962a87d93200/0xaa253ed19be1f942 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117613.613236:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93200 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117613.613240:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962a87d93200/0xaa253ed19be1f942 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117613.613248:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962a87d93200/0xaa253ed19be1f942 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117613.613258:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962a87d93200/0xaa253ed19be1f942 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117613.613285:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117613.613348:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e4b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7945443b-b7e4-4157-aee9-c9b2172613e6+16:3647:x1876025593098368:12345-0@lo:103: Request processed in 5263us (6349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117613.613358:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789117613.614943:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf81cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593098368:0@lo:103: 00010000:00010000:2.0:1789117613.616163:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813db600/0xaa253ed19be1f7dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f7d6 expref: 15 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117613.616184:0:10336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef5a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1876025593098240:0@lo:104: 00010000:00010000:2.0:1789117613.616371:0:10336:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962a87d93200/0xaa253ed19be1f942 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117613.616384:0:10336:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962a87d93200/0xaa253ed19be1f942 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117613.616391:0:10336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962a87d93200/0xaa253ed19be1f942 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117613.616398:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d93200/0xaa253ed19be1f942 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117614.040535:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117614.042285:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572070912 00000100:00100000:2.0:1789117614.042301:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572070912 00000100:00100000:2.0:1789117614.042389:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 204 00000100:00100000:2.0:1789117614.042400:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+8:6181:x1876025572070912:12345-192.168.204.30@tcp:101: 00010000:00010000:2.0:1789117614.042420:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117614.042445:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b89b69c00/0xaa253ed19be1f949 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ed31 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117614.042494:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b89b69c00/0xaa253ed19be1f949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed31 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117614.042505:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b89b69c00/0xaa253ed19be1f949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed31 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117614.042515:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69c00, rc 0) 00000100:00100000:2.0:1789117614.042656:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+9:6181:x1876025572070912:12345-192.168.204.30@tcp:101: Request processed in 256us (2130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117614.042663:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 204 00010000:00010000:2.0:1789117614.053895:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117614.054012:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117614.054128:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572071040 00000100:00100000:1.0:1789117614.054148:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572071040 00000100:00100000:1.0:1789117614.054210:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 205 00000100:00100000:1.0:1789117614.054221:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+9:6181:x1876025572071040:12345-192.168.204.30@tcp:501: 00000100:00100000:1.0:1789117614.054383:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+9:6181:x1876025572071040:12345-192.168.204.30@tcp:501: Request processed in 163us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117614.054391:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 205 00000100:00100000:3.0:1789117614.057985:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117614.058089:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572071168 00000100:00100000:2.0:1789117614.058099:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572071168 00000100:00100000:2.0:1789117614.058173:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 206 00000100:00100000:2.0:1789117614.058183:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+9:6181:x1876025572071168:12345-192.168.204.30@tcp:503: 00000100:00100000:2.0:1789117614.058337:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+9:6181:x1876025572071168:12345-192.168.204.30@tcp:503: Request processed in 154us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117614.058345:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 206 00000100:00100000:3.0:1789117614.066041:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117614.066496:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572071296 00000100:00100000:1.0:1789117614.066507:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572071296 00000100:00100000:1.0:1789117614.066556:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 207 00000100:00100000:1.0:1789117614.066567:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+9:6652:x1876025572071296:12345-192.168.204.30@tcp:502: 00000100:00100000:1.0:1789117614.066740:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+9:6652:x1876025572071296:12345-192.168.204.30@tcp:502: Request processed in 174us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117614.066749:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 207 00000100:00100000:0.0:1789117614.071847:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117614.072346:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572071424 00000100:00100000:2.0:1789117614.072421:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572071424 00000100:00100000:2.0:1789117614.072490:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 208 00000100:00100000:2.0:1789117614.072502:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+9:6652:x1876025572071424:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789117614.074581:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+9:6652:x1876025572071424:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 2073us (2736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117614.074594:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 208 00000100:00100000:3.0:1789117614.086324:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117614.086908:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572071552 00000100:00100000:1.0:1789117614.086923:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572071552 00000100:00100000:1.0:1789117614.087165:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 209 00000100:00100000:1.0:1789117614.087177:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+9:6181:x1876025572071552:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117614.087196:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117614.087215:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbf70c000/0xaa253ed19be1f950 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ed38 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117614.087248:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbf70c000/0xaa253ed19be1f950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed38 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117614.087259:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbf70c000/0xaa253ed19be1f950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed38 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117614.087268:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70c000, rc 0) 00000100:00100000:1.0:1789117614.087347:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+10:6181:x1876025572071552:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 Request processed in 173us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117614.087365:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 209 00000100:00100000:3.0:1789117614.090219:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117614.091160:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572071680 00000100:00100000:0.0:1789117614.091172:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572071680 00000100:00100000:0.0:1789117614.091239:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 210 00000100:00100000:0.0:1789117614.091249:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:6181:x1876025572071680:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117614.093298:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:6181:x1876025572071680:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 Request processed in 2040us (3079us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789117614.093313:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 210 00000100:00100000:3.0:1789117614.949398:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789117614.949425:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593099520:0@lo:41: 00000100:00100000:3.0:1789117614.949501:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117614.949648:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593099520 00000100:00100000:0.0:1789117614.949657:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593099520 00000100:00100000:0.0:1789117614.949713:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789117614.949723:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593099520:12345-0@lo:41: 00000004:00000024:0.0:1789117614.949757:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789117614.949816:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593099520:12345-0@lo:41: Request processed in 95us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117614.949824:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789117614.949909:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593099520:0@lo:41: 00010000:00010000:0.0:1789117615.079818:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789117615.397208:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789117615.397218:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962b872f5000 from 48 10000000:01000000:0.0:1789117615.397224:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789117615.397279:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f957 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.397290:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f957 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.397302:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f957 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117615.397346:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593099648:0@lo:101: 00000100:00100000:0.0:1789117615.397428:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117615.397750:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf839c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117615.408827:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593099648 00000100:00100000:3.0:1789117615.408842:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593099648 00000100:00100000:3.0:1789117615.408913:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789117615.408923:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+15:6517:x1876025593099648:12345-0@lo:101: 00010000:00010000:3.0:1789117615.408939:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117615.408959:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d93800/0xaa253ed19be1f95e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f957 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117615.408989:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d93800/0xaa253ed19be1f95e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f957 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117615.409001:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d93800/0xaa253ed19be1f95e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f957 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117615.409011:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93800, rc 0) 00000100:00100000:3.0:1789117615.409131:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+16:6517:x1876025593099648:12345-0@lo:101: Request processed in 209us (11702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117615.409138:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789117615.409583:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593099648:0@lo:101: 00010000:00010000:2.0:1789117615.409604:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f957 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f95e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117615.409615:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f957 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f95e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117615.409708:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a75e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593099776:0@lo:501: 00000100:00100000:2.0:1789117615.409750:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117615.409794:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf751cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117615.409853:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593099776 00000100:00100000:1.0:1789117615.409858:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593099776 00000100:00100000:1.0:1789117615.409899:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789117615.409907:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+16:6517:x1876025593099776:12345-0@lo:501: 00000100:00100000:1.0:1789117615.410048:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+16:6517:x1876025593099776:12345-0@lo:501: Request processed in 141us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117615.410081:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789117615.410447:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a75e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593099776:0@lo:501: 00000100:00100000:3.0:1789117615.410485:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593099904:0@lo:503: 00000100:00100000:3.0:1789117615.410534:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117615.410671:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e46240 going to sleep for 11 seconds 00000100:00100000:2.0:1789117615.418799:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593099904 00000100:00100000:2.0:1789117615.418817:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593099904 00000100:00100000:1.0:1789117615.421004:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789117615.421043:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+16:6517:x1876025593099904:12345-0@lo:503: 00000100:00100000:1.0:1789117615.421286:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+16:6517:x1876025593099904:12345-0@lo:503: Request processed in 247us (10749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117615.421294:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789117615.430754:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593099904:0@lo:503: 00000100:00100000:2.0:1789117615.436622:0:10360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a75e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10360:1876025593100032:0@lo:502: 00000100:00100000:2.0:1789117615.436715:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117615.436765:0:10360:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf751480 going to sleep for 11 seconds 00000100:00100000:0.0:1789117615.436891:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593100032 00000100:00100000:0.0:1789117615.436899:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593100032 00000100:00100000:0.0:1789117615.436951:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789117615.436961:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+16:10360:x1876025593100032:12345-0@lo:502: 00000100:00100000:0.0:1789117615.437141:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+16:10360:x1876025593100032:12345-0@lo:502: Request processed in 181us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117615.437150:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789117615.437485:0:10360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a75e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10360:1876025593100032:0@lo:502: 00000100:00100000:2.0:1789117615.437559:0:10360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a75e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10360:1876025593100160:0@lo:502: 00000100:00100000:2.0:1789117615.437596:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117615.437628:0:10360:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf751480 going to sleep for 11 seconds 00000100:00100000:3.0:1789117615.437737:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593100160 00000100:00100000:3.0:1789117615.437743:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593100160 00000100:00100000:3.0:1789117615.437774:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789117615.437790:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+16:10360:x1876025593100160:12345-0@lo:502: 00000100:00100000:3.0:1789117615.437883:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+16:10360:x1876025593100160:12345-0@lo:502: Request processed in 94us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117615.437890:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789117615.438840:0:10360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a75e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10360:1876025593100160:0@lo:502: 00000040:00080000:2.0:1789117615.438883:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789117615.439159:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789117615.439182:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789117615.439192:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f957 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f95e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.439202:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f957 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f95e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117615.439211:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789117615.439214:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1789117615.439217:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789117615.439265:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9aa00/0xaa253ed19be1f965 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.439275:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962baea9aa00/0xaa253ed19be1f965 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.439286:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962baea9aa00/0xaa253ed19be1f965 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117615.439316:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e4ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593100288:0@lo:101: 00000100:00100000:0.0:1789117615.439366:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117615.439405:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf839900 going to sleep for 11 seconds 00000100:00100000:2.0:1789117615.441712:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593100288 00000100:00100000:2.0:1789117615.441726:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593100288 00000100:00100000:2.0:1789117615.441793:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789117615.441803:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+16:6517:x1876025593100288:12345-0@lo:101: 00010000:00010000:2.0:1789117615.441833:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117615.441855:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b89b68000/0xaa253ed19be1f96c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f965 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117615.441885:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b89b68000/0xaa253ed19be1f96c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f965 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117615.441896:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b89b68000/0xaa253ed19be1f96c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f965 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117615.441906:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b68000, rc 0) 00000100:00100000:2.0:1789117615.441981:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593100288:12345-0@lo:101: Request processed in 179us (2615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117615.441987:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789117615.443852:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e4ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593100288:0@lo:101: 00010000:00010000:0.0:1789117615.443883:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962baea9aa00/0xaa253ed19be1f965 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f96c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.443895:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962baea9aa00/0xaa253ed19be1f965 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f96c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117615.443999:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e4ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593100416:0@lo:501: 00000100:00100000:0.0:1789117615.444122:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117615.444154:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf839900 going to sleep for 11 seconds 00000100:00100000:3.0:1789117615.444902:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593100416 00000100:00100000:3.0:1789117615.444911:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593100416 00000100:00100000:3.0:1789117615.444983:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789117615.444993:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593100416:12345-0@lo:501: 00000100:00100000:3.0:1789117615.445204:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593100416:12345-0@lo:501: Request processed in 212us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117615.445213:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789117615.445319:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e4ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593100416:0@lo:501: 00000100:00100000:2.0:1789117615.445367:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a75e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593100544:0@lo:503: 00000100:00100000:2.0:1789117615.445427:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117615.445452:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf7513c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117615.445911:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593100544 00000100:00100000:0.0:1789117615.445917:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593100544 00000100:00100000:0.0:1789117615.445962:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789117615.445971:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593100544:12345-0@lo:503: 00000100:00100000:0.0:1789117615.446119:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593100544:12345-0@lo:503: Request processed in 148us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117615.446126:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789117615.446161:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a75e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593100544:0@lo:503: 00000100:00100000:0.0:1789117615.446429:0:10361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e49e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10361:1876025593100672:0@lo:502: 00000100:00100000:0.0:1789117615.446466:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117615.446482:0:10361:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf8393c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117615.450263:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593100672 00000100:00100000:3.0:1789117615.450281:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593100672 00000100:00100000:3.0:1789117615.450361:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789117615.450372:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+17:10361:x1876025593100672:12345-0@lo:502: 00000100:00100000:3.0:1789117615.450574:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+17:10361:x1876025593100672:12345-0@lo:502: Request processed in 204us (4107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117615.450583:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789117615.450702:0:10361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e49e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10361:1876025593100672:0@lo:502: 00000020:01000000:2.0:1789117615.450739:0:10361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117615.450749:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117615.450752:0:10361:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789117615.450759:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789117615.450802:0:10361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10361:1876025593100800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117615.450851:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117615.450892:0:10361:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf7513c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117615.454241:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593100800 00000100:00100000:3.0:1789117615.454268:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593100800 00000100:00100000:3.0:1789117615.454346:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789117615.454357:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+17:10361:x1876025593100800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117615.454556:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+17:10361:x1876025593100800:12345-0@lo:502:llog_process_th.0 Request processed in 201us (3705us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117615.454564:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789117615.454683:0:10361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10361:1876025593100800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789117615.454744:0:10361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117615.454753:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117615.454755:0:10361:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789117615.454762:0:10361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1789117615.456371:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789117615.456422:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789117615.456439:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9aa00/0xaa253ed19be1f965 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f96c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.456454:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962baea9aa00/0xaa253ed19be1f965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f96c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117615.456465:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789117615.456468:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962bbf4b3000 from 48 10000000:01000000:0.0:1789117615.456471:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789117615.456512:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f973 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.456520:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f973 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.456531:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f973 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117615.456557:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593100928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789117615.456632:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117615.456675:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf839840 going to sleep for 11 seconds 00000100:00100000:0.0:1789117615.456704:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593100928 00000100:00100000:0.0:1789117615.456710:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593100928 00000100:00100000:0.0:1789117615.456754:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789117615.456763:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+17:6517:x1876025593100928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117615.456775:0:9525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117615.456786:0:9525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962baea9b600/0xaa253ed19be1f97a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f973 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.456822:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962baea9b600/0xaa253ed19be1f97a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f973 expref: 18 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.456833:0:9525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962baea9b600/0xaa253ed19be1f97a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f973 expref: 18 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.456841:0:9525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962baea9b600, rc 0) 00000100:00100000:0.0:1789117615.456878:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593100928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117615.456885:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789117615.456925:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593100928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117615.456938:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f973 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f97a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.456947:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f973 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f97a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117615.456994:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593101056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117615.457015:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117615.457364:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf839840 going to sleep for 11 seconds 00000100:00100000:0.0:1789117615.457379:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593101056 00000100:00100000:0.0:1789117615.457382:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593101056 00000100:00100000:0.0:1789117615.457406:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789117615.457411:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593101056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117615.457524:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593101056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117615.457538:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789117615.457565:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593101056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117615.457595:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593101184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117615.457632:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117615.457644:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf839840 going to sleep for 11 seconds 00000100:00100000:0.0:1789117615.457656:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593101184 00000100:00100000:0.0:1789117615.457659:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593101184 00000100:00100000:0.0:1789117615.457676:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789117615.457681:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593101184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117615.457752:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593101184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117615.457759:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789117615.457794:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593101184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117615.457965:0:10362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10362:1876025593101312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117615.457997:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117615.458014:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593101312 00000100:00100000:0.0:1789117615.458032:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593101312 00000100:00100000:0.0:1789117615.458077:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789117615.458083:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:10362:x1876025593101312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117615.458174:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:10362:x1876025593101312:12345-0@lo:502:llog_process_th.0 Request processed in 89us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117615.458180:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789117615.458207:0:10362:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf839780 going to sleep for 11 seconds 00000100:00100000:0.0:1789117615.458218:0:10362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10362:1876025593101312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117615.458268:0:10362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10362:1876025593101440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117615.458301:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117615.458319:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593101440 00000100:00100000:0.0:1789117615.458322:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593101440 00000100:00100000:0.0:1789117615.458342:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789117615.458348:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:10362:x1876025593101440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117615.458401:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:10362:x1876025593101440:12345-0@lo:502:llog_process_th.0 Request processed in 53us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117615.458408:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789117615.458434:0:10362:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf839780 going to sleep for 11 seconds 00000100:00100000:0.0:1789117615.458445:0:10362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10362:1876025593101440:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789117615.458461:0:10362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789117615.458511:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789117615.458525:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789117615.458532:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f973 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f97a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.458541:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f973 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f97a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117615.458550:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789117615.458553:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789117615.458556:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789117615.458577:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9be00/0xaa253ed19be1f981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.458585:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962baea9be00/0xaa253ed19be1f981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.458599:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962baea9be00/0xaa253ed19be1f981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117615.458612:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593101568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789117615.458636:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117615.458649:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117615.458660:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593101568 00000100:00100000:0.0:1789117615.458663:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593101568 00000100:00100000:0.0:1789117615.458683:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789117615.458689:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+18:6517:x1876025593101568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117615.458696:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117615.458706:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962baea9a200/0xaa253ed19be1f988 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f981 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.458725:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962baea9a200/0xaa253ed19be1f988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f981 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.458734:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962baea9a200/0xaa253ed19be1f988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f981 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.458742:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962baea9a200, rc 0) 00000100:00100000:0.0:1789117615.458768:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+19:6517:x1876025593101568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117615.458774:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789117615.458801:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593101568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117615.458810:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962baea9be00/0xaa253ed19be1f981 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f988 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.458825:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962baea9be00/0xaa253ed19be1f981 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f988 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117615.458866:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593101696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117615.458890:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117615.458902:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117615.458913:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593101696 00000100:00100000:0.0:1789117615.458916:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593101696 00000100:00100000:0.0:1789117615.458935:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789117615.458941:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+19:6517:x1876025593101696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117615.459021:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+19:6517:x1876025593101696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 79us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117615.459027:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789117615.459077:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593101696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117615.459100:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593101824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117615.459145:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117615.459158:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117615.459170:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593101824 00000100:00100000:0.0:1789117615.459172:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593101824 00000100:00100000:0.0:1789117615.459192:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789117615.459197:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+19:6517:x1876025593101824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117615.459261:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+19:6517:x1876025593101824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117615.459268:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789117615.459308:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593101824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117615.472618:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10363:1876025593101952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117615.472717:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117615.472778:0:10363:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e46d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789117615.477941:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593101952 00000100:00100000:1.0:1789117615.477959:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593101952 00000100:00100000:1.0:1789117615.478049:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789117615.478075:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+19:10363:x1876025593101952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117615.478258:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+19:10363:x1876025593101952:12345-0@lo:502:llog_process_th.0 Request processed in 186us (5540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117615.478266:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789117615.479013:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10363:1876025593101952:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789117615.479047:0:10363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117615.479080:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117615.479083:0:10363:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789117615.479090:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789117615.479139:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10363:1876025593102080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117615.479190:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117615.479235:0:10363:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e46d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789117615.479549:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593102080 00000100:00100000:0.0:1789117615.479555:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593102080 00000100:00100000:0.0:1789117615.479605:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789117615.479614:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+19:10363:x1876025593102080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117615.479730:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+19:10363:x1876025593102080:12345-0@lo:502:llog_process_th.0 Request processed in 118us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117615.479738:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789117615.482889:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10363:1876025593102080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789117615.482952:0:10363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117615.482966:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117615.482969:0:10363:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789117615.482976:0:10363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1789117615.483094:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1789117615.483127:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789117615.483139:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9be00/0xaa253ed19be1f981 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f988 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.483150:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962baea9be00/0xaa253ed19be1f981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f988 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117615.483161:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789117615.483163:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962bbcf27000 from 48 10000000:01000000:0.0:1789117615.483166:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789117615.483207:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9a600/0xaa253ed19be1f98f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.483215:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962baea9a600/0xaa253ed19be1f98f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.483225:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962baea9a600/0xaa253ed19be1f98f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117615.483254:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593102208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789117615.483455:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117615.483501:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4f600 going to sleep for 11 seconds 00000100:00100000:1.0:1789117615.484154:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593102208 00000100:00100000:1.0:1789117615.484162:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593102208 00000100:00100000:0.0:1789117615.484518:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789117615.484529:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba1a92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+19:6517:x1876025593102208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117615.484545:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117615.484564:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962baea9a400/0xaa253ed19be1f996 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f98f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.484607:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962baea9a400/0xaa253ed19be1f996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f98f expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.484617:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962baea9a400/0xaa253ed19be1f996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f98f expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.484625:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962baea9a400, rc 0) 00000100:00100000:0.0:1789117615.484688:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba1a92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+20:6517:x1876025593102208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117615.484694:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789117615.486228:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593102208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117615.486253:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962baea9a600/0xaa253ed19be1f98f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f996 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117615.486264:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962baea9a600/0xaa253ed19be1f98f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f996 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117615.486351:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593102336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117615.486401:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117615.486440:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf7519c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117615.486460:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593102336 00000100:00100000:0.0:1789117615.486468:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593102336 00000100:00100000:0.0:1789117615.486512:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789117615.486521:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba1a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+20:6517:x1876025593102336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117615.486658:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba1a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+20:6517:x1876025593102336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117615.486666:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789117615.487789:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593102336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117615.487838:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593102464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117615.487899:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117615.487937:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf7519c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117615.488152:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593102464 00000100:00100000:0.0:1789117615.488158:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593102464 00000100:00100000:0.0:1789117615.488204:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789117615.488212:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba1a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+20:6517:x1876025593102464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117615.488325:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba1a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+20:6517:x1876025593102464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117615.488333:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789117615.488355:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593102464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117615.488951:0:10364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e48b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10364:1876025593102592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117615.489000:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117615.489037:0:10364:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117615.489048:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593102592 00000100:00100000:2.0:1789117615.489085:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593102592 00000100:00100000:2.0:1789117615.489127:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789117615.489136:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90434450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+20:10364:x1876025593102592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117615.489245:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90434450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+20:10364:x1876025593102592:12345-0@lo:502:llog_process_th.0 Request processed in 111us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117615.489263:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789117615.489555:0:10364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e48b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10364:1876025593102592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117615.489609:0:10364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e48b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10364:1876025593102720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117615.489645:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117615.489676:0:10364:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117615.491502:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593102720 00000100:00100000:2.0:1789117615.491515:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593102720 00000100:00100000:2.0:1789117615.491577:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789117615.491587:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+20:10364:x1876025593102720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117615.491742:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+20:10364:x1876025593102720:12345-0@lo:502:llog_process_th.0 Request processed in 156us (2095us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117615.491750:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789117615.491837:0:10364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e48b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10364:1876025593102720:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789117615.491868:0:10364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789117615.492030:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789117615.492118:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789117615.492128:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9a600/0xaa253ed19be1f98f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f996 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117615.492139:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962baea9a600/0xaa253ed19be1f98f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f996 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117615.492159:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789117615.492161:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1789117615.492164:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789117615.492193:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70c400/0xaa253ed19be1f99d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117615.492200:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962bbf70c400/0xaa253ed19be1f99d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117615.492209:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962bbf70c400/0xaa253ed19be1f99d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117615.492230:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593102848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789117615.492262:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117615.492297:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f2e540 going to sleep for 11 seconds 00000100:00100000:3.0:1789117615.492351:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593102848 00000100:00100000:3.0:1789117615.492355:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593102848 00000100:00100000:3.0:1789117615.492397:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789117615.492405:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+20:6517:x1876025593102848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117615.492414:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117615.492425:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d93e00/0xaa253ed19be1f9a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f99d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117615.492463:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d93e00/0xaa253ed19be1f9a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f99d expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117615.492473:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d93e00/0xaa253ed19be1f9a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f99d expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117615.492481:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93e00, rc 0) 00000100:00100000:3.0:1789117615.492517:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593102848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117615.492524:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789117615.492702:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593102848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117615.492714:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962bbf70c400/0xaa253ed19be1f99d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f9a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117615.492723:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962bbf70c400/0xaa253ed19be1f99d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f9a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117615.492770:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593102976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117615.492795:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117615.492815:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f2e540 going to sleep for 11 seconds 00000100:00100000:2.0:1789117615.493748:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593102976 00000100:00100000:2.0:1789117615.493756:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593102976 00000100:00100000:2.0:1789117615.493793:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789117615.493800:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90434050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593102976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117615.493948:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90434050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593102976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117615.493956:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789117615.494600:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593102976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117615.494647:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593103104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117615.494708:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117615.494739:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f2e540 going to sleep for 11 seconds 00000100:00100000:2.0:1789117615.494901:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593103104 00000100:00100000:2.0:1789117615.494906:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593103104 00000100:00100000:2.0:1789117615.495011:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789117615.495031:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90436450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593103104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117615.495143:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90436450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593103104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117615.495150:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789117615.503811:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593103104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117615.504833:0:10365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10365:1876025593103232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117615.504911:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117615.504941:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593103232 00000100:00100000:0.0:1789117615.504949:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593103232 00000100:00100000:3.0:1789117615.504965:0:10365:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e463c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117615.504991:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789117615.505000:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90436050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:10365:x1876025593103232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117615.505154:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90436050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:10365:x1876025593103232:12345-0@lo:502:llog_process_th.0 Request processed in 154us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117615.505162:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789117615.505289:0:10365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10365:1876025593103232:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789117615.505314:0:10365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117615.505322:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117615.505324:0:10365:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789117615.505329:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789117615.505359:0:10365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10365:1876025593103360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117615.505391:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117615.505447:0:10365:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e463c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117615.511764:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593103360 00000100:00100000:2.0:1789117615.511788:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593103360 00000100:00100000:3.0:1789117615.511961:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789117615.511974:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90434c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+21:10365:x1876025593103360:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117615.512226:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90434c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+21:10365:x1876025593103360:12345-0@lo:502:llog_process_th.0 Request processed in 254us (6832us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117615.512234:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789117615.512308:0:10365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10365:1876025593103360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789117615.512350:0:10365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117615.512361:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117615.512365:0:10365:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789117615.512371:0:10365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1789117615.512699:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1789117615.512727:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789117615.512738:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70c400/0xaa253ed19be1f99d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f9a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.512763:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962bbf70c400/0xaa253ed19be1f99d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f9a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117615.512776:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789117615.512778:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962b9832f800 from 48 10000000:01000000:0.0:1789117615.512781:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789117615.512814:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be1f9ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.512821:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be1f9ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.512829:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be1f9ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117615.512851:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e48b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593103488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789117615.512890:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117615.512931:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117615.513026:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593103488 00000100:00100000:2.0:1789117615.513032:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593103488 00000100:00100000:2.0:1789117615.513086:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789117615.513094:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593103488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117615.513115:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117615.513127:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b89b68800/0xaa253ed19be1f9b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f9ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117615.513150:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b89b68800/0xaa253ed19be1f9b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f9ab expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117615.513160:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b89b68800/0xaa253ed19be1f9b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f9ab expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117615.513168:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b68800, rc 0) 00000100:00100000:2.0:1789117615.513207:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593103488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117615.513213:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789117615.514766:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e48b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593103488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117615.514787:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be1f9ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f9b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117615.514797:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be1f9ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f9b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117615.514865:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e48b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593103616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117615.515919:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117615.515971:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117615.515994:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593103616 00000100:00100000:0.0:1789117615.516001:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593103616 00000100:00100000:0.0:1789117615.516047:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789117615.516078:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90437c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593103616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117615.516233:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90437c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593103616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117615.516241:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789117615.516296:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e48b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593103616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117615.516340:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e48b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593103744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117615.516397:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117615.516418:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117615.518481:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593103744 00000100:00100000:3.0:1789117615.518495:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593103744 00000100:00100000:3.0:1789117615.518561:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789117615.518570:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593103744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117615.518729:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593103744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (2332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117615.518745:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789117615.518808:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e48b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593103744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117615.520337:0:10366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e4b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10366:1876025593103872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117615.520414:0:10366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117615.520467:0:10366:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf839600 going to sleep for 11 seconds 00000100:00100000:1.0:1789117615.520794:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593103872 00000100:00100000:1.0:1789117615.520801:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593103872 00000100:00100000:1.0:1789117615.520848:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789117615.520857:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90437050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+22:10366:x1876025593103872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117615.520984:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90437050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+22:10366:x1876025593103872:12345-0@lo:502:llog_process_th.0 Request processed in 128us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117615.520991:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789117615.521160:0:10366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e4b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10366:1876025593103872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117615.521209:0:10366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a770c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10366:1876025593104000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117615.521243:0:10366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117615.521265:0:10366:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf751840 going to sleep for 11 seconds 00000100:00100000:3.0:1789117615.521588:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593104000 00000100:00100000:3.0:1789117615.521594:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593104000 00000100:00100000:3.0:1789117615.521624:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789117615.521631:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+22:10366:x1876025593104000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117615.521713:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+22:10366:x1876025593104000:12345-0@lo:502:llog_process_th.0 Request processed in 82us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117615.521720:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789117615.521895:0:10366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a770c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10366:1876025593104000:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789117615.521921:0:10366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789117615.521994:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789117615.522011:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789117615.522031:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be1f9ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f9b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117615.522074:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be1f9ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f9b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117615.522086:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789117615.522089:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1789117615.522092:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789117615.522129:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b89b68400/0xaa253ed19be1f9b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117615.522136:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b89b68400/0xaa253ed19be1f9b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117615.522144:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b89b68400/0xaa253ed19be1f9b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117615.522159:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a770c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593104128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789117615.522186:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117615.522200:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf751840 going to sleep for 11 seconds 00000100:00100000:2.0:1789117615.522216:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593104128 00000100:00100000:2.0:1789117615.522219:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593104128 00000100:00100000:2.0:1789117615.522251:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789117615.522257:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90434850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593104128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117615.522266:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117615.522277:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b89b68e00/0xaa253ed19be1f9c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f9b9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117615.522297:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b89b68e00/0xaa253ed19be1f9c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f9b9 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117615.522317:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b89b68e00/0xaa253ed19be1f9c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f9b9 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117615.522326:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b68e00, rc 0) 00000100:00100000:2.0:1789117615.522355:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90434850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593104128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117615.522361:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789117615.522389:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a770c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593104128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117615.522400:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b89b68400/0xaa253ed19be1f9b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f9c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117615.522408:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b89b68400/0xaa253ed19be1f9b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f9c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117615.522456:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a770c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593104256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117615.523175:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117615.523199:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf751840 going to sleep for 11 seconds 00000100:00100000:0.0:1789117615.524507:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593104256 00000100:00100000:0.0:1789117615.524521:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593104256 00000100:00100000:0.0:1789117615.524583:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789117615.524593:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593104256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117615.524778:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593104256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117615.524786:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789117615.524953:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a770c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593104256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117615.525021:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593104384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117615.525115:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117615.525137:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593104384 00000100:00100000:2.0:1789117615.525143:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593104384 00000100:00100000:1.0:1789117615.525149:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f2ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1789117615.525171:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789117615.525178:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593104384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117615.525262:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593104384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117615.525269:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789117615.525279:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593104384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117615.525803:0:10368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbe940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10368:1876025593104512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117615.525836:0:10368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117615.525865:0:10368:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f2e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789117615.525915:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593104512 00000100:00100000:2.0:1789117615.525919:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593104512 00000100:00100000:2.0:1789117615.525952:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789117615.525959:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+23:10368:x1876025593104512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117615.526024:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+23:10368:x1876025593104512:12345-0@lo:502:llog_process_th.0 Request processed in 65us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117615.526031:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789117615.526175:0:10368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbe940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10368:1876025593104512:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789117615.526205:0:10368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789117615.526213:0:10368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117615.526215:0:10368:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789117615.526219:0:10368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789117615.526235:0:10368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbe940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10368:1876025593104640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117615.526262:0:10368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117615.526293:0:10368:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f2e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789117615.526471:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593104640 00000100:00100000:2.0:1789117615.526476:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593104640 00000100:00100000:2.0:1789117615.526504:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789117615.526510:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+23:10368:x1876025593104640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117615.526565:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+23:10368:x1876025593104640:12345-0@lo:502:llog_process_th.0 Request processed in 55us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117615.526572:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789117615.526716:0:10368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbe940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10368:1876025593104640:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789117615.526735:0:10368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117615.526738:0:10368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117615.526740:0:10368:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789117615.526744:0:10368:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1789117615.526948:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1789117615.526971:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789117615.526980:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b89b68400/0xaa253ed19be1f9b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f9c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117615.526991:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b89b68400/0xaa253ed19be1f9b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f9c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117615.527000:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789117615.527002:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff962b88028000 from 1 10000000:01000000:2.0:1789117615.527005:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789117615.527029:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b89b68200/0xaa253ed19be1f9c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117615.527036:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b89b68200/0xaa253ed19be1f9c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117615.527091:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b89b68200/0xaa253ed19be1f9c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117615.527118:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593104768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789117615.527150:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117615.527169:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf7513c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117615.527221:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593104768 00000100:00100000:1.0:1789117615.527226:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593104768 00000100:00100000:1.0:1789117615.527256:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789117615.527262:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83ada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593104768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117615.527271:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117615.527282:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbf70dc00/0xaa253ed19be1f9ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f9c7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117615.527302:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbf70dc00/0xaa253ed19be1f9ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f9c7 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117615.527311:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbf70dc00/0xaa253ed19be1f9ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f9c7 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117615.527320:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70dc00, rc 0) 00000100:00100000:1.0:1789117615.527348:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83ada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593104768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117615.527355:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789117615.528132:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593104768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117615.528149:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b89b68200/0xaa253ed19be1f9c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f9ce expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117615.528158:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b89b68200/0xaa253ed19be1f9c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f9ce expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117615.528217:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593104896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117615.528249:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117615.528269:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf7513c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117615.528287:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593104896 00000100:00100000:2.0:1789117615.528291:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593104896 00000100:00100000:2.0:1789117615.528326:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789117615.528333:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b904e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593104896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117615.528412:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b904e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593104896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 79us (162us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789117615.528419:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789117615.529134:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593104896:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789117615.529171:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789117615.529193:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b89b68200/0xaa253ed19be1f9c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f9ce expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117615.529202:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b89b68200/0xaa253ed19be1f9c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f9ce expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.109999:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789117616.348863:0:10397:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea829e190 20000000:00000080:2.0:1789117616.348880:0:10397:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff962a86de3000 uarg=0000000000000000 20000000:01000000:2.0:1789117616.348921:0:10397:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789117616.348926:0:10397:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789117616.348930:0:10397:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789117616.351713:0:10398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1789117616.353944:0:10397:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1789117616.365776:0:10397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1789117616.365818:0:10397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1789117616.365834:0:10397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1789117616.365850:0:10397:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789117616.365869:0:10397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962b89b68c00/0xaa253ed19be1f9d5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117616.365887:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962bc20f4600/0xaa253ed19be1f671 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f66a expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117616.365895:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962baea9bc00/0xaa253ed19be1f67f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f678 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117616.365901:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962bc20f4c00/0xaa253ed19be1f6d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f6cc expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117616.365908:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b89b69600/0xaa253ed19be1f7f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f7f2 expref: 23 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117616.365935:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b89b69000/0xaa253ed19be1f911 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecf9 expref: 9 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117616.365942:0:10397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962b89b68c00/0xaa253ed19be1f9d5 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117616.365984:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b89b69000/0xaa253ed19be1f911 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecf9 expref: 9 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117616.366011:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962b89b69000/0xaa253ed19be1f911 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecf9 expref: 9 pid: 9525 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117616.366026:0:10397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a761c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1876025593105024:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789117616.366267:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b89b69600/0xaa253ed19be1f7f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f7f2 expref: 23 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117616.366275:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962b89b69600/0xaa253ed19be1f7f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f7f2 expref: 23 pid: 9525 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117616.366284:0:10397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1876025593105152:0@lo:104: 00000100:00100000:2.0:1789117616.366324:0:10397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789117616.366621:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962bc20f4c00/0xaa253ed19be1f6d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f6cc expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117616.366629:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962bc20f4c00/0xaa253ed19be1f6d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f6cc expref: 23 pid: 6514 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117616.366637:0:10397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a770c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1876025593105280:0@lo:104: 00000100:00100000:2.0:1789117616.366671:0:10397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789117616.366703:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962baea9bc00/0xaa253ed19be1f67f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f678 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117616.366711:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962baea9bc00/0xaa253ed19be1f67f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f678 expref: 23 pid: 6512 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117616.366718:0:10397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1876025593105408:0@lo:104: 00010000:00010000:2.0:1789117616.366741:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962bc20f4600/0xaa253ed19be1f671 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f66a expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117616.366748:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962bc20f4600/0xaa253ed19be1f671 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f66a expref: 23 pid: 6513 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117616.366756:0:10397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a75e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1876025593105536:0@lo:104: 00000100:00100000:2.0:1789117616.366773:0:10397:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf7513c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117616.366831:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789117616.366849:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117616.366872:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117616.366881:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593105152 00000100:00100000:0.0:1789117616.366888:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593105152 00000100:00100000:0.0:1789117616.366924:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593105280 00000100:00100000:0.0:1789117616.366927:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593105280 00000100:00100000:0.0:1789117616.366935:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593105408 00000100:00100000:0.0:1789117616.366937:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593105408 00000100:00100000:0.0:1789117616.366945:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593105536 00000100:00100000:0.0:1789117616.366947:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593105536 00000100:00100000:0.0:1789117616.366957:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789117616.366964:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a75a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+6:10397:x1876025593105152:12345-0@lo:104: 00010000:00010000:0.0:1789117616.366979:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f7f9 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.367038:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789117616.367044:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a75a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+6:10397:x1876025593105152:12345-0@lo:104: Request processed in 80us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117616.367075:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789117616.367107:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789117616.367115:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a3e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+5:10397:x1876025593105280:12345-0@lo:104: 00010000:00010000:0.0:1789117616.367123:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b813dba00/0xaa253ed19be1f6cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f6d3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.367156:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789117616.367161:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a3e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+5:10397:x1876025593105280:12345-0@lo:104: Request processed in 48us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117616.367167:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789117616.367196:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789117616.367202:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e48f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+4:10397:x1876025593105408:12345-0@lo:104: 00010000:00010000:0.0:1789117616.367215:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b89b68600/0xaa253ed19be1f678 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f67f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.367246:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789117616.367251:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e48f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+4:10397:x1876025593105408:12345-0@lo:104: Request processed in 50us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117616.367257:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789117616.367268:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789117616.367274:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+3:10397:x1876025593105536:12345-0@lo:104: 00010000:00010000:0.0:1789117616.367280:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962bc20f4200/0xaa253ed19be1f66a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f671 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.367304:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789117616.367308:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+3:10397:x1876025593105536:12345-0@lo:104: Request processed in 36us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117616.367314:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1789117616.367345:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789117616.367351:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f7f9 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.367358:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9ba00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117616.367361:0:9523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f7f9 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.367370:0:9523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f7f9 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117616.367377:0:9523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f7f9 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117616.367389:0:9523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789117616.367422:0:9523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f7f9 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.367428:0:9523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117616.367458:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7f2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f7f9 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.367466:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f7f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f7f9 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.367478:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789117616.367481:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b813dba00/0xaa253ed19be1f6cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f6d3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.367486:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dba00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117616.367489:0:9523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b813dba00/0xaa253ed19be1f6cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f6d3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.367496:0:9523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b813dba00/0xaa253ed19be1f6cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f6d3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117616.367501:0:9523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b813dba00/0xaa253ed19be1f6cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f6d3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117616.367506:0:9523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789117616.367518:0:9523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b813dba00/0xaa253ed19be1f6cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f6d3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.367524:0:9523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117616.367551:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b813dba00/0xaa253ed19be1f6cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f6d3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.367558:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b813dba00/0xaa253ed19be1f6cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f6d3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.367568:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789117616.367571:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b89b68600/0xaa253ed19be1f678 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f67f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.367577:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b68600 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117616.367580:0:9523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b89b68600/0xaa253ed19be1f678 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f67f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.367587:0:9523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b89b68600/0xaa253ed19be1f678 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f67f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117616.367594:0:9523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b89b68600/0xaa253ed19be1f678 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f67f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117616.367599:0:9523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789117616.367613:0:9523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b89b68600/0xaa253ed19be1f678 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f67f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.367618:0:9523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117616.367625:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b89b68600/0xaa253ed19be1f678 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f67f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.367630:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b89b68600/0xaa253ed19be1f678 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f67f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.367636:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117616.367644:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bc20f4200/0xaa253ed19be1f66a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f671 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.367650:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4200 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117616.367652:0:9523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bc20f4200/0xaa253ed19be1f66a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f671 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.367658:0:9523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bc20f4200/0xaa253ed19be1f66a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f671 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117616.367663:0:9523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bc20f4200/0xaa253ed19be1f66a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f671 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117616.367668:0:9523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789117616.367679:0:9523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962bc20f4200/0xaa253ed19be1f66a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f671 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.367684:0:9523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117616.367690:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bc20f4200/0xaa253ed19be1f66a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f671 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.367695:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bc20f4200/0xaa253ed19be1f66a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f671 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.367708:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117616.367710:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117616.367712:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117616.367719:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117616.367724:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117616.367745:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593105664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789117616.367775:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117616.367802:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789117616.367807:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593106048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789117616.367828:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117616.367851:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593105792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789117616.367871:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117616.367887:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789117616.367892:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593105920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789117616.367912:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117616.367940:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593105664 00000100:00100000:0.0:1789117616.367944:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593105664 00010000:00010000:0.0:1789117616.367964:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b89b69600/0xaa253ed19be1f7f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f7f2 expref: 24 pid: 9525 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117616.367984:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593106048 00000100:00100000:0.0:1789117616.367987:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593106048 00010000:00010000:0.0:1789117616.367996:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962bc20f4600/0xaa253ed19be1f671 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f66a expref: 25 pid: 6513 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117616.368006:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593105792 00000100:00100000:0.0:1789117616.368008:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593105792 00010000:00010000:0.0:1789117616.368017:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962bc20f4c00/0xaa253ed19be1f6d3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f6cc expref: 26 pid: 6514 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117616.368027:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593105920 00000100:00100000:0.0:1789117616.368030:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593105920 00010000:00010000:0.0:1789117616.368039:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962baea9bc00/0xaa253ed19be1f67f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f678 expref: 27 pid: 6512 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117616.368073:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789117616.368082:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+27:3645:x1876025593105664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789117616.368111:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117616.368116:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b89b69600/0xaa253ed19be1f7f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f7f2 expref: 27 pid: 9525 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.368127:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b89b69600/0xaa253ed19be1f7f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f7f2 expref: 27 pid: 9525 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.368142:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117616.368169:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+27:3645:x1876025593105664:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117616.368176:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789117616.368195:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789117616.368202:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e49a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+26:3645:x1876025593106048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789117616.368210:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117616.368214:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962bc20f4600/0xaa253ed19be1f671 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f66a expref: 26 pid: 6513 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.368222:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962bc20f4600/0xaa253ed19be1f671 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f66a expref: 26 pid: 6513 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.368232:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117616.368250:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e49a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+26:3645:x1876025593106048:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117616.368256:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789117616.368267:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789117616.368272:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+25:3646:x1876025593105792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789117616.368279:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117616.368283:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962bc20f4c00/0xaa253ed19be1f6d3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f6cc expref: 25 pid: 6514 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.368296:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962bc20f4c00/0xaa253ed19be1f6d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f6cc expref: 25 pid: 6514 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.368306:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117616.368331:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+25:3646:x1876025593105792:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117616.368338:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789117616.368349:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789117616.368355:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb0939050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3646:x1876025593105920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789117616.368362:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117616.368366:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962baea9bc00/0xaa253ed19be1f67f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f678 expref: 24 pid: 6512 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.368373:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962baea9bc00/0xaa253ed19be1f67f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f678 expref: 24 pid: 6512 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117616.368381:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117616.368399:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb0939050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3646:x1876025593105920:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117616.368405:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789117616.368464:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593105920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789117616.368474:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593105792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789117616.368497:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593106048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789117616.368504:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593105664:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789117616.368959:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b89b69600/0xaa253ed19be1f7f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f7f2 expref: 23 pid: 9525 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117616.368973:0:10397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1876025593105152:0@lo:104: 00010000:00010000:2.0:1789117616.368984:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bc20f4c00/0xaa253ed19be1f6d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f6cc expref: 22 pid: 6514 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117616.369003:0:10397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a770c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1876025593105280:0@lo:104: 00010000:00010000:2.0:1789117616.369016:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962baea9bc00/0xaa253ed19be1f67f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f678 expref: 21 pid: 6512 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117616.369023:0:10397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1876025593105408:0@lo:104: 00010000:00010000:2.0:1789117616.369032:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bc20f4600/0xaa253ed19be1f671 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f66a expref: 20 pid: 6513 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117616.369097:0:10397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a75e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1876025593105536:0@lo:104: 00000100:00100000:0.0:1789117616.376118:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117616.376305:0:10397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a761c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1876025593105024:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789117616.376359:0:10397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962b89b68c00/0xaa253ed19be1f9d5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117616.376804:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572071808 00000100:00100000:3.0:1789117616.376811:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572071808 00010000:00010000:3.0:1789117616.376851:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b89b69000/0xaa253ed19be1f911 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecf9 expref: 10 pid: 9525 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117616.376891:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:3.0:1789117616.376901:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2406:x1876025572071808:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117616.376918:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117616.376925:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b89b69000/0xaa253ed19be1f911 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecf9 expref: 10 pid: 9525 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117616.376936:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b89b69000/0xaa253ed19be1f911 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecf9 expref: 10 pid: 9525 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117616.376957:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b89b69000/0xaa253ed19be1f911 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecf9 expref: 10 pid: 9525 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117616.376972:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962b89b68c00/0xaa253ed19be1f9d5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117616.377003:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b89b68c00/0xaa253ed19be1f9d5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117616.377021:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962b89b68c00/0xaa253ed19be1f9d5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117616.377028:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962b89b68c00/0xaa253ed19be1f9d5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117616.377034:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962b89b68c00/0xaa253ed19be1f9d5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117616.377040:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962b89b68c00/0xaa253ed19be1f9d5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117616.377046:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b68c00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789117616.377076:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962b89b68c00/0xaa253ed19be1f9d5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117616.377096:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962b89b68c00/0xaa253ed19be1f9d5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117616.377113:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962b89b68c00/0xaa253ed19be1f9d5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117616.377122:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117616.377248:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b51ebb8-b89b-4376-982e-072902ca33a8+9:2406:x1876025572071808:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 348us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117616.377256:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 39 00010000:00010000:2.0:1789117616.377453:0:10397:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962b89b68c00/0xaa253ed19be1f9d5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117616.377462:0:10397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962b89b68c00/0xaa253ed19be1f9d5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117616.377468:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b89b68c00/0xaa253ed19be1f9d5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117617.000298:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789117617.000322:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593106176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117617.000396:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117617.000488:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593106176 00000100:00100000:0.0:1789117617.000497:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593106176 00000100:00100000:0.0:1789117617.000562:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789117617.000572:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593106176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789117617.000603:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117617.000646:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593106176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117617.000653:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1789117617.000671:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789117617.000696:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e49e00 x1876025593106176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117617.000714:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593106176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117617.000857:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789117617.000866:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593106304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789117617.000896:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117617.000927:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593106304 00000100:00100000:2.0:1789117617.000930:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593106304 00000100:00100000:2.0:1789117617.000960:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789117617.000966:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593106304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789117617.000976:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117617.001004:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593106304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117617.001009:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789117617.001025:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789117617.001041:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a77c00 x1876025593106304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117617.001115:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593106304:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789117617.125324:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789117617.445156:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789117617.445168:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962b872f5000 from 4 10000000:01000000:0.0:1789117617.445175:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789117617.445255:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f9dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117617.445269:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f9dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117617.445282:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f9dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117617.445314:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e49e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593106432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789117617.445440:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117617.445507:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbd0c70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117617.446519:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593106432 00000100:00100000:3.0:1789117617.446544:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593106432 00000100:00100000:3.0:1789117617.446625:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789117617.446647:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b904eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+20:6517:x1876025593106432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117617.446666:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117617.446687:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d92000/0xaa253ed19be1f9e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f9dc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117617.446720:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d92000/0xaa253ed19be1f9e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f9dc expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117617.446733:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d92000/0xaa253ed19be1f9e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f9dc expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117617.446745:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92000, rc 0) 00000100:00100000:3.0:1789117617.446809:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b904eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593106432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117617.446817:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789117617.447097:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e49e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593106432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117617.447116:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f9dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f9e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117617.447126:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f9dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f9e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117617.447221:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e49e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593106560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117617.447264:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117617.447304:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbd0c70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117617.454703:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593106560 00000100:00100000:3.0:1789117617.454724:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593106560 00000100:00100000:3.0:1789117617.454791:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789117617.454804:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b904eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593106560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117617.455090:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b904eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593106560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 287us (7825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117617.455099:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789117617.455177:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e49e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593106560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117617.455256:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593106688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117617.455317:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117617.455363:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e46c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117617.455380:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593106688 00000100:00100000:3.0:1789117617.455384:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593106688 00000100:00100000:3.0:1789117617.455425:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789117617.455433:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b904e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593106688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117617.455526:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b904e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593106688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117617.455533:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789117617.455644:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593106688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117617.455908:0:10416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10416:1876025593106816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117617.455945:0:10416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117617.455965:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593106816 00000100:00100000:3.0:1789117617.455969:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593106816 00000100:00100000:3.0:1789117617.455992:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789117617.455998:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+21:10416:x1876025593106816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117617.456102:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+21:10416:x1876025593106816:12345-0@lo:502:llog_process_th.0 Request processed in 103us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117617.456109:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789117617.456137:0:10416:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e46a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789117617.456149:0:10416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10416:1876025593106816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789117617.456171:0:10416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117617.456183:0:10416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117617.456186:0:10416:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789117617.456193:0:10416:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962b872f5000 00000020:00000080:3.0:1789117617.456195:0:10416:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789117617.461411:0:10416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10416:1876025593106944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117617.461564:0:10416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117617.461740:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593106944 00000100:00100000:1.0:1789117617.461749:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593106944 00000100:00100000:1.0:1789117617.461818:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789117617.461831:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+21:10416:x1876025593106944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117617.461991:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+21:10416:x1876025593106944:12345-0@lo:502:llog_process_th.0 Request processed in 162us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117617.462008:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789117617.462322:0:10416:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b89ad8840 going to sleep for 11 seconds 00000100:00100000:1.0:1789117617.462417:0:10416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10416:1876025593106944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789117617.462457:0:10416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117617.462468:0:10416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117617.462470:0:10416:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789117617.462476:0:10416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789117617.462835:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789117617.462861:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789117617.462875:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f9dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f9e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117617.462887:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f9dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f9e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117617.462900:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789117617.462904:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962bbf4b3000 from 4 10000000:01000000:2.0:1789117617.462907:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789117617.462946:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b89b69600/0xaa253ed19be1f9ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117617.462955:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b89b69600/0xaa253ed19be1f9ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117617.462965:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b89b69600/0xaa253ed19be1f9ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117617.462988:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a75e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593107072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789117617.463034:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117617.463110:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8168e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789117617.463509:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593107072 00000100:00100000:1.0:1789117617.463516:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593107072 00000100:00100000:1.0:1789117617.463573:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789117617.463583:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593107072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117617.463598:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117617.463614:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbf70ca00/0xaa253ed19be1f9f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f9ea expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117617.464189:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbf70ca00/0xaa253ed19be1f9f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f9ea expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117617.464215:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbf70ca00/0xaa253ed19be1f9f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f9ea expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117617.464226:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70ca00, rc 0) 00000100:00100000:1.0:1789117617.464297:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593107072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 716us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117617.464304:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789117617.464538:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a75e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593107072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117617.464585:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b89b69600/0xaa253ed19be1f9ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f9f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117617.464597:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b89b69600/0xaa253ed19be1f9ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f9f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117617.464699:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a75e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593107200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117617.464733:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117617.464767:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8168e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789117617.464996:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593107200 00000100:00100000:1.0:1789117617.465002:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593107200 00000100:00100000:1.0:1789117617.465047:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789117617.465095:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593107200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117617.465258:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593107200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 166us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117617.465265:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789117617.465299:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a75e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593107200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117617.465334:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593107328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117617.465382:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117617.465542:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c14480 going to sleep for 11 seconds 00000100:00100000:1.0:1789117617.465618:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593107328 00000100:00100000:1.0:1789117617.465622:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593107328 00000100:00100000:1.0:1789117617.468944:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789117617.468973:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593107328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117617.469243:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593107328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 283us (3859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117617.469251:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789117617.477917:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593107328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117617.488957:0:10417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10417:1876025593107456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117617.489112:0:10417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117617.489177:0:10417:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e46a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789117617.491351:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593107456 00000100:00100000:1.0:1789117617.491366:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593107456 00000100:00100000:1.0:1789117617.491478:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789117617.491489:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+22:10417:x1876025593107456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117617.491846:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+22:10417:x1876025593107456:12345-0@lo:502:llog_process_th.0 Request processed in 358us (2734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117617.491855:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789117617.492374:0:10417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10417:1876025593107456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789117617.492433:0:10417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117617.492447:0:10417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117617.492450:0:10417:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789117617.492458:0:10417:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962bbf4b3000 00000020:00000080:3.0:1789117617.492461:0:10417:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789117617.492589:0:10417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10417:1876025593107584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117617.492786:0:10417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117617.492825:0:10417:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e46a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789117617.492851:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593107584 00000100:00100000:3.0:1789117617.492855:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593107584 00000100:00100000:3.0:1789117617.492891:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789117617.492898:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+22:10417:x1876025593107584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117617.492983:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+22:10417:x1876025593107584:12345-0@lo:502:llog_process_th.0 Request processed in 84us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117617.492990:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789117617.493030:0:10417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10417:1876025593107584:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789117617.493050:0:10417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117617.493082:0:10417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117617.493084:0:10417:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789117617.493088:0:10417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789117617.493828:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789117617.493860:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789117617.493874:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b89b69600/0xaa253ed19be1f9ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f9f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117617.493887:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b89b69600/0xaa253ed19be1f9ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f9f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117617.493901:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789117617.493904:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962bbcf27000 from 4 10000000:01000000:0.0:1789117617.493907:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789117617.493945:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9bc00/0xaa253ed19be1f9f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117617.493955:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962baea9bc00/0xaa253ed19be1f9f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117617.493973:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962baea9bc00/0xaa253ed19be1f9f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117617.493994:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593107712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789117617.494039:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117617.494100:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbd0c73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117617.497085:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593107712 00000100:00100000:0.0:1789117617.497103:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593107712 00000100:00100000:0.0:1789117617.497191:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789117617.501871:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593107712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117617.501905:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117617.501935:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962baea9b400/0xaa253ed19be1f9ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1f9f8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117617.501982:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962baea9b400/0xaa253ed19be1f9ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1f9f8 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117617.501997:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962baea9b400/0xaa253ed19be1f9ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f9f8 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117617.502009:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962baea9b400, rc 0) 00000100:00100000:0.0:1789117617.502173:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593107712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2973us (8132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117617.502184:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789117617.505111:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593107712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117617.505165:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962baea9bc00/0xaa253ed19be1f9f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f9ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117617.505211:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962baea9bc00/0xaa253ed19be1f9f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f9ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117617.505349:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593107840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117617.506735:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117617.506798:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbd0c73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117617.507136:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593107840 00000100:00100000:3.0:1789117617.507147:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593107840 00000100:00100000:3.0:1789117617.507231:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789117617.507242:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593107840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117617.507449:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593107840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 209us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117617.507458:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789117617.509444:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117617.510739:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593107840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117617.510822:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593107968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117617.512740:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117617.512813:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbd0c73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117617.512848:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572071936 00000100:00100000:0.0:1789117617.512857:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572071936 00000100:00100000:0.0:1789117617.512937:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593107968 00000100:00100000:0.0:1789117617.512940:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593107968 00000100:00100000:0.0:1789117617.512968:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 265 00000100:00100000:0.0:1789117617.512981:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+9:6181:x1876025572071936:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117617.513006:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117617.513039:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fa06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ed3f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117617.513114:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fa06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed3f expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117617.513130:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fa06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed3f expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117617.513166:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813dba00, rc 0) 00000100:00100000:2.0:1789117617.513512:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593108096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117617.516211:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+10:6181:x1876025572071936:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 Request processed in 3210us (9310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117617.516227:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 265 00000100:00100000:0.0:1789117617.516305:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789117617.516321:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593107968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117617.521976:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117617.522889:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593107968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 6567us (10492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117617.522907:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789117617.523008:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593108096 00000100:00100000:0.0:1789117617.523019:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593108096 00000100:00100000:0.0:1789117617.523102:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789117617.523114:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593108096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789117617.523172:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789117617.523341:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593108096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 228us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117617.523348:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789117617.523396:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593107968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117617.523587:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593108096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117617.523966:0:10421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10421:1876025593108224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117617.524027:0:10421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117617.524095:0:10421:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbd0c7780 going to sleep for 11 seconds 00000100:00100000:0.0:1789117617.524109:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593108224 00000100:00100000:0.0:1789117617.524120:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593108224 00000100:00100000:0.0:1789117617.524152:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789117617.524160:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+23:10421:x1876025593108224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117617.526269:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117617.526414:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572072064 00000100:00100000:3.0:1789117617.526424:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572072064 00000100:00100000:3.0:1789117617.526475:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 268 00000100:00100000:3.0:1789117617.526484:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+10:6181:x1876025572072064:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117617.526838:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593108352:0@lo:400:kworker.0 00000100:00100000:3.0:1789117617.526895:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117617.526923:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593108864:0@lo:400:kworker.0 00000100:00100000:3.0:1789117617.526942:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117617.526957:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593109376:0@lo:400:kworker.0 00000100:00100000:3.0:1789117617.526979:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117617.527003:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789117617.527009:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593108480:0@lo:400:kworker.0 00000100:00100000:3.0:1789117617.527034:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117617.527050:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593108992:0@lo:400:kworker.0 00000100:00100000:3.0:1789117617.527144:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117617.527175:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593108608:0@lo:400:kworker.0 00000100:00100000:0.0:1789117617.527921:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+23:10421:x1876025593108224:12345-0@lo:502:llog_process_th.0 Request processed in 3757us (3890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117617.527933:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789117617.528028:0:10421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10421:1876025593108224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789117617.528099:0:10421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117617.528112:0:10421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117617.528114:0:10421:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789117617.528122:0:10421:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962bbcf27000 00000020:00000080:0.0:1789117617.528125:0:10421:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789117617.528731:0:10421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10421:1876025593109504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117617.528783:0:10421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117617.528820:0:10421:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf751c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789117617.528875:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593109376 00000100:00100000:0.0:1789117617.528882:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593109376 00000100:00100000:0.0:1789117617.528940:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789117617.528950:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593109376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117617.529005:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593109376:12345-0@lo:400:kworker.0 Request processed in 57us (2023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117617.529012:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789117617.529034:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593108352 00000100:00100000:0.0:1789117617.529038:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593108352 00000100:00100000:0.0:1789117617.529109:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593108864 00000100:00100000:0.0:1789117617.529113:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593108864 00000100:00100000:0.0:1789117617.529129:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593108480 00000100:00100000:0.0:1789117617.529132:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593108480 00000100:00100000:0.0:1789117617.529153:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593108992 00000100:00100000:0.0:1789117617.529157:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593108992 00000100:00100000:0.0:1789117617.529172:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789117617.529178:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593108352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117617.529215:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593108352:12345-0@lo:400:kworker.0 Request processed in 37us (2318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117617.529220:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789117617.529234:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789117617.529240:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593108864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117617.529266:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593108864:12345-0@lo:400:kworker.0 Request processed in 27us (2323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117617.529272:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789117617.529282:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789117617.529287:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593108480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117617.529313:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593108480:12345-0@lo:400:kworker.0 Request processed in 26us (2279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117617.529319:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789117617.529329:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789117617.529334:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593108992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117617.529361:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593108992:12345-0@lo:400:kworker.0 Request processed in 26us (2216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117617.529367:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789117617.529393:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593108736:0@lo:400:kworker.0 00000100:00100000:0.0:1789117617.529423:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117617.529444:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593109248:0@lo:400:kworker.0 00000100:00100000:0.0:1789117617.529481:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117617.533291:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117617.533331:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593109120:0@lo:400:kworker.0 00000100:00100000:3.0:1789117617.533362:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117617.533413:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593108736 00000100:00100000:3.0:1789117617.533434:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593108736 00000100:00100000:3.0:1789117617.533492:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593109120 00000100:00100000:3.0:1789117617.533495:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593109120 00000100:00100000:3.0:1789117617.533512:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789117617.533522:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593108736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117617.533594:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593108736:12345-0@lo:400:kworker.0 Request processed in 72us (4169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117617.533602:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789117617.533620:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789117617.533626:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593109120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117617.535613:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593109120:12345-0@lo:400:kworker.0 Request processed in 1918us (2180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117617.535626:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789117617.535742:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593108608 00000100:00100000:3.0:1789117617.535750:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593108608 00000100:00100000:3.0:1789117617.535793:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789117617.535800:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593108608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117617.535837:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593108608:12345-0@lo:400:kworker.0 Request processed in 37us (2557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117617.535843:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789117617.535963:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593109504 00000100:00100000:3.0:1789117617.535968:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593109504 00000100:00100000:3.0:1789117617.535995:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789117617.536003:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+23:10421:x1876025593109504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117617.536173:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+23:10421:x1876025593109504:12345-0@lo:502:llog_process_th.0 Request processed in 171us (7389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117617.536181:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789117617.536376:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+10:6181:x1876025572072064:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 Request processed in 9890us (10115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117617.536385:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 268 00000100:00100000:3.0:1789117617.540512:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117617.541989:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593108480:0@lo:400:kworker.0 00000100:00100000:3.0:1789117617.542013:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593108992:0@lo:400:kworker.0 00000100:00100000:3.0:1789117617.542029:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593108352:0@lo:400:kworker.0 00010000:00080000:3.0:1789117617.542048:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87ef4000 x1876025593108864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117617.542086:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593108864:0@lo:400:kworker.0 00010000:00080000:3.0:1789117617.542100:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87ef52c0 x1876025593109376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117617.542110:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593109376:0@lo:400:kworker.0 00000100:00100000:3.0:1789117617.542175:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593108608:0@lo:400:kworker.0 00010000:00080000:3.0:1789117617.542189:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87ef6580 x1876025593109120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117617.542208:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593109120:0@lo:400:kworker.0 00000100:00100000:3.0:1789117617.542247:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572072192 00000100:00100000:3.0:1789117617.542255:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572072192 00000100:00100000:3.0:1789117617.542341:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 270 00000100:00100000:3.0:1789117617.542353:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+10:6181:x1876025572072192:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117617.543099:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593109248 00000100:00100000:1.0:1789117617.543106:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593109248 00000100:00100000:1.0:1789117617.543157:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789117617.543166:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593109248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117617.543292:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593109248:12345-0@lo:400:kworker.0 Request processed in 126us (13808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117617.543301:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789117617.543334:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789117617.543340:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789117617.543344:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789117617.546887:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87ef7c00 x1876025593109248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117617.546910:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593109248:0@lo:400:kworker.0 00000100:00100000:0.0:1789117617.546961:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593108736:0@lo:400:kworker.0 00000100:00100000:0.0:1789117617.547003:0:10421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10421:1876025593109504:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789117617.547049:0:10421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117617.547091:0:10421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117617.547094:0:10421:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789117617.547100:0:10421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789117617.547201:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789117617.547225:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789117617.547238:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9bc00/0xaa253ed19be1f9f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f9ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117617.547250:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962baea9bc00/0xaa253ed19be1f9f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f9ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117617.547262:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789117617.547265:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962b9832f800 from 4 10000000:01000000:0.0:1789117617.547268:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789117617.547313:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1fa0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117617.547321:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1fa0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117617.547608:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+10:6181:x1876025572072192:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 Request processed in 5252us (7104us total) trans 0 rc 0/0 00010000:00010000:0.0:1789117617.548156:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1fa0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117617.548195:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593109632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789117617.548262:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117617.548308:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf751c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117617.548802:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593109632 00000100:00100000:1.0:1789117617.548812:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593109632 00000100:00100000:1.0:1789117617.548863:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789117617.548875:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593109632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117617.548891:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117617.548909:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbf70d000/0xaa253ed19be1fa14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1fa0d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117617.548942:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbf70d000/0xaa253ed19be1fa14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1fa0d expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117617.548955:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbf70d000/0xaa253ed19be1fa14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fa0d expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117617.548966:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70d000, rc 0) 00000100:00100000:1.0:1789117617.549015:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593109632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117617.549023:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789117617.549120:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593109632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117617.549138:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1fa0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fa14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117617.549162:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1fa0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1fa14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117617.549258:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593109760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117617.549289:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117617.549302:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c14240 going to sleep for 11 seconds 00000100:00100000:1.0:1789117617.549314:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593109760 00000100:00100000:1.0:1789117617.549316:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593109760 00000100:00100000:1.0:1789117617.549335:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789117617.549340:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593109760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117617.549463:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593109760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117617.549470:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789117617.549490:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593109760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117617.549516:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593109888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117617.549560:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117617.549568:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c14240 going to sleep for 11 seconds 00000100:00100000:1.0:1789117617.549582:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593109888 00000100:00100000:1.0:1789117617.549585:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593109888 00000100:00100000:1.0:1789117617.549599:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789117617.549604:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593109888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117617.549682:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593109888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117617.549689:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789117617.549726:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593109888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117617.550038:0:10423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10423:1876025593110016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117617.550107:0:10423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117617.550125:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593110016 00000100:00100000:1.0:1789117617.550128:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593110016 00000100:00100000:1.0:1789117617.550148:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789117617.550154:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:10423:x1876025593110016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117617.550222:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:10423:x1876025593110016:12345-0@lo:502:llog_process_th.0 Request processed in 68us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117617.550229:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789117617.550255:0:10423:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c14c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117617.550266:0:10423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10423:1876025593110016:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789117617.550287:0:10423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789117617.559492:0:10423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117617.559517:0:10423:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789117617.559731:0:10423:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962b9832f800 00000020:00000080:1.0:1789117617.559735:0:10423:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789117617.559878:0:10423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10423:1876025593110144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117617.559986:0:10423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117617.560039:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593110144 00000100:00100000:1.0:1789117617.560048:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593110144 00000100:00100000:1.0:1789117617.560132:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789117617.560144:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:10423:x1876025593110144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117617.560293:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:10423:x1876025593110144:12345-0@lo:502:llog_process_th.0 Request processed in 149us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117617.560302:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789117617.560372:0:10423:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c14c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117617.560396:0:10423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:10423:1876025593110144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789117617.560424:0:10423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117617.560428:0:10423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117617.560430:0:10423:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789117617.560435:0:10423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789117617.560517:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789117617.561687:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789117617.561704:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1fa0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fa14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117617.561718:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1fa0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fa14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117617.561992:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 270 00000100:00100000:3.0:1789117617.562850:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117617.562914:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572072320 00000100:00100000:3.0:1789117617.562925:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572072320 00000100:00100000:3.0:1789117617.562976:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 276 00000100:00100000:3.0:1789117617.562987:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+10:6710:x1876025572072320:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789117617.563195:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+10:6710:x1876025572072320:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 209us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117617.563203:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 276 00000100:00100000:3.0:1789117617.568180:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117617.568247:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572072448 00000100:00100000:3.0:1789117617.568272:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572072448 00000100:00100000:3.0:1789117617.568339:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 277 00000100:00100000:3.0:1789117617.568351:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+10:6710:x1876025572072448:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789117617.568525:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+10:6710:x1876025572072448:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 176us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117617.568534:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 277 00000100:00100000:0.0:1789117618.023530:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789117618.023567:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e49680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593110272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117618.023679:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117618.024455:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593110272 00000100:00100000:2.0:1789117618.024466:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593110272 00000100:00100000:2.0:1789117618.024532:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789117618.024545:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593110272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789117618.024582:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117618.024662:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593110272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117618.024671:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1789117618.024724:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e49680 x1876025593110272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117634 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117618.024747:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e49680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593110272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117618.025190:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593110400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789117618.025235:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117618.025732:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593110400 00000100:00100000:2.0:1789117618.025738:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593110400 00000100:00100000:2.0:1789117618.025778:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789117618.025786:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e49a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593110400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789117618.025823:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117618.025867:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e49a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593110400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117618.025875:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1789117618.025904:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87dbf480 x1876025593110400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117634 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117618.025921:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593110400:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789117618.154514:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117618.533959:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117618.534011:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117618.534041:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117618.534099:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117618.534122:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117618.534151:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572073088 00000100:00100000:1.0:1789117618.534160:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572073088 00000100:00100000:1.0:1789117618.534211:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572072960 00000100:00100000:1.0:1789117618.534214:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572072960 00000100:00100000:1.0:1789117618.534238:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:1.0:1789117618.534247:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572073088:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117618.534315:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572073088:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 69us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117618.534323:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:1.0:1789117618.534338:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00100000:1.0:1789117618.534356:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572072960:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117618.534380:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572072960:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 26us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117618.534387:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00100000:1.0:1789117618.534404:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572072832 00000100:00100000:1.0:1789117618.534407:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572072832 00000100:00100000:1.0:1789117618.534447:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572072704 00000100:00100000:1.0:1789117618.534451:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572072704 00000100:00100000:1.0:1789117618.534470:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 83 00000100:00100000:1.0:1789117618.534477:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572072832:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117618.534503:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572072832:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 27us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117618.534508:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 83 00000100:00100000:1.0:1789117618.534519:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 84 00000100:00100000:1.0:1789117618.534530:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2407:x1876025572072704:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117618.534553:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2407:x1876025572072704:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 28us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117618.534559:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 84 00000100:00080000:1.0:1789117618.534578:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789117618.534582:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789117618.534585:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789117618.534586:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117618.535417:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572072576 00000100:00100000:2.0:1789117618.535436:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572072576 00000100:00100000:2.0:1789117618.535482:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 278 00000100:00100000:2.0:1789117618.535489:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2406:x1876025572072576:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117618.535551:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2406:x1876025572072576:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 61us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117618.535559:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 278 00010000:00010000:0.0:1789117619.173344:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117620.071948:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117620.071979:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593110528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789117620.072130:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117620.072351:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593110528 00000100:00100000:0.0:1789117620.072358:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593110528 00000100:00100000:0.0:1789117620.072412:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789117620.072422:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593110528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789117620.072458:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789117620.072510:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593110528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117620.072516:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789117620.072617:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593110528:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789117620.197426:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117621.223022:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117622.125726:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593110656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789117622.125828:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117622.125930:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593110656 00000100:00100000:2.0:1789117622.125939:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593110656 00000100:00100000:2.0:1789117622.126030:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789117622.126043:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593110656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789117622.126100:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117622.126157:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593110656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117622.126165:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1789117622.126193:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789117622.126250:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a77840 x1876025593110656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117622.126278:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593110656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789117622.133174:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593110784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117622.133285:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117622.133387:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593110784 00000100:00100000:2.0:1789117622.133397:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593110784 00000100:00100000:2.0:1789117622.133488:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789117622.133501:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a77c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593110784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789117622.133668:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117622.133734:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a77c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593110784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 235us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117622.133745:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1789117622.133779:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789117622.133815:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a77840 x1876025593110784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117622.133842:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593110784:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789117622.247277:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117622.629390:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593110912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117622.629500:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117622.629603:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593110912 00000100:00100000:0.0:1789117622.629612:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593110912 00000100:00100000:0.0:1789117622.629667:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789117622.629686:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593110912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789117622.629735:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789117622.629790:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593110912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117622.629799:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789117622.629854:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593110912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789117622.630295:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593111168:0@lo:400:kworker.0 00000100:00100000:3.0:1789117622.630340:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117622.630367:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593111680:0@lo:400:kworker.0 00000100:00100000:3.0:1789117622.630389:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117622.630424:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88419a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593112192:0@lo:400:kworker.0 00000100:00100000:3.0:1789117622.630465:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117622.630493:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789117622.630499:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593111296:0@lo:400:kworker.0 00000100:00100000:3.0:1789117622.630523:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117622.630552:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593111808:0@lo:400:kworker.0 00000100:00100000:3.0:1789117622.630575:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117622.630609:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593111168 00000100:00100000:3.0:1789117622.630613:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593111168 00000100:00100000:3.0:1789117622.630639:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593111680 00000100:00100000:3.0:1789117622.630641:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593111680 00000100:00100000:3.0:1789117622.630665:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593111296 00000100:00100000:3.0:1789117622.630667:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593111296 00000100:00100000:3.0:1789117622.630676:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593111808 00000100:00100000:3.0:1789117622.630678:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593111808 00000100:00100000:3.0:1789117622.630708:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789117622.630715:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8841ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593111168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117622.630761:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8841ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593111168:12345-0@lo:400:kworker.0 Request processed in 47us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117622.630769:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789117622.630787:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789117622.630794:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88419e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593111680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117622.630822:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88419e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593111680:12345-0@lo:400:kworker.0 Request processed in 29us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117622.630827:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789117622.630839:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789117622.630844:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88418b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593111296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117622.630880:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88418b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593111296:12345-0@lo:400:kworker.0 Request processed in 36us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117622.630887:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789117622.630899:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789117622.630905:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8841b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593111808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117622.630930:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8841b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593111808:12345-0@lo:400:kworker.0 Request processed in 25us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117622.630935:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789117622.630958:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593112192 00000100:00100000:3.0:1789117622.630961:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593112192 00000100:00100000:3.0:1789117622.631002:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789117622.631010:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8841a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593112192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117622.631039:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8841a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593112192:12345-0@lo:400:kworker.0 Request processed in 30us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117622.631045:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1789117622.631093:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789117622.631099:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789117622.631101:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789117622.631130:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593111296:0@lo:400:kworker.0 00000100:00100000:3.0:1789117622.631140:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593111808:0@lo:400:kworker.0 00000100:00100000:3.0:1789117622.631149:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593111168:0@lo:400:kworker.0 00010000:00080000:3.0:1789117622.631161:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87ef6580 x1876025593111680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117622.631170:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593111680:0@lo:400:kworker.0 00010000:00080000:3.0:1789117622.631190:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88419a40 x1876025593112192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117622.631198:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88419a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593112192:0@lo:400:kworker.0 00000100:00100000:0.0:1789117622.633266:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593111040:0@lo:400:kworker.0 00000100:00100000:0.0:1789117622.633352:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117622.633402:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593111552:0@lo:400:kworker.0 00000100:00100000:0.0:1789117622.633432:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117622.633466:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88419680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593112064:0@lo:400:kworker.0 00000100:00100000:0.0:1789117622.633495:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117622.633527:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789117622.633544:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593111424:0@lo:400:kworker.0 00000100:00100000:0.0:1789117622.633577:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117622.633611:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876025593111936:0@lo:400:kworker.0 00000100:00100000:0.0:1789117622.633636:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117622.633674:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593111040 00000100:00100000:0.0:1789117622.633684:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593111040 00000100:00100000:0.0:1789117622.633739:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789117622.633750:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3647:x1876025593111040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117622.633810:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3647:x1876025593111040:12345-0@lo:400:kworker.0 Request processed in 61us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117622.633818:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789117622.633858:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593112064 00000100:00100000:0.0:1789117622.633872:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593112064 00000100:00100000:0.0:1789117622.633917:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789117622.633923:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e4b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593112064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117622.633959:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e4b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593112064:12345-0@lo:400:kworker.0 Request processed in 36us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117622.633966:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789117622.634006:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593111552 00000100:00100000:0.0:1789117622.634009:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593111552 00000100:00100000:0.0:1789117622.634049:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593111936 00000100:00100000:0.0:1789117622.634080:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593111936 00000100:00100000:0.0:1789117622.635262:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789117622.635275:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593111552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117622.635342:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593111552:12345-0@lo:400:kworker.0 Request processed in 72us (1909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117622.635349:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789117622.635364:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789117622.635370:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876025593111936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117622.635395:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876025593111936:12345-0@lo:400:kworker.0 Request processed in 26us (1758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117622.635400:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1789117622.635428:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789117622.635434:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789117622.635438:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789117622.636822:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87ef7c00 x1876025593111936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117622.636866:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876025593111936:0@lo:400:kworker.0 00000100:00100000:1.0:1789117622.636883:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593111040:0@lo:400:kworker.0 00000100:00100000:1.0:1789117622.636897:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593111552:0@lo:400:kworker.0 00010000:00080000:1.0:1789117622.636912:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88419680 x1876025593112064/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117622.636921:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88419680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593112064:0@lo:400:kworker.0 00000100:00100000:0.0:1789117622.638293:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593111424 00000100:00100000:0.0:1789117622.638316:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593111424 00000100:00100000:1.0:1789117622.642406:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789117622.642427:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593111424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117622.642589:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593111424:12345-0@lo:400:kworker.0 Request processed in 167us (9010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117622.642598:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789117622.643762:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593111424:0@lo:400:kworker.0 00000100:00100000:2.0:1789117623.141824:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117623.141872:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593112320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117623.142001:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117623.142406:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593112320 00000100:00100000:2.0:1789117623.142418:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593112320 00000100:00100000:1.0:1789117623.142887:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593112448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789117623.142954:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117623.144249:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593112448 00000100:00100000:2.0:1789117623.144265:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593112448 00000100:00100000:2.0:1789117623.144303:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789117623.144316:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a75a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593112320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789117623.144415:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1789117623.144940:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a77840 x1876025593112320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117623.144981:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593112320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117623.145377:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a75a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593112320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1062us (3374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117623.146259:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789117623.146310:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789117623.146324:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593112448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789117623.146354:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1789117623.146726:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87dbf840 x1876025593112448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117623.146756:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593112448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789117623.147022:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593112448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 702us (4066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117623.147033:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:3.0:1789117623.275607:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117623.649781:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117623.650840:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117623.651127:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572073472 00000100:00100000:0.0:1789117623.651142:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572073472 00000100:00100000:0.0:1789117623.651238:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 91 00000100:00100000:0.0:1789117623.651252:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88419a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572073472:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117623.651389:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88419a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572073472:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 140us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117623.651409:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 91 00000100:00080000:0.0:1789117623.651443:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789117623.654666:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117623.654737:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117623.654786:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117623.654835:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572073344 00000100:00100000:0.0:1789117623.654849:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572073344 00000100:00100000:0.0:1789117623.655022:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 92 00000100:00100000:0.0:1789117623.655036:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2407:x1876025572073344:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117623.656282:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572073728 00000100:00100000:3.0:1789117623.656296:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572073728 00000100:00100000:3.0:1789117623.656374:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572073600 00000100:00100000:3.0:1789117623.656378:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572073600 00000100:00100000:3.0:1789117623.656422:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:3.0:1789117623.656434:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572073728:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117623.656537:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572073728:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 106us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117623.656546:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:3.0:1789117623.656581:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:3.0:1789117623.656588:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e49e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572073600:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117623.656617:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e49e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572073600:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 30us (1830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117623.656624:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:0.0:1789117623.657606:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2407:x1876025572073344:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 2565us (2858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117623.657620:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 92 00000100:00080000:0.0:1789117623.657694:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789117623.657702:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789117623.657707:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117623.663247:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572073216 00000100:00100000:2.0:1789117623.663271:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572073216 00000100:00100000:0.0:1789117623.663534:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 280 00000100:00100000:0.0:1789117623.663548:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2407:x1876025572073216:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117623.663672:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2407:x1876025572073216:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 126us (13917us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117623.663681:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 280 00010000:00010000:0.0:1789117624.295280:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117625.189428:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117625.189455:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593112576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789117625.189531:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117625.189613:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593112576 00000100:00100000:1.0:1789117625.189620:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593112576 00000100:00100000:1.0:1789117625.189675:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789117625.189700:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593112576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789117625.189739:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789117625.189787:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593112576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117625.189794:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789117625.189859:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593112576:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789117625.317782:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117626.342216:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789117626.349447:0:10698:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1789117627.240695:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593112704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117627.240801:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117627.240906:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593112704 00000100:00100000:2.0:1789117627.240915:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593112704 00000100:00100000:2.0:1789117627.240979:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789117627.240990:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a77840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593112704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789117627.241017:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117627.241073:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a77840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593112704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117627.241081:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1789117627.241103:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789117627.241135:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a77480 x1876025593112704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117643 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117627.241157:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593112704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117627.243192:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593112832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789117627.243250:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117627.243401:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593112832 00000100:00100000:1.0:1789117627.243417:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593112832 00000100:00100000:1.0:1789117627.243465:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789117627.243473:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593112832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789117627.243491:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117627.243528:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593112832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117627.243535:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1789117627.243933:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789117627.243963:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87dbf840 x1876025593112832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117643 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117627.243983:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593112832:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789117627.389165:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117627.765596:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789117627.765621:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593112960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789117627.765705:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117627.765849:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593112960 00000100:00100000:1.0:1789117627.765860:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593112960 00000100:00100000:1.0:1789117627.765933:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789117627.765943:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593112960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789117627.765979:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789117627.766033:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593112960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117627.766041:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789117627.766105:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593112960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117627.766389:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117627.766399:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593113088:0@lo:400:kworker.0 00000100:00100000:1.0:1789117627.766444:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117627.766499:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593113216:0@lo:400:kworker.0 00000100:00100000:1.0:1789117627.766527:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117627.766573:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593113344:0@lo:400:kworker.0 00000100:00100000:1.0:1789117627.766597:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117627.766638:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593113472:0@lo:400:kworker.0 00000100:00100000:1.0:1789117627.766662:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117627.766686:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593113472 00000100:00100000:1.0:1789117627.766690:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593113472 00000100:00100000:1.0:1789117627.766712:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789117627.766718:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593113472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117627.766753:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593113472:12345-0@lo:400:kworker.0 Request processed in 35us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117627.766760:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789117627.766785:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593113472:0@lo:400:kworker.0 00000100:00100000:1.0:1789117627.766815:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117627.766821:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593113600:0@lo:400:kworker.0 00000100:00100000:1.0:1789117627.766843:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117627.766895:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593113728:0@lo:400:kworker.0 00000100:00100000:1.0:1789117627.766918:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117627.766964:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593113856:0@lo:400:kworker.0 00000100:00100000:1.0:1789117627.766989:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117627.767018:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593113856 00000100:00100000:1.0:1789117627.767022:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593113856 00000100:00100000:1.0:1789117627.767051:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789117627.767090:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593113856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117627.767128:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593113856:12345-0@lo:400:kworker.0 Request processed in 39us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117627.767134:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1789117627.767170:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7df0c0 x1876025593113856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117627.767196:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593113856:0@lo:400:kworker.0 00000100:00100000:1.0:1789117627.767229:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593113984:0@lo:400:kworker.0 00000100:00100000:1.0:1789117627.767252:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117627.767290:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117627.767296:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593114112:0@lo:400:kworker.0 00000100:00100000:1.0:1789117627.767319:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117627.767353:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593114240:0@lo:400:kworker.0 00000100:00100000:1.0:1789117627.767375:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117627.767413:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593114368:0@lo:400:kworker.0 00000100:00100000:1.0:1789117627.767438:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117627.767497:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593114496:0@lo:400:kworker.0 00000100:00100000:1.0:1789117627.767524:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117627.767547:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593113984 00000100:00100000:1.0:1789117627.767551:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593113984 00000100:00100000:1.0:1789117627.767590:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593114368 00000100:00100000:1.0:1789117627.767593:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593114368 00000100:00100000:1.0:1789117627.767615:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593114496 00000100:00100000:1.0:1789117627.767618:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593114496 00000100:00100000:1.0:1789117627.767632:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789117627.767639:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593113984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117627.767678:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593113984:12345-0@lo:400:kworker.0 Request processed in 40us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117627.767685:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789117627.767698:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789117627.767704:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfc07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593114368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117627.767736:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfc07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593114368:12345-0@lo:400:kworker.0 Request processed in 33us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117627.767742:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789117627.767904:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789117627.767911:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87faad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593114496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117627.767938:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87faad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593114496:12345-0@lo:400:kworker.0 Request processed in 29us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117627.767944:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1789117627.767964:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789117627.767984:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7dde00 x1876025593114368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117627.767993:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593114368:0@lo:400:kworker.0 00010000:00080000:1.0:1789117627.768015:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87fa9a40 x1876025593114496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117627.768024:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593114496:0@lo:400:kworker.0 00010000:00080000:1.0:1789117627.768034:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7df0c0 x1876025593113984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117627.768041:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593113984:0@lo:400:kworker.0 00000100:00100000:0.0:1789117627.769342:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593113088 00000100:00100000:0.0:1789117627.769380:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593113088 00000100:00100000:0.0:1789117627.769438:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789117627.769447:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3646:x1876025593113088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117627.769517:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3646:x1876025593113088:12345-0@lo:400:kworker.0 Request processed in 72us (3073us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117627.769525:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789117627.769557:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593113216 00000100:00100000:0.0:1789117627.769561:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593113216 00000100:00100000:0.0:1789117627.769582:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593113344 00000100:00100000:0.0:1789117627.769585:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593113344 00000100:00100000:0.0:1789117627.769596:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593113600 00000100:00100000:0.0:1789117627.769598:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593113600 00000100:00100000:0.0:1789117627.769617:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593113728 00000100:00100000:0.0:1789117627.769620:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593113728 00000100:00100000:0.0:1789117627.769632:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593114112 00000100:00100000:0.0:1789117627.769634:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593114112 00000100:00100000:0.0:1789117627.769646:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593114240 00000100:00100000:0.0:1789117627.769648:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593114240 00000100:00100000:0.0:1789117627.769661:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789117627.769666:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593113216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117627.769706:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593113216:12345-0@lo:400:kworker.0 Request processed in 39us (3178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117627.769711:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789117627.769723:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789117627.769729:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593113344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117627.769762:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593113344:12345-0@lo:400:kworker.0 Request processed in 33us (3164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117627.769768:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789117627.769778:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789117627.769791:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593113600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117627.769821:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593113600:12345-0@lo:400:kworker.0 Request processed in 31us (2977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117627.769827:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789117627.769838:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789117627.769844:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593113728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117627.769883:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593113728:12345-0@lo:400:kworker.0 Request processed in 28us (2953us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117627.769889:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789117627.769901:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789117627.769906:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593114112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117627.769931:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593114112:12345-0@lo:400:kworker.0 Request processed in 26us (2611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117627.769936:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789117627.769945:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789117627.769950:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593114240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117627.769974:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593114240:12345-0@lo:400:kworker.0 Request processed in 24us (2599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117627.769979:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1789117627.770009:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789117627.770013:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789117627.770041:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7de940 x1876025593114240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117627.770088:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593114240:0@lo:400:kworker.0 00010000:00080000:0.0:1789117627.770113:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7dc000 x1876025593113728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117627.770128:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593113728:0@lo:400:kworker.0 00000100:00100000:0.0:1789117627.770144:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593113216:0@lo:400:kworker.0 00000100:00100000:0.0:1789117627.770192:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593113344:0@lo:400:kworker.0 00000100:00100000:0.0:1789117627.770216:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593114112:0@lo:400:kworker.0 00000100:00100000:0.0:1789117627.770226:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593113600:0@lo:400:kworker.0 00000100:00100000:0.0:1789117627.770235:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593113088:0@lo:400:kworker.0 00000100:00100000:0.0:1789117628.262101:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593114624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789117628.262207:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117628.264381:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593114624 00000100:00100000:1.0:1789117628.264411:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593114624 00000100:00100000:1.0:1789117628.264487:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789117628.264497:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593114624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789117628.264533:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117628.264629:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593114624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 133us (2422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117628.264637:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1789117628.268242:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87fa9a40 x1876025593114624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117628.268279:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593114624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789117628.276974:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593114752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117628.277080:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117628.277392:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593114752 00000100:00100000:0.0:1789117628.277401:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593114752 00000100:00100000:0.0:1789117628.277457:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789117628.277466:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593114752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789117628.277494:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117628.288332:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593114752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10854us (11267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117628.288359:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1789117628.296400:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e4b840 x1876025593114752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117628.296434:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593114752:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789117628.393616:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117628.802414:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117628.802449:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117628.802560:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117628.802621:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572073856 00000100:00100000:1.0:1789117628.802643:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572073856 00000100:00100000:1.0:1789117628.802709:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 282 00000100:00100000:1.0:1789117628.802719:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2406:x1876025572073856:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117628.802802:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2406:x1876025572073856:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 74us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117628.802810:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 282 00000100:00100000:0.0:1789117628.809284:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117628.809323:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117628.809360:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572074240 00000100:00100000:0.0:1789117628.809385:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572074240 00000100:00100000:0.0:1789117628.809447:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572074368 00000100:00100000:0.0:1789117628.809450:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572074368 00000100:00100000:0.0:1789117628.809474:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:0.0:1789117628.809485:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2403:x1876025572074240:12345-192.168.204.30@tcp:9:kworker.0 00000020:00000080:0.0:1789117628.809529:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f926 00000100:00080000:0.0:1789117628.809538:0:8433:0:(import.c:65:import_set_state_nolock()) ffff962a87e9b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789117628.809579:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789117628.809756:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+2:2403:x1876025572074240:12345-192.168.204.30@tcp:9:kworker.0 Request processed in 272us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117628.809765:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:0.0:1789117628.809782:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:0.0:1789117628.809788:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e4b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2403:x1876025572074368:12345-192.168.204.30@tcp:9:kworker.0 00000100:00100000:2.0:1789117628.811379:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572074112 00000100:00100000:2.0:1789117628.811391:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572074112 00010000:00010000:3.0:1789117628.811504:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789117628.811650:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789117628.811655:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789117628.811657:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1789117628.812109:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f92d 00000100:00080000:0.0:1789117628.812120:0:8433:0:(import.c:65:import_set_state_nolock()) ffff962bbf944000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789117628.812171:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:3.0:1789117628.812319:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117628.812338:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e4b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+2:2403:x1876025572074368:12345-192.168.204.30@tcp:9:kworker.0 Request processed in 2545us (3009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117628.812350:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:1.0:1789117628.815938:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572073984 00000100:00100000:1.0:1789117628.815961:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572073984 00000100:00100000:1.0:1789117628.816169:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 99 00000100:00100000:1.0:1789117628.816185:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572074112:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117628.816299:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572074112:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 118us (13847us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117628.816408:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 99 00000100:00100000:1.0:1789117628.816432:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 100 00000100:00100000:1.0:1789117628.816439:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572073984:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117628.816465:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572073984:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 27us (13905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117628.816471:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 100 00000100:00080000:3.0:1789117628.817746:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789117629.413233:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117630.310522:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593114880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789117630.310637:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117630.312446:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593114880 00000100:00100000:0.0:1789117630.312468:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593114880 00000100:00100000:0.0:1789117630.312552:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789117630.312566:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87faa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593114880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789117630.312620:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789117630.313596:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87faa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593114880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1025us (2950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117630.313610:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789117630.313772:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593114880:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789117630.439522:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117631.461586:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117632.357431:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf83c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593115008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117632.357528:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117632.357925:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789117632.357933:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593115136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789117632.357965:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117632.358020:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593115008 00000100:00100000:0.0:1789117632.358027:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593115008 00000100:00100000:0.0:1789117632.358104:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593115136 00000100:00100000:0.0:1789117632.358108:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593115136 00000100:00100000:0.0:1789117632.358130:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789117632.358139:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d83c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593115008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789117632.358171:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117632.358219:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d83c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593115008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117632.358226:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789117632.358243:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789117632.358250:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593115136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789117632.358261:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117632.358285:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593115136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117632.358291:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1789117632.358306:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789117632.358333:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87fa8b40 x1876025593115136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117648 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117632.358354:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593115136:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1789117632.358367:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf83c780 x1876025593115008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117648 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117632.358393:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf83c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593115008:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789117632.485192:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117632.869497:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593115520:0@lo:400:kworker.0 00000100:00100000:0.0:1789117632.869579:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117632.869644:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf81ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593116032:0@lo:400:kworker.0 00000100:00100000:0.0:1789117632.869670:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117632.869691:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf81de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593116544:0@lo:400:kworker.0 00000100:00100000:0.0:1789117632.869712:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117632.869733:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789117632.869739:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593115648:0@lo:400:kworker.0 00000100:00100000:0.0:1789117632.869758:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117632.869784:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf81f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593116160:0@lo:400:kworker.0 00000100:00100000:0.0:1789117632.869809:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117632.869829:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf81da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593116672:0@lo:400:kworker.0 00000100:00100000:0.0:1789117632.869868:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117632.869908:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593115520 00000100:00100000:0.0:1789117632.869916:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593115520 00000100:00100000:0.0:1789117632.869966:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789117632.869977:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593115520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117632.870039:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593115520:12345-0@lo:400:kworker.0 Request processed in 64us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117632.870046:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789117632.870091:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593116032 00000100:00100000:0.0:1789117632.870095:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593116032 00000100:00100000:0.0:1789117632.870131:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593116544 00000100:00100000:0.0:1789117632.870141:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593116544 00000100:00100000:0.0:1789117632.870158:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593115648 00000100:00100000:0.0:1789117632.870161:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593115648 00000100:00100000:0.0:1789117632.870172:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789117632.870178:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593116032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117632.870213:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593116032:12345-0@lo:400:kworker.0 Request processed in 35us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117632.870219:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789117632.870230:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789117632.870236:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593116544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117632.870277:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593116544:12345-0@lo:400:kworker.0 Request processed in 41us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117632.870283:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789117632.870293:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789117632.870299:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593115648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117632.870324:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593115648:12345-0@lo:400:kworker.0 Request processed in 25us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117632.870329:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1789117632.870348:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789117632.870381:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593115648:0@lo:400:kworker.0 00000100:00100000:0.0:1789117632.870392:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593115520:0@lo:400:kworker.0 00010000:00080000:0.0:1789117632.870404:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf81ed00 x1876025593116032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117632.870414:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf81ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593116032:0@lo:400:kworker.0 00010000:00080000:0.0:1789117632.870423:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf81de00 x1876025593116544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117632.870441:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf81de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593116544:0@lo:400:kworker.0 00000100:00100000:1.0:1789117632.870587:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593115264:0@lo:400:kworker.0 00000100:00100000:1.0:1789117632.870623:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117632.870656:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593115776:0@lo:400:kworker.0 00000100:00100000:1.0:1789117632.870680:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117632.870697:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf81e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593116288:0@lo:400:kworker.0 00000100:00100000:1.0:1789117632.870717:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117632.870733:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf81cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593116800:0@lo:400:kworker.0 00000100:00100000:1.0:1789117632.870752:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117632.870772:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789117632.870791:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593115392:0@lo:400:kworker.0 00000100:00100000:1.0:1789117632.870814:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117632.870831:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593115904:0@lo:400:kworker.0 00000100:00100000:1.0:1789117632.870850:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117632.870873:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf81d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593116416:0@lo:400:kworker.0 00000100:00100000:1.0:1789117632.870894:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117632.870919:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593115392 00000100:00100000:1.0:1789117632.870923:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593115392 00000100:00100000:1.0:1789117632.870943:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593115904 00000100:00100000:1.0:1789117632.870946:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593115904 00000100:00100000:1.0:1789117632.870964:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593116416 00000100:00100000:1.0:1789117632.870967:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593116416 00000100:00100000:1.0:1789117632.870981:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789117632.870987:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593115392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117632.871025:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593115392:12345-0@lo:400:kworker.0 Request processed in 38us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117632.871031:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789117632.871044:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789117632.871050:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593115904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117632.871128:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593115904:12345-0@lo:400:kworker.0 Request processed in 78us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117632.871134:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789117632.871146:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789117632.871152:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87faa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593116416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117632.871179:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87faa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593116416:12345-0@lo:400:kworker.0 Request processed in 28us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117632.871185:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789117632.871210:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593116160 00000100:00100000:1.0:1789117632.871214:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593116160 00000100:00100000:1.0:1789117632.871231:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593116672 00000100:00100000:1.0:1789117632.871234:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593116672 00000100:00100000:1.0:1789117632.871245:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593116288 00000100:00100000:1.0:1789117632.872354:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593116288 00000100:00100000:1.0:1789117632.872396:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593116800 00000100:00100000:1.0:1789117632.872399:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593116800 00000100:00100000:1.0:1789117632.872420:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789117632.872429:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593116160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117632.872522:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593116160:12345-0@lo:400:kworker.0 Request processed in 94us (2711us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117632.872528:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789117632.872541:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789117632.872546:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f70f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593116672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117632.872575:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f70f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593116672:12345-0@lo:400:kworker.0 Request processed in 29us (2707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117632.872580:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789117632.872591:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789117632.872596:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593116288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117632.872622:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593116288:12345-0@lo:400:kworker.0 Request processed in 26us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117632.872627:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789117632.872638:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789117632.872643:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593116800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117632.872669:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593116800:12345-0@lo:400:kworker.0 Request processed in 27us (1917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117632.872676:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1789117632.872707:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789117632.872713:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117632.872744:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593115776 00000100:00100000:1.0:1789117632.872749:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593115776 00000100:00100000:1.0:1789117632.872803:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789117632.872810:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593115776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117632.872845:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593115776:12345-0@lo:400:kworker.0 Request processed in 36us (2164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117632.872851:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789117632.872908:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593115392:0@lo:400:kworker.0 00000100:00100000:1.0:1789117632.872921:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593115904:0@lo:400:kworker.0 00000100:00100000:1.0:1789117632.872932:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf81d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593116416:0@lo:400:kworker.0 00000100:00100000:1.0:1789117632.872944:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593115776:0@lo:400:kworker.0 00010000:00080000:1.0:1789117632.872959:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf81e940 x1876025593116288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117632.872970:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf81e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593116288:0@lo:400:kworker.0 00010000:00080000:1.0:1789117632.872981:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf81cb40 x1876025593116800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117632.872990:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf81cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593116800:0@lo:400:kworker.0 00010000:00080000:1.0:1789117632.873040:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf81f0c0 x1876025593116160/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117632.873051:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf81f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593116160:0@lo:400:kworker.0 00010000:00080000:1.0:1789117632.873091:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf81da40 x1876025593116672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117632.873100:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf81da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593116672:0@lo:400:kworker.0 00000100:00100000:0.0:1789117632.873239:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593115264 00000100:00100000:0.0:1789117632.873245:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593115264 00000100:00100000:0.0:1789117632.873297:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789117632.873304:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593115264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117632.873347:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593115264:12345-0@lo:400:kworker.0 Request processed in 44us (2723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117632.873353:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1789117632.873675:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8841bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593116928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789117632.873720:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117632.873762:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593116928 00000100:00100000:3.0:1789117632.873765:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593116928 00000100:00100000:3.0:1789117632.873805:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789117632.873812:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593116928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789117632.873848:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789117632.873890:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593116928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117632.873898:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789117632.873933:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8841bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593116928:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117632.875465:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593115264:0@lo:400:kworker.0 00000001:02000400:3.0:1789117633.006638:0:10942:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing yml_node 00000100:00100000:1.0:1789117633.381204:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789117633.381231:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593117056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789117633.381314:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117633.381395:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593117056 00000100:00100000:2.0:1789117633.381404:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593117056 00000100:00100000:2.0:1789117633.381461:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789117633.381472:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593117056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789117633.381504:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117633.381548:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593117056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117633.381555:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789117633.381573:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789117633.381583:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593117184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117633.381609:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117633.381658:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593117184 00000100:00100000:0.0:1789117633.381667:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593117184 00000100:00100000:0.0:1789117633.381700:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1789117633.381702:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87fabc00 x1876025593117056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117633.381707:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593117184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789117633.381718:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117633.381721:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593117056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789117633.381749:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593117184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117633.381756:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1789117633.381837:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f703c0 x1876025593117184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117633.381850:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593117184:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789117633.510160:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117633.899707:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117633.899745:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117633.899783:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117633.900215:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572074496 00000100:00100000:2.0:1789117633.900226:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572074496 00000100:00100000:2.0:1789117633.900283:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 284 00000100:00100000:2.0:1789117633.900295:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2407:x1876025572074496:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117633.900384:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2407:x1876025572074496:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 91us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117633.900392:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 284 00000100:00100000:1.0:1789117633.902359:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572074752 00000100:00100000:1.0:1789117633.902375:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572074752 00000100:00100000:1.0:1789117633.902462:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572074624 00000100:00100000:1.0:1789117633.902466:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572074624 00000100:00100000:1.0:1789117633.902500:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 107 00000100:00100000:1.0:1789117633.902512:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572074752:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117633.902622:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572074752:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 111us (2875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117633.902630:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 107 00000100:00100000:1.0:1789117633.902647:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 108 00000100:00100000:1.0:1789117633.902894:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2407:x1876025572074624:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117633.902928:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2407:x1876025572074624:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 38us (3144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117633.902934:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 108 00000100:00080000:2.0:1789117633.903037:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789117633.903044:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789117634.533546:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789117634.919362:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35e670b1-2cce-4394-8cb4-d5255c6a6a93 00000020:00000080:0.0:1789117634.919372:0:9514:0:(genops.c:885:class_export_put()) final put ffff962bbf947800/35e670b1-2cce-4394-8cb4-d5255c6a6a93 00000020:00000080:2.0:1789117634.919475:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf947800/35e670b1-2cce-4394-8cb4-d5255c6a6a93 for lustre-OST0001 00000020:00000080:2.0:1789117634.919547:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bbf944000 for lustre-OST0001 00000001:00100000:1.0:1789117634.926223:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 35e670b1-2cce-4394-8cb4-d5255c6a6a93 00000020:00000080:1.0:1789117634.926234:0:8429:0:(genops.c:885:class_export_put()) final put ffff962a87e9a800/35e670b1-2cce-4394-8cb4-d5255c6a6a93 00000020:00000080:0.0:1789117634.926366:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962a87e9a800/35e670b1-2cce-4394-8cb4-d5255c6a6a93 for lustre-OST0000 00000020:00000080:0.0:1789117634.926443:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a87e9b800 for lustre-OST0000 00000100:00100000:1.0:1789117635.431081:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593117312:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789117635.431158:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117635.431312:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593117312 00000100:00100000:0.0:1789117635.431320:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593117312 00000100:00100000:0.0:1789117635.431372:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789117635.431382:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593117312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789117635.431416:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789117635.431477:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593117312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117635.431495:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789117635.431641:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593117312:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789117635.558125:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117636.581405:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117637.480375:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593117440:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789117637.480449:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117637.480547:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593117440 00000100:00100000:1.0:1789117637.480556:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593117440 00000100:00100000:1.0:1789117637.480619:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1789117637.480722:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789117637.480799:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8841bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593117440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789117637.480832:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117637.480994:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf83f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593117568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117637.481025:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117637.481078:0:8439:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1789117637.481086:0:8439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1789117637.481210:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593117568 00000100:00100000:2.0:1789117637.481215:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593117568 00000100:00100000:2.0:1789117637.481312:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789117637.481319:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593117568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789117637.481330:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117637.481363:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593117568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117637.481380:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1789117637.481415:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf83f480 x1876025593117568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117637.481433:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf83f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593117568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117637.482874:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8841bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593117440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2241us (2418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117637.482884:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1789117637.485543:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87faa1c0 x1876025593117440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117637.485572:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593117440:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789117637.486886:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789117637.605477:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789117637.816676:0:11126:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.140 00000100:00100000:1.0:1789117637.989400:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8841a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593117696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117637.989494:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117637.989788:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593118080:0@lo:400:kworker.0 00000100:00100000:1.0:1789117637.989821:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117637.989979:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593117824:0@lo:400:kworker.0 00000100:00100000:0.0:1789117637.990019:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117637.990075:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593117824 00000100:00100000:0.0:1789117637.990083:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593117824 00000100:00100000:0.0:1789117637.990146:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789117637.990272:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593117824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117637.990333:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593117824:12345-0@lo:400:kworker.0 Request processed in 177us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117637.990341:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789117637.990434:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593118592:0@lo:400:kworker.0 00000100:00100000:1.0:1789117637.990465:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117637.990497:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593118080 00000100:00100000:1.0:1789117637.990500:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593118080 00000100:00100000:1.0:1789117637.990534:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789117637.990541:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593118080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117637.990579:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593118080:12345-0@lo:400:kworker.0 Request processed in 39us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117637.990585:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789117637.990614:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593118592 00000100:00100000:1.0:1789117637.990617:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593118592 00000100:00100000:1.0:1789117637.990645:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789117637.990652:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e14f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593118592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117637.990771:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593117696 00000100:00100000:3.0:1789117637.990777:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593117696 00000100:00100000:3.0:1789117637.990810:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789117637.990817:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593117696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789117637.990863:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789117637.990908:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593117696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (1416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117637.990915:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789117637.990937:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593117952:0@lo:400:kworker.0 00000100:00100000:3.0:1789117637.990963:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117637.991330:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593117824:0@lo:400:kworker.0 00000100:00100000:0.0:1789117637.991340:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593118336:0@lo:400:kworker.0 00000100:00100000:0.0:1789117637.991371:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117637.991405:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593118848:0@lo:400:kworker.0 00000100:00100000:0.0:1789117637.991428:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117637.991480:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593117952 00000100:00100000:0.0:1789117637.991484:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593117952 00000100:00100000:0.0:1789117637.991501:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593118336 00000100:00100000:0.0:1789117637.991504:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593118336 00000100:00100000:0.0:1789117637.991525:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593118848 00000100:00100000:0.0:1789117637.991528:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593118848 00000100:00100000:0.0:1789117637.991542:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789117637.991548:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8841b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593117952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117637.991582:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8841b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593117952:12345-0@lo:400:kworker.0 Request processed in 35us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117637.991610:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789117637.991623:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789117637.991628:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593118336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117637.991673:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593118336:12345-0@lo:400:kworker.0 Request processed in 32us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117637.991688:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789117637.991699:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789117637.991706:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593118848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117637.991733:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593118848:12345-0@lo:400:kworker.0 Request processed in 28us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117637.991738:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789117637.991769:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593118336:0@lo:400:kworker.0 00000100:00100000:0.0:1789117637.991779:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593118848:0@lo:400:kworker.0 00000100:00080000:3.0:1789117637.992701:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117637.992758:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593117952:0@lo:400:kworker.0 00000100:00100000:3.0:1789117637.992777:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593118464:0@lo:400:kworker.0 00000100:00100000:3.0:1789117637.992855:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117637.992892:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593118976:0@lo:400:kworker.0 00000100:00100000:3.0:1789117637.992928:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117637.992986:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593118464 00000100:00100000:3.0:1789117637.992992:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593118464 00000100:00100000:3.0:1789117637.993038:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593118976 00000100:00100000:3.0:1789117637.993042:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593118976 00000100:00100000:3.0:1789117637.993077:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789117637.993087:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88418780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593118464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117637.993142:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88418780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593118464:12345-0@lo:400:kworker.0 Request processed in 57us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117637.993150:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789117637.993278:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789117637.993285:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8841b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593118976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117637.993316:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8841b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593118976:12345-0@lo:400:kworker.0 Request processed in 32us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117637.993324:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1789117637.993338:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789117637.993364:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7a7c00 x1876025593118464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117637.993379:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593118464:0@lo:400:kworker.0 00010000:00080000:3.0:1789117637.993389:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf6fc000 x1876025593118976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117637.993399:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593118976:0@lo:400:kworker.0 00000100:00100000:1.0:1789117637.997101:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e14f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593118592:12345-0@lo:400:kworker.0 Request processed in 467us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117637.997183:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789117637.997294:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593118208:0@lo:400:kworker.0 00000100:00100000:1.0:1789117637.997404:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117637.997604:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593118720:0@lo:400:kworker.0 00000100:00100000:1.0:1789117637.997631:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117637.997656:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593119232:0@lo:400:kworker.0 00000100:00100000:1.0:1789117637.998294:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117637.998373:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8841a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593117696:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1789117637.998446:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b98a6e580 x1876025593118592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117637.998459:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593118592:0@lo:400:kworker.0 00000100:00100000:1.0:1789117637.998468:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593119104:0@lo:400:kworker.0 00000100:00100000:1.0:1789117637.998493:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117637.998527:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593118080:0@lo:400:kworker.0 00000100:00100000:1.0:1789117637.998554:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593118720 00000100:00100000:1.0:1789117637.998561:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593118720 00000100:00100000:1.0:1789117637.998609:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593119232 00000100:00100000:1.0:1789117637.998612:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593119232 00000100:00100000:1.0:1789117637.998632:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593119104 00000100:00100000:1.0:1789117637.998634:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593119104 00000100:00100000:1.0:1789117637.998649:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789117637.998905:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86808f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593118720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117637.998971:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86808f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593118720:12345-0@lo:400:kworker.0 Request processed in 314us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117637.998996:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789117637.999014:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789117637.999021:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593119232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117637.999051:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593119232:12345-0@lo:400:kworker.0 Request processed in 30us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117637.999079:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789117637.999090:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789117637.999096:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593119104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117637.999126:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593119104:12345-0@lo:400:kworker.0 Request processed in 30us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117637.999142:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1789117637.999494:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf6fe580 x1876025593119104/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117637.999506:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593119104:0@lo:400:kworker.0 00010000:00080000:1.0:1789117637.999538:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf6fde00 x1876025593118720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117637.999547:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593118720:0@lo:400:kworker.0 00010000:00080000:1.0:1789117637.999558:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf6ffc00 x1876025593119232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117637.999564:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593119232:0@lo:400:kworker.0 00000100:00080000:2.0:1789117638.002375:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789117638.004453:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593118208 00000100:00100000:3.0:1789117638.004487:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593118208 00000100:00100000:3.0:1789117638.004574:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789117638.004588:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593118208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117638.004742:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593118208:12345-0@lo:400:kworker.0 Request processed in 157us (7336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117638.004751:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789117638.005565:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593118208:0@lo:400:kworker.0 00000100:00100000:0.0:1789117638.502385:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593119360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789117638.502509:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117638.502652:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593119360 00000100:00100000:1.0:1789117638.502661:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593119360 00000100:00100000:1.0:1789117638.502765:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789117638.502776:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f712c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593119360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789117638.502820:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117638.502880:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f712c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593119360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117638.502887:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1789117638.506979:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a74000 x1876025593119360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117654 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117638.507009:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593119360:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789117638.512349:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789117638.512373:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88418f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593119488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117638.512444:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117638.512495:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593119488 00000100:00100000:3.0:1789117638.512505:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593119488 00000100:00100000:3.0:1789117638.512562:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789117638.512572:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593119488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789117638.512594:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117638.512659:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593119488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117638.512676:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1789117638.512703:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88418f00 x1876025593119488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117654 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117638.512724:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88418f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593119488:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789117638.635568:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117639.008878:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117639.009946:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117639.009983:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117639.013516:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572074880 00000100:00100000:2.0:1789117639.013549:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572074880 00000100:00100000:2.0:1789117639.013642:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 286 00000100:00100000:2.0:1789117639.013656:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2405:x1876025572074880:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117639.013784:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2405:x1876025572074880:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 120us (3833us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117639.013793:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 286 00000100:00100000:0.0:1789117639.018611:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572075008 00000100:00100000:0.0:1789117639.018640:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572075008 00000100:00100000:0.0:1789117639.018733:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572075136 00000100:00100000:0.0:1789117639.018738:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572075136 00000100:00100000:0.0:1789117639.018773:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 115 00000100:00100000:0.0:1789117639.018784:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8841a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2405:x1876025572075008:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117639.018880:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8841a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2405:x1876025572075008:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 97us (10014us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117639.018888:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 115 00000100:00100000:0.0:1789117639.018907:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 116 00000100:00100000:0.0:1789117639.018913:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2405:x1876025572075136:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117639.018939:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2405:x1876025572075136:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 26us (8956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117639.018946:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 116 00000100:00080000:0.0:1789117639.018964:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789117639.018968:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789117639.653283:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117640.555264:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88419680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593119616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789117640.555338:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117640.555898:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593119616 00000100:00100000:0.0:1789117640.555907:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593119616 00000100:00100000:0.0:1789117640.555979:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789117640.555991:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593119616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789117640.556033:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789117640.574017:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593119616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 18017us (18666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117640.574036:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789117640.574512:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88419680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593119616:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789117640.677177:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789117641.031252:0:11224:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.140 00010000:00010000:0.0:1789117641.703078:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117642.599405:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117642.599443:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88419680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593119744:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789117642.599548:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117642.600304:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593119744 00000100:00100000:0.0:1789117642.600317:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593119744 00000100:00100000:0.0:1789117642.600421:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789117642.600436:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88418f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593119744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789117642.600487:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117642.600568:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88418f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593119744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 136us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117642.600577:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1789117642.600650:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88419680 x1876025593119744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117642.600675:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88419680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593119744:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789117642.600857:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117642.601432:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593119872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117642.601499:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117642.601564:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593119872 00000100:00100000:0.0:1789117642.601570:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593119872 00000100:00100000:0.0:1789117642.601644:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789117642.601655:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593119872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789117642.601683:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117642.601726:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593119872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117642.601734:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1789117642.601766:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f721c0 x1876025593119872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117642.601782:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593119872:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789117642.609637:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789117642.725596:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117643.109776:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593120128:0@lo:400:kworker.0 00000100:00100000:2.0:1789117643.109924:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117643.110109:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593120256:0@lo:400:kworker.0 00000100:00100000:2.0:1789117643.110154:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117643.110264:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a878883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593120640:0@lo:400:kworker.0 00000100:00100000:2.0:1789117643.110290:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117643.110332:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593120128 00000100:00100000:2.0:1789117643.110343:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593120128 00000100:00100000:2.0:1789117643.110409:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593120640 00000100:00100000:2.0:1789117643.110412:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593120640 00000100:00100000:2.0:1789117643.110450:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789117643.110461:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593120128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117643.110522:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593120128:12345-0@lo:400:kworker.0 Request processed in 61us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117643.110537:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789117643.110556:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789117643.110562:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8788a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593120640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117643.110602:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8788a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593120640:12345-0@lo:400:kworker.0 Request processed in 40us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117643.110608:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789117643.110661:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a878883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593120640:0@lo:400:kworker.0 00000100:00100000:2.0:1789117643.110672:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593120128:0@lo:400:kworker.0 00000100:00100000:2.0:1789117643.110726:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a878883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876025593120768:0@lo:400:kworker.0 00000100:00100000:2.0:1789117643.110753:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117643.110776:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593120768 00000100:00100000:2.0:1789117643.110780:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593120768 00000100:00100000:2.0:1789117643.110806:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789117643.110812:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87888f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876025593120768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117643.110846:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87888f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876025593120768:12345-0@lo:400:kworker.0 Request processed in 34us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117643.110852:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:2.0:1789117643.110880:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a878883c0 x1876025593120768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117643.110891:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a878883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876025593120768:0@lo:400:kworker.0 00000100:00100000:2.0:1789117643.110935:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593121152:0@lo:400:kworker.0 00000100:00100000:2.0:1789117643.110957:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117643.110987:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593121152 00000100:00100000:2.0:1789117643.110998:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593121152 00000100:00100000:2.0:1789117643.111024:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789117643.111030:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593121152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117643.111095:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593121152:12345-0@lo:400:kworker.0 Request processed in 66us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117643.111102:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789117643.111130:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593121152:0@lo:400:kworker.0 00000100:00100000:2.0:1789117643.111163:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876025593121280:0@lo:400:kworker.0 00000100:00100000:2.0:1789117643.111187:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117643.111212:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593121280 00000100:00100000:2.0:1789117643.111216:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593121280 00000100:00100000:2.0:1789117643.111241:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789117643.111248:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876025593121280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117643.111282:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876025593121280:12345-0@lo:400:kworker.0 Request processed in 35us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117643.111288:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:2.0:1789117643.111314:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87888000 x1876025593121280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117643.111326:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876025593121280:0@lo:400:kworker.0 00000100:00100000:3.0:1789117643.111618:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593120256 00000100:00100000:3.0:1789117643.111623:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593120256 00000100:00100000:3.0:1789117643.111654:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789117643.111661:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593120256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117643.111703:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593120256:12345-0@lo:400:kworker.0 Request processed in 43us (1548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117643.111715:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1789117643.111736:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789117643.111741:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117643.111760:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593120256:0@lo:400:kworker.0 00000100:00100000:3.0:1789117643.111774:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789117643.111780:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8841a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593121664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789117643.111808:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117643.111831:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593121664 00000100:00100000:3.0:1789117643.111835:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593121664 00000100:00100000:3.0:1789117643.111851:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789117643.111856:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8841a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593121664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789117643.111888:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789117643.111926:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8841a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593121664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117643.111933:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789117643.111962:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8841a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593121664:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117643.112462:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf83f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593120000:0@lo:400:kworker.0 00000100:00100000:0.0:1789117643.112524:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117643.112570:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8788b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593120512:0@lo:400:kworker.0 00000100:00100000:0.0:1789117643.112606:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117643.112628:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8788a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593121024:0@lo:400:kworker.0 00000100:00100000:0.0:1789117643.112653:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117643.112669:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593121536:0@lo:400:kworker.0 00000100:00100000:0.0:1789117643.112689:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117643.112710:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789117643.112716:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87889e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593120384:0@lo:400:kworker.0 00000100:00100000:0.0:1789117643.112742:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117643.112762:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a878883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593120896:0@lo:400:kworker.0 00000100:00100000:0.0:1789117643.112784:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117643.112800:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593121408:0@lo:400:kworker.0 00000100:00100000:0.0:1789117643.112821:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117643.112852:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593120384 00000100:00100000:0.0:1789117643.112857:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593120384 00000100:00100000:0.0:1789117643.112911:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789117643.112920:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593120384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117643.112977:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593120384:12345-0@lo:400:kworker.0 Request processed in 47us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117643.112984:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789117643.113007:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593120512 00000100:00100000:0.0:1789117643.113010:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593120512 00000100:00100000:0.0:1789117643.113030:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789117643.113037:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593120512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117643.113116:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593120512:12345-0@lo:400:kworker.0 Request processed in 78us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117643.113136:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789117643.113255:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593121024 00000100:00100000:1.0:1789117643.113260:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593121024 00000100:00100000:1.0:1789117643.113286:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593121536 00000100:00100000:1.0:1789117643.113289:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593121536 00000100:00100000:1.0:1789117643.113314:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593120896 00000100:00100000:1.0:1789117643.113317:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593120896 00000100:00100000:1.0:1789117643.113329:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593121408 00000100:00100000:1.0:1789117643.113332:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593121408 00000100:00100000:1.0:1789117643.113345:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789117643.113352:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f70780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593121024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117643.113394:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f70780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593121024:12345-0@lo:400:kworker.0 Request processed in 43us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117643.113401:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789117643.113412:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789117643.113417:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f71680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593121536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117643.113440:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f71680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593121536:12345-0@lo:400:kworker.0 Request processed in 23us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117643.113457:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789117643.113467:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789117643.113473:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593120896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117643.113498:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593120896:12345-0@lo:400:kworker.0 Request processed in 26us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117643.113504:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789117643.113513:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789117643.113518:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593121408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117643.113540:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593121408:12345-0@lo:400:kworker.0 Request processed in 22us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117643.113547:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1789117643.113564:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789117643.113649:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87889e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593120384:0@lo:400:kworker.0 00010000:00080000:1.0:1789117643.113664:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a878883c0 x1876025593120896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117643.113676:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a878883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593120896:0@lo:400:kworker.0 00010000:00080000:1.0:1789117643.113686:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87888000 x1876025593121408/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117643.113694:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593121408:0@lo:400:kworker.0 00000100:00100000:1.0:1789117643.113704:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8788b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593120512:0@lo:400:kworker.0 00010000:00080000:1.0:1789117643.113712:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a8788a580 x1876025593121024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117643.113721:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8788a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593121024:0@lo:400:kworker.0 00010000:00080000:1.0:1789117643.113742:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a4b0c0 x1876025593121536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117643.113751:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593121536:0@lo:400:kworker.0 00000100:00100000:3.0:1789117643.114672:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593120000 00000100:00100000:3.0:1789117643.114684:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593120000 00000100:00100000:3.0:1789117643.114740:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789117643.114751:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593120000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117643.114846:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593120000:12345-0@lo:400:kworker.0 Request processed in 98us (2321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117643.114854:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789117643.116362:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf83f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593120000:0@lo:400:kworker.0 00000100:00100000:2.0:1789117643.621586:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789117643.621620:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593121792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789117643.621718:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117643.621953:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593121792 00000100:00100000:1.0:1789117643.621965:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593121792 00000100:00100000:1.0:1789117643.622042:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789117643.622087:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593121792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789117643.622132:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117643.622190:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593121792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 139us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117643.622198:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1789117643.622478:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf6eed00 x1876025593121792/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117659 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117643.622501:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593121792:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789117643.628322:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593121920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117643.628439:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117643.632980:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593121920 00000100:00100000:2.0:1789117643.633004:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593121920 00000100:00100000:2.0:1789117643.633981:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789117643.633998:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593121920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789117643.634081:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117643.634217:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593121920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 223us (5777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117643.634225:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1789117643.634335:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f70b40 x1876025593121920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117659 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117643.634362:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593121920:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789117643.750358:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117644.143881:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117644.143930:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117644.143968:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117644.144000:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572075520 00000100:00100000:0.0:1789117644.144011:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572075520 00000100:00100000:0.0:1789117644.144103:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572075392 00000100:00100000:0.0:1789117644.144106:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572075392 00000100:00100000:0.0:1789117644.144133:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 123 00000100:00100000:1.0:1789117644.144262:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 124 00000100:00100000:1.0:1789117644.144274:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572075392:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117644.144360:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572075392:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 90us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117644.144368:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 124 00000100:00100000:0.0:1789117644.144506:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572075520:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117644.144551:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572075520:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 409us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117644.144558:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 123 00000100:00080000:0.0:1789117644.144588:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789117644.144592:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789117644.144901:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572075264 00000100:00100000:2.0:1789117644.144907:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572075264 00000100:00100000:2.0:1789117644.144957:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 288 00000100:00100000:2.0:1789117644.144966:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2406:x1876025572075264:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117644.145007:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2406:x1876025572075264:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 41us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117644.145014:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 288 00000001:02000400:2.0:1789117644.202311:0:11321:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.140 00010000:00010000:1.0:1789117644.773661:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117645.671283:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117645.671323:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8841a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593122048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789117645.671436:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117645.673700:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593122048 00000100:00100000:1.0:1789117645.673716:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593122048 00000100:00100000:1.0:1789117645.673787:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789117645.673799:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593122048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789117645.673855:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789117645.674046:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8841a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593122048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789117645.674129:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593122048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 330us (2691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117645.674145:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00010000:0.0:1789117645.800255:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789117646.463878:0:11370:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 11 05:07:24 EDT 2026 00010000:00010000:3.0:1789117646.821228:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117647.717235:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789117647.717259:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593122176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117647.717339:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117647.717597:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117647.717607:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8841a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593122304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789117647.717668:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117647.717920:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593122176 00000100:00100000:3.0:1789117647.717929:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593122176 00000100:00100000:3.0:1789117647.718003:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593122304 00000100:00100000:3.0:1789117647.718007:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593122304 00000100:00100000:3.0:1789117647.718026:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789117647.718035:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f72940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593122176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789117647.718094:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117647.718158:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f72940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593122176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117647.718165:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789117647.718182:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789117647.718187:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593122304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789117647.718196:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117647.718222:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593122304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117647.718228:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1789117647.718263:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a8841a580 x1876025593122304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117647.718282:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8841a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593122304:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789117647.718348:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789117647.718904:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f703c0 x1876025593122176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117647.718930:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593122176:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789117647.850769:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117648.229419:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593122688:0@lo:400:kworker.0 00000100:00100000:2.0:1789117648.229555:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117648.229625:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593123200:0@lo:400:kworker.0 00000100:00100000:2.0:1789117648.229683:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117648.229710:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593123712:0@lo:400:kworker.0 00000100:00100000:2.0:1789117648.229751:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117648.229798:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789117648.229806:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593122816:0@lo:400:kworker.0 00000100:00100000:2.0:1789117648.229831:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117648.229850:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593123328:0@lo:400:kworker.0 00000100:00100000:2.0:1789117648.229875:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117648.229889:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593123840:0@lo:400:kworker.0 00000100:00100000:2.0:1789117648.229908:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117648.229941:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593123200 00000100:00100000:2.0:1789117648.229949:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593123200 00000100:00100000:2.0:1789117648.230003:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593123712 00000100:00100000:2.0:1789117648.230007:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593123712 00000100:00100000:2.0:1789117648.230024:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593122816 00000100:00100000:2.0:1789117648.230027:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593122816 00000100:00100000:2.0:1789117648.230043:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789117648.230050:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593123200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117648.230123:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593123200:12345-0@lo:400:kworker.0 Request processed in 73us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117648.230130:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789117648.230147:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789117648.230152:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593123712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117648.230174:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593123712:12345-0@lo:400:kworker.0 Request processed in 23us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117648.230180:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789117648.230189:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789117648.230193:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593122816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117648.230212:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593122816:12345-0@lo:400:kworker.0 Request processed in 19us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117648.230225:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789117648.230264:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593122816:0@lo:400:kworker.0 00010000:00080000:2.0:1789117648.230275:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a48f00 x1876025593123200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117648.230284:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593123200:0@lo:400:kworker.0 00010000:00080000:2.0:1789117648.230292:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a4a580 x1876025593123712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117648.230299:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593123712:0@lo:400:kworker.0 00000100:00100000:1.0:1789117648.230813:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593122432:0@lo:400:kworker.0 00000100:00100000:1.0:1789117648.230855:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117648.230890:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593122944:0@lo:400:kworker.0 00000100:00100000:1.0:1789117648.230915:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117648.230931:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593122688 00000100:00100000:1.0:1789117648.230931:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593123456:0@lo:400:kworker.0 00000100:00100000:3.0:1789117648.230936:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593122688 00000100:00100000:1.0:1789117648.230953:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117648.230957:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593122944 00000100:00100000:3.0:1789117648.230959:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593122944 00000100:00100000:1.0:1789117648.230970:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593123968:0@lo:400:kworker.0 00000100:00100000:1.0:1789117648.230991:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117648.231010:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1789117648.231016:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593122560:0@lo:400:kworker.0 00000100:00100000:1.0:1789117648.231036:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117648.231038:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789117648.231046:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593122688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117648.231073:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593123072:0@lo:400:kworker.0 00000100:00100000:1.0:1789117648.231094:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117648.231110:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593123584:0@lo:400:kworker.0 00000100:00100000:3.0:1789117648.231115:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593122688:12345-0@lo:400:kworker.0 Request processed in 70us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117648.231122:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789117648.231129:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117648.231137:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789117648.231143:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae5dc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593122944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117648.231144:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8841a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593124096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789117648.231167:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae5dc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593122944:12345-0@lo:400:kworker.0 Request processed in 25us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117648.231173:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789117648.231191:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117648.231216:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593122944:0@lo:400:kworker.0 00000100:00100000:1.0:1789117648.231241:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593124096 00000100:00100000:1.0:1789117648.231244:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593124096 00000100:00100000:1.0:1789117648.231261:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789117648.231266:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593124096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789117648.231289:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789117648.231336:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593124096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117648.231342:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789117648.231357:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593122560 00000100:00100000:1.0:1789117648.231360:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593122560 00000100:00100000:1.0:1789117648.231373:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593123072 00000100:00100000:1.0:1789117648.231375:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593123072 00000100:00100000:1.0:1789117648.231387:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593123584 00000100:00100000:1.0:1789117648.231389:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593123584 00000100:00100000:1.0:1789117648.231402:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789117648.231407:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593122560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117648.231435:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593122560:12345-0@lo:400:kworker.0 Request processed in 28us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117648.231441:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789117648.231451:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789117648.231457:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8788a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593123072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117648.231481:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8788a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593123072:12345-0@lo:400:kworker.0 Request processed in 25us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117648.231498:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789117648.231509:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789117648.231514:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8788b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593123584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117648.231523:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593122432 00000100:00100000:0.0:1789117648.231527:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593122432 00000100:00100000:1.0:1789117648.231547:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8788b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593123584:12345-0@lo:400:kworker.0 Request processed in 33us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117648.231553:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789117648.231554:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1789117648.231560:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593122432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117648.231570:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593123328 00000100:00100000:1.0:1789117648.231573:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593123328 00000100:00100000:1.0:1789117648.231588:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593123840 00000100:00100000:1.0:1789117648.231590:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593123840 00000100:00100000:1.0:1789117648.231602:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593123456 00000100:00100000:0.0:1789117648.231602:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593122432:12345-0@lo:400:kworker.0 Request processed in 32us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117648.231608:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789117648.231616:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593123456 00000100:00100000:1.0:1789117648.231628:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593123968 00000100:00100000:1.0:1789117648.231631:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593123968 00000100:00100000:1.0:1789117648.231643:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789117648.231649:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593123328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117648.231692:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593123328:12345-0@lo:400:kworker.0 Request processed in 43us (1816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117648.231698:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789117648.231710:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789117648.231716:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593123840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117648.231742:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593123840:12345-0@lo:400:kworker.0 Request processed in 27us (1834us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117648.231748:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789117648.231758:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789117648.231764:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6eed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593123456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117648.231791:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6eed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593123456:12345-0@lo:400:kworker.0 Request processed in 27us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117648.231796:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789117648.231806:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789117648.231818:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593123968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117648.231851:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593123968:12345-0@lo:400:kworker.0 Request processed in 34us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117648.231857:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1789117648.231876:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789117648.231880:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789117648.231882:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789117648.231884:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a483c0 x1876025593123328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117648.231897:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593123328:0@lo:400:kworker.0 00010000:00080000:2.0:1789117648.231910:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a4bc00 x1876025593123840/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117648.231918:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593123840:0@lo:400:kworker.0 00000100:00100000:2.0:1789117648.231928:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593122688:0@lo:400:kworker.0 00000100:00100000:1.0:1789117648.231929:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593122560:0@lo:400:kworker.0 00000100:00100000:1.0:1789117648.231937:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593123072:0@lo:400:kworker.0 00000100:00100000:1.0:1789117648.231945:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593123584:0@lo:400:kworker.0 00000100:00100000:1.0:1789117648.231958:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8841a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593124096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117648.231966:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593122432:0@lo:400:kworker.0 00010000:00080000:1.0:1789117648.231975:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a48000 x1876025593123456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117648.231983:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593123456:0@lo:400:kworker.0 00010000:00080000:1.0:1789117648.231991:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a492c0 x1876025593123968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117648.231999:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593123968:0@lo:400:kworker.0 00000100:00100000:2.0:1789117648.741437:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a878883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593124224:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789117648.741527:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117648.741935:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593124224 00000100:00100000:3.0:1789117648.741944:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593124224 00000100:00100000:3.0:1789117648.742008:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789117648.742018:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593124224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789117648.742048:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117648.742135:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593124224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117648.742142:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1789117648.742279:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a878883c0 x1876025593124224/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117648.742311:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a878883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593124224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789117648.742927:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117648.742963:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593124352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117648.743005:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117648.743160:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593124352 00000100:00100000:2.0:1789117648.743167:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593124352 00000100:00100000:2.0:1789117648.743208:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789117648.743216:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a878883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593124352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789117648.743233:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117648.743287:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a878883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593124352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117648.743303:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1789117648.743489:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e1c3c0 x1876025593124352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117648.743504:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593124352:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789117648.869319:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117649.262630:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117649.263137:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117649.263176:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117649.263221:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572075776 00000100:00100000:1.0:1789117649.263237:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572075776 00000100:00100000:1.0:1789117649.263322:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572075904 00000100:00100000:1.0:1789117649.263325:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572075904 00000100:00100000:1.0:1789117649.263354:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 131 00000100:00100000:1.0:1789117649.263366:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87889e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572075776:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117649.263479:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87889e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572075776:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 115us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117649.263487:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 131 00000100:00100000:1.0:1789117649.263505:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 132 00000100:00100000:1.0:1789117649.263513:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87888780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572075904:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117649.263615:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87888780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572075904:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 103us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117649.263622:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 132 00000100:00080000:1.0:1789117649.263640:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789117649.263644:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117649.267724:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572075648 00000100:00100000:2.0:1789117649.267742:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572075648 00000100:00100000:2.0:1789117649.267809:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 290 00000100:00100000:2.0:1789117649.267821:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2407:x1876025572075648:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117649.267914:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2407:x1876025572075648:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 95us (5295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117649.267922:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 290 00010000:00010000:1.0:1789117649.894049:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117650.789366:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88419680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593124480:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789117650.789527:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117650.795695:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593124480 00000100:00100000:0.0:1789117650.795711:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593124480 00000100:00100000:0.0:1789117650.795786:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789117650.795797:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87888b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593124480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789117650.795836:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789117650.796000:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87888b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593124480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 204us (6472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117650.796008:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789117650.796523:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88419680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593124480:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789117650.917532:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117651.943986:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117652.837428:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f73c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593124608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117652.837513:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117652.837755:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593124608 00000100:00100000:3.0:1789117652.837764:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593124608 00000100:00100000:3.0:1789117652.837821:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789117652.837833:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593124608:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117652.838001:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e1fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593124736:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789117652.838033:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117652.838095:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593124736 00000100:00100000:2.0:1789117652.838099:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593124736 00000100:00100000:2.0:1789117652.838122:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789117652.838129:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593124736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789117652.838144:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117652.838192:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593124736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117652.838200:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1789117652.838237:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e1fc00 x1876025593124736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117652.838256:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e1fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593124736:0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789117652.838414:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789117652.839848:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789117652.840091:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593124608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2256us (2573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117652.840103:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1789117652.840204:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f73c00 x1876025593124608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117652.840226:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f73c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593124608:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789117652.965209:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117653.351383:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593125248:0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.351464:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117653.351518:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf775680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593125760:0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.351540:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117653.351568:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789117653.351574:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593124864:0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.351600:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117653.351622:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593125376:0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.351646:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117653.351662:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf776d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593125888:0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.351683:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117653.351705:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593124992:0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.351726:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117653.351742:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593125504:0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.351761:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117653.351773:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf776940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593126016:0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.351793:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117653.351828:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789117653.351834:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593125120:0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.351855:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117653.351872:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593125632:0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.351892:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117653.351902:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf774780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593126144:0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.351920:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117653.351950:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593125248 00000100:00100000:1.0:1789117653.351957:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593125248 00000100:00100000:1.0:1789117653.351991:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593125760 00000100:00100000:1.0:1789117653.351993:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593125760 00000100:00100000:1.0:1789117653.352017:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593125888 00000100:00100000:1.0:1789117653.352019:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593125888 00000100:00100000:1.0:1789117653.352030:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593124992 00000100:00100000:1.0:1789117653.352032:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593124992 00000100:00100000:1.0:1789117653.352041:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593125504 00000100:00100000:1.0:1789117653.352043:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593125504 00000100:00100000:1.0:1789117653.352077:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593125632 00000100:00100000:1.0:1789117653.352080:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593125632 00000100:00100000:1.0:1789117653.352099:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789117653.352107:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf774f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593125248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.352165:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf774f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593125248:12345-0@lo:400:kworker.0 Request processed in 58us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117653.352172:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789117653.352191:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789117653.352197:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593125760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.352225:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593125760:12345-0@lo:400:kworker.0 Request processed in 28us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117653.352231:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789117653.352250:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789117653.352256:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593125888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.352286:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593125888:12345-0@lo:400:kworker.0 Request processed in 30us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117653.352292:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789117653.352303:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789117653.352309:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593124992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.352343:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593124992:12345-0@lo:400:kworker.0 Request processed in 34us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117653.352348:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789117653.352361:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789117653.352366:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593125504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.352404:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593125504:12345-0@lo:400:kworker.0 Request processed in 37us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117653.352410:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789117653.352421:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789117653.352427:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593125632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.352455:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593125632:12345-0@lo:400:kworker.0 Request processed in 28us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117653.352460:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789117653.352485:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593124864 00000100:00100000:1.0:1789117653.352489:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593124864 00000100:00100000:1.0:1789117653.352515:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1789117653.352521:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3646:x1876025593124864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.352550:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3646:x1876025593124864:12345-0@lo:400:kworker.0 Request processed in 29us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117653.352561:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1789117653.352590:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593125376 00000100:00100000:1.0:1789117653.352594:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593125376 00000100:00100000:1.0:1789117653.352611:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593125120 00000100:00100000:1.0:1789117653.352614:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593125120 00000100:00100000:1.0:1789117653.352626:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789117653.352631:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593125376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.352665:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593125376:12345-0@lo:400:kworker.0 Request processed in 33us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117653.352671:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789117653.352683:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789117653.352689:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593125120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.352716:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593125120:12345-0@lo:400:kworker.0 Request processed in 27us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117653.352722:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789117653.352747:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593126016 00000100:00100000:1.0:1789117653.352751:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593126016 00000100:00100000:1.0:1789117653.352773:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593126144 00000100:00100000:1.0:1789117653.352775:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593126144 00000100:00100000:2.0:1789117653.353230:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789117653.353247:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e1fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593126272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117653.353289:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117653.353326:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593126272 00000100:00100000:2.0:1789117653.353330:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593126272 00000100:00100000:2.0:1789117653.353356:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789117653.353364:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593126272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789117653.353416:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789117653.353463:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593126272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117653.353471:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789117653.353523:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e1fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593126272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117653.355046:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789117653.355083:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593126016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.355182:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593126016:12345-0@lo:400:kworker.0 Request processed in 110us (3387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117653.355189:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789117653.355212:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789117653.355219:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593126144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.355259:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593126144:12345-0@lo:400:kworker.0 Request processed in 41us (3339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117653.355267:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1789117653.355589:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789117653.355596:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789117653.355600:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117653.355688:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593125120:0@lo:400:kworker.0 00010000:00080000:1.0:1789117653.355705:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbfd15a40 x1876025593125632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117653.355715:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593125632:0@lo:400:kworker.0 00010000:00080000:1.0:1789117653.355725:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf774780 x1876025593126144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117653.355733:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf774780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593126144:0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.355745:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593124992:0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.355756:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593125504:0@lo:400:kworker.0 00010000:00080000:1.0:1789117653.355765:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf776940 x1876025593126016/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117653.355774:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf776940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593126016:0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.355820:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593124864:0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.355833:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593125376:0@lo:400:kworker.0 00010000:00080000:1.0:1789117653.355844:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf776d00 x1876025593125888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117653.355866:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf776d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593125888:0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.355880:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593125248:0@lo:400:kworker.0 00000100:00100000:1.0:1789117653.355892:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf775680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593125760:0@lo:400:kworker.0 00000100:00100000:3.0:1789117653.861280:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117653.861322:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88419680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593126400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117653.861414:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117653.861488:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593126400 00000100:00100000:3.0:1789117653.861657:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593126400 00000100:00100000:3.0:1789117653.861713:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789117653.861723:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8841a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593126400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789117653.861755:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117653.861805:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8841a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593126400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117653.861812:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1789117653.861858:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88419680 x1876025593126400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117653.861880:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88419680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593126400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789117653.862563:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593126528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117653.862606:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117653.862655:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593126528 00000100:00100000:0.0:1789117653.862660:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593126528 00000100:00100000:0.0:1789117653.862691:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789117653.862699:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593126528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789117653.862723:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117653.862757:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593126528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117653.862764:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1789117653.862796:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f70000 x1876025593126528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117653.862810:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593126528:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789117653.990212:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117654.374266:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117654.374317:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117654.374357:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117654.374404:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572076288 00000100:00100000:1.0:1789117654.374414:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572076288 00000100:00100000:1.0:1789117654.374473:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572076160 00000100:00100000:1.0:1789117654.374475:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572076160 00000100:00100000:1.0:1789117654.374496:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 139 00000100:00100000:1.0:1789117654.374506:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572076288:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117654.374577:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572076288:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 72us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117654.374586:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 139 00000100:00100000:1.0:1789117654.374602:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 140 00000100:00100000:1.0:1789117654.374608:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572076160:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117654.374637:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572076160:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 29us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117654.374642:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 140 00000100:00080000:1.0:1789117654.374664:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117654.374781:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572076032 00000100:00100000:2.0:1789117654.374786:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572076032 00000100:00100000:2.0:1789117654.374831:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 292 00000100:00100000:2.0:1789117654.374839:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2406:x1876025572076032:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117654.374875:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2406:x1876025572076032:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 38us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117654.374882:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 292 00000100:00080000:1.0:1789117654.375037:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789117655.020849:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117655.913497:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593126656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789117655.913582:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117655.913678:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593126656 00000100:00100000:0.0:1789117655.913686:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593126656 00000100:00100000:0.0:1789117655.913740:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789117655.913750:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593126656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789117655.913802:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789117655.913927:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593126656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 178us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117655.913934:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789117655.913988:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593126656:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789117656.037218:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117657.061701:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117657.960208:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789117657.960234:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593126784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789117657.960318:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117657.960384:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593126784 00000100:00100000:3.0:1789117657.960394:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593126784 00000100:00100000:3.0:1789117657.960443:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789117657.960453:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593126784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789117657.960482:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117657.960524:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593126784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117657.960531:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1789117657.960551:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789117657.960582:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88418000 x1876025593126784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117673 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117657.960599:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593126784:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789117657.961243:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117657.961256:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593126912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117657.961292:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117657.961367:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593126912 00000100:00100000:0.0:1789117657.961372:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593126912 00000100:00100000:0.0:1789117657.961414:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789117657.961421:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf776d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593126912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789117657.961434:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117657.961471:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf776d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593126912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117657.961485:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1789117657.961515:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f703c0 x1876025593126912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117673 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117657.961528:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593126912:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789117657.961568:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789117658.087308:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117658.469249:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789117658.469276:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593127040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117658.469374:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117658.469470:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593127040 00000100:00100000:2.0:1789117658.469478:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593127040 00000100:00100000:2.0:1789117658.469525:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789117658.469534:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593127040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789117658.469566:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789117658.469609:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593127040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117658.469616:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789117658.469669:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593127040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117658.470709:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f73c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593127296:0@lo:400:kworker.0 00000100:00100000:0.0:1789117658.470789:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117658.470824:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf83f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593127808:0@lo:400:kworker.0 00000100:00100000:0.0:1789117658.470847:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117658.470866:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593128320:0@lo:400:kworker.0 00000100:00100000:0.0:1789117658.470889:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117658.470914:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789117658.470920:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf83e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593127424:0@lo:400:kworker.0 00000100:00100000:0.0:1789117658.470943:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117658.470957:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593127936:0@lo:400:kworker.0 00000100:00100000:0.0:1789117658.470978:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117658.471005:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf83da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593127552:0@lo:400:kworker.0 00000100:00100000:0.0:1789117658.471030:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117658.471049:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593128064:0@lo:400:kworker.0 00000100:00100000:0.0:1789117658.471097:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117658.471111:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789117658.471116:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593127168:0@lo:400:kworker.0 00000100:00100000:0.0:1789117658.471145:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117658.471181:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf83d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593127680:0@lo:400:kworker.0 00000100:00100000:0.0:1789117658.471202:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117658.471214:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593128192:0@lo:400:kworker.0 00000100:00100000:0.0:1789117658.471232:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117658.471259:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593127552 00000100:00100000:0.0:1789117658.471265:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593127552 00000100:00100000:0.0:1789117658.471320:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789117658.471329:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593127552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117658.471376:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593127552:12345-0@lo:400:kworker.0 Request processed in 48us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117658.471383:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789117658.471422:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf83da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593127552:0@lo:400:kworker.0 00000100:00100000:1.0:1789117658.471742:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593127296 00000100:00100000:1.0:1789117658.471747:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593127296 00000100:00100000:1.0:1789117658.471779:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593127808 00000100:00100000:1.0:1789117658.471782:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593127808 00000100:00100000:1.0:1789117658.471813:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593127424 00000100:00100000:1.0:1789117658.471816:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593127424 00000100:00100000:1.0:1789117658.471826:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593127936 00000100:00100000:1.0:1789117658.471829:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593127936 00000100:00100000:1.0:1789117658.471840:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593128064 00000100:00100000:1.0:1789117658.471843:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593128064 00000100:00100000:1.0:1789117658.471856:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593127680 00000100:00100000:1.0:1789117658.471858:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593127680 00000100:00100000:1.0:1789117658.471872:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789117658.471879:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593127296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117658.471930:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593127296:12345-0@lo:400:kworker.0 Request processed in 52us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117658.471938:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789117658.471954:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789117658.471961:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593127808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117658.471991:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593127808:12345-0@lo:400:kworker.0 Request processed in 31us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117658.471997:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789117658.472008:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789117658.472014:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593127424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117658.472040:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593127424:12345-0@lo:400:kworker.0 Request processed in 26us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117658.472076:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789117658.472088:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789117658.472094:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593127936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117658.472123:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593127936:12345-0@lo:400:kworker.0 Request processed in 30us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117658.472128:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789117658.472138:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789117658.472143:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593128064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117658.472179:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593128064:12345-0@lo:400:kworker.0 Request processed in 36us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117658.472185:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789117658.472196:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789117658.472201:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593127680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117658.472227:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593127680:12345-0@lo:400:kworker.0 Request processed in 26us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117658.472234:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789117658.472260:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593128320 00000100:00100000:1.0:1789117658.472264:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593128320 00000100:00100000:1.0:1789117658.472309:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593128192 00000100:00100000:1.0:1789117658.472313:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593128192 00000100:00100000:1.0:1789117658.472335:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789117658.472341:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593128320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117658.472373:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593128320:12345-0@lo:400:kworker.0 Request processed in 32us (1483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117658.472379:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789117658.472399:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789117658.472405:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593128192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117658.472433:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593128192:12345-0@lo:400:kworker.0 Request processed in 29us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117658.472439:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1789117658.472681:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789117658.472687:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789117658.472690:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789117658.472919:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593127168 00000100:00100000:1.0:1789117658.472923:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593127168 00000100:00100000:1.0:1789117658.472963:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1789117658.472969:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593127168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117658.473004:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593127168:12345-0@lo:400:kworker.0 Request processed in 35us (1858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117658.473010:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1789117658.473089:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593127168:0@lo:400:kworker.0 00000100:00100000:1.0:1789117658.473104:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf83d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593127680:0@lo:400:kworker.0 00010000:00080000:1.0:1789117658.473117:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf6ff0c0 x1876025593128192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117658.473127:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593128192:0@lo:400:kworker.0 00010000:00080000:1.0:1789117658.473136:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf6ff840 x1876025593128064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117658.473143:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593128064:0@lo:400:kworker.0 00000100:00100000:1.0:1789117658.473180:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf83e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593127424:0@lo:400:kworker.0 00000100:00100000:1.0:1789117658.473191:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593127936:0@lo:400:kworker.0 00000100:00100000:1.0:1789117658.473202:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f73c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593127296:0@lo:400:kworker.0 00010000:00080000:1.0:1789117658.473221:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf83f480 x1876025593127808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117658.473229:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf83f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593127808:0@lo:400:kworker.0 00010000:00080000:1.0:1789117658.473239:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf6fd680 x1876025593128320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117658.473246:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593128320:0@lo:400:kworker.0 00000100:00100000:3.0:1789117658.981245:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88419680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593128448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117658.981344:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117658.981429:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593128448 00000100:00100000:3.0:1789117658.981437:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593128448 00000100:00100000:3.0:1789117658.981483:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789117658.981493:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593128448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789117658.981527:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117658.981569:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593128448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117658.981577:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1789117658.981620:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88419680 x1876025593128448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117658.981638:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88419680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593128448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789117658.981788:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789117658.981798:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593128576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117658.981829:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117658.981862:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593128576 00000100:00100000:2.0:1789117658.981866:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593128576 00000100:00100000:2.0:1789117658.981891:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789117658.981898:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593128576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789117658.981908:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117658.981938:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593128576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117658.981945:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1789117658.981970:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e1da40 x1876025593128576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117658.981983:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593128576:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789117659.110676:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117659.490827:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117659.490873:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117659.490897:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117659.490925:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572076544 00000100:00100000:3.0:1789117659.490935:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572076544 00000100:00100000:3.0:1789117659.490999:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572076672 00000100:00100000:3.0:1789117659.491002:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572076672 00000100:00100000:3.0:1789117659.491029:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 147 00000100:00100000:3.0:1789117659.491039:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88419680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2404:x1876025572076544:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117659.491140:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88419680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2404:x1876025572076544:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 101us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117659.491147:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 147 00000100:00100000:3.0:1789117659.491167:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 148 00000100:00100000:3.0:1789117659.491192:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8841a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2404:x1876025572076672:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117659.491218:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8841a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2404:x1876025572076672:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 29us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117659.491224:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 148 00000100:00100000:3.0:1789117659.491244:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572076416 00000100:00100000:3.0:1789117659.491248:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572076416 00000100:00100000:3.0:1789117659.491288:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 294 00000100:00100000:3.0:1789117659.491294:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2404:x1876025572076416:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117659.491321:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2404:x1876025572076416:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 28us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117659.491328:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 294 00000100:00080000:3.0:1789117659.491360:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789117659.491365:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789117660.133527:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117661.030508:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789117661.030534:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593128704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789117661.030611:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117661.030746:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593128704 00000100:00100000:2.0:1789117661.030754:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593128704 00000100:00100000:2.0:1789117661.030806:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789117661.030832:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf774780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593128704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789117661.030866:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789117661.030914:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf774780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593128704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117661.030921:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789117661.030973:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593128704:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789117661.162355:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117662.181314:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117663.077334:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b989cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593128832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789117663.077366:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593128960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117663.077420:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117663.077529:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117663.077571:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593128832 00000100:00100000:0.0:1789117663.077585:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593128832 00000100:00100000:1.0:1789117663.077610:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593128960 00000100:00100000:1.0:1789117663.077616:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593128960 00000100:00100000:0.0:1789117663.077649:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789117663.077665:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf776940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593128832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789117663.077697:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117663.077748:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf776940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593128832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117663.078534:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1789117663.078536:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789117663.078551:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593128960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789117663.078569:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1789117663.078601:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b989cf480 x1876025593128832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117679 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117663.078613:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593128960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117663.078622:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789117663.078625:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b989cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593128832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789117663.078703:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1789117663.080313:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf6ff0c0 x1876025593128960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117679 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117663.080346:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593128960:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789117663.206428:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117663.589962:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593129088:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789117663.590114:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117663.590529:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593129088 00000100:00100000:2.0:1789117663.590539:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593129088 00000100:00100000:2.0:1789117663.590599:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789117663.590610:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593129088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789117663.590645:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789117663.590702:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593129088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117663.590711:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789117663.590763:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593129088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117663.590877:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593129216:0@lo:400:kworker.0 00000100:00100000:2.0:1789117663.590912:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117663.590929:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593129344:0@lo:400:kworker.0 00000100:00100000:2.0:1789117663.590941:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf83f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593129728:0@lo:400:kworker.0 00000100:00100000:2.0:1789117663.590959:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117663.591014:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593130240:0@lo:400:kworker.0 00000100:00100000:2.0:1789117663.591041:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117663.591082:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789117663.591088:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593129600:0@lo:400:kworker.0 00000100:00100000:2.0:1789117663.591111:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117663.591125:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf83da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593130112:0@lo:400:kworker.0 00000100:00100000:2.0:1789117663.591146:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117663.591170:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593129472:0@lo:400:kworker.0 00000100:00100000:2.0:1789117663.591209:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117663.591234:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf83d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876025593129984:0@lo:400:kworker.0 00000100:00100000:2.0:1789117663.591260:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117663.591297:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593129216 00000100:00100000:2.0:1789117663.591302:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593129216 00000100:00100000:2.0:1789117663.591333:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789117663.591340:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba1a92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593129216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117663.591377:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba1a92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593129216:12345-0@lo:400:kworker.0 Request processed in 37us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117663.591384:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1789117663.591432:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593129728 00000100:00100000:0.0:1789117663.591445:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593129728 00000100:00100000:0.0:1789117663.591480:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593130112 00000100:00100000:0.0:1789117663.591483:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593130112 00000100:00100000:2.0:1789117663.591494:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593130240 00000100:00100000:0.0:1789117663.591496:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593129472 00000100:00100000:2.0:1789117663.591498:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593130240 00000100:00100000:0.0:1789117663.591498:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593129472 00000100:00100000:0.0:1789117663.591507:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593129984 00000100:00100000:0.0:1789117663.591509:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593129984 00000100:00100000:0.0:1789117663.591523:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789117663.591524:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789117663.591530:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593130240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117663.591563:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593130240:12345-0@lo:400:kworker.0 Request processed in 33us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117663.591570:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789117663.591589:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789117663.591593:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593129728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117663.591602:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593130112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117663.591700:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593130112:12345-0@lo:400:kworker.0 Request processed in 97us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117663.591700:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593129728:12345-0@lo:400:kworker.0 Request processed in 170us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117663.591707:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789117663.591756:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593129600 00000100:00100000:3.0:1789117663.591760:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593129600 00000100:00100000:3.0:1789117663.591782:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789117663.591788:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593129600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117663.591822:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593129600:12345-0@lo:400:kworker.0 Request processed in 34us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117663.591835:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:1.0:1789117663.598441:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789117663.598457:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789117663.598462:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117663.599934:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789117663.600504:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789117663.600528:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593129472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117663.600691:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593129472:12345-0@lo:400:kworker.0 Request processed in 177us (9481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117663.600699:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789117663.600717:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789117663.600726:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876025593129984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117663.600757:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876025593129984:12345-0@lo:400:kworker.0 Request processed in 33us (9495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117663.600763:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789117663.600870:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593129600:0@lo:400:kworker.0 00010000:00080000:2.0:1789117663.600890:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf83da40 x1876025593130112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117663.600903:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf83da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593130112:0@lo:400:kworker.0 00000100:00100000:2.0:1789117663.600919:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf83f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593129728:0@lo:400:kworker.0 00010000:00080000:2.0:1789117663.600932:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87faa940 x1876025593130240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117663.600941:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593130240:0@lo:400:kworker.0 00000100:00100000:2.0:1789117663.600955:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593129216:0@lo:400:kworker.0 00000100:00100000:1.0:1789117663.601070:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593129472:0@lo:400:kworker.0 00000100:00100000:2.0:1789117663.601072:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117663.601085:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf83d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876025593129984:0@lo:400:kworker.0 00000100:00100000:2.0:1789117663.601110:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf83e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593129856:0@lo:400:kworker.0 00000100:00100000:2.0:1789117663.601146:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117663.601174:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593130368:0@lo:400:kworker.0 00000100:00100000:2.0:1789117663.601210:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117663.601215:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593129344 00000100:00100000:1.0:1789117663.601220:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593129344 00000100:00100000:2.0:1789117663.601243:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593130368 00000100:00100000:2.0:1789117663.601246:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593130368 00000100:00100000:1.0:1789117663.601253:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593129856 00000100:00100000:1.0:1789117663.601255:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593129856 00000100:00100000:1.0:1789117663.601272:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789117663.601278:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593129344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117663.601283:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789117663.601288:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593130368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117663.601367:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789117663.601424:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593129856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117663.601516:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593130368:12345-0@lo:400:kworker.0 Request processed in 228us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117663.601523:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1789117663.601539:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789117663.601543:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117663.601567:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593129344:0@lo:400:kworker.0 00010000:00080000:2.0:1789117663.601576:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87fab480 x1876025593130368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117663.601584:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593130368:0@lo:400:kworker.0 00000100:00100000:1.0:1789117663.601743:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593129344:12345-0@lo:400:kworker.0 Request processed in 462us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117663.601750:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789117663.602339:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593129856:12345-0@lo:400:kworker.0 Request processed in 962us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117663.602346:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00010000:00080000:3.0:1789117663.604855:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf83e580 x1876025593129856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117663.604877:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf83e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593129856:0@lo:400:kworker.0 00000100:00100000:1.0:1789117664.101340:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593130496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117664.101436:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117664.101633:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593130496 00000100:00100000:2.0:1789117664.101643:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593130496 00000100:00100000:2.0:1789117664.101711:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789117664.101723:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf775680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593130496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789117664.101777:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117664.101837:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf775680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593130496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117664.101846:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:0.0:1789117664.101939:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a4b480 x1876025593130496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117664.101963:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593130496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117664.102372:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f73c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593130624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117664.102415:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117664.102498:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593130624 00000100:00100000:0.0:1789117664.102502:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593130624 00000100:00100000:0.0:1789117664.102543:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789117664.102551:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593130624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789117664.102565:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117664.102613:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593130624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117664.102620:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1789117664.102697:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f73c00 x1876025593130624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117664.102711:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f73c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593130624:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789117664.234224:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789117664.410784:0:11999:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 05:07:43 (1789117663) === 00000100:00100000:1.0:1789117664.611424:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117664.611467:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117664.611497:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117664.611553:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572077056 00000100:00100000:2.0:1789117664.611563:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572077056 00000100:00100000:2.0:1789117664.611632:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572076928 00000100:00100000:2.0:1789117664.611636:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572076928 00000100:00100000:2.0:1789117664.611677:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 155 00000100:00100000:2.0:1789117664.611688:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572077056:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117664.611774:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572077056:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 88us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117664.611781:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 155 00000100:00100000:2.0:1789117664.611798:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 156 00000100:00100000:2.0:1789117664.611804:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2407:x1876025572076928:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117664.611829:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2407:x1876025572076928:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 25us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117664.611834:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 156 00000100:00080000:1.0:1789117664.612231:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789117664.612236:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789117664.612365:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572076800 00000100:00100000:3.0:1789117664.612371:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572076800 00000100:00100000:3.0:1789117664.612411:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 296 00000100:00100000:3.0:1789117664.612419:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba1a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2407:x1876025572076800:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117664.612461:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba1a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2407:x1876025572076800:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 43us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117664.612470:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 296 00000100:00100000:1.0:1789117664.882538:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117664.882729:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572077184 00000100:00100000:2.0:1789117664.882743:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572077184 00000100:00100000:2.0:1789117664.882815:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 297 00000100:00100000:2.0:1789117664.882826:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba1a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+10:8726:x1876025572077184:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789117664.882851:0:9525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117664.882895:0:9525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b89b68600/0xaa253ed19be1fa1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ed46 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117664.882939:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b89b68600/0xaa253ed19be1fa1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed46 expref: 11 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117664.882953:0:9525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b89b68600/0xaa253ed19be1fa1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed46 expref: 11 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117664.882964:0:9525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b68600, rc 0) 00000100:00100000:2.0:1789117664.884466:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba1a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+11:8726:x1876025572077184:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 1625us (1935us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117664.884481:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 297 00000100:00100000:0.0:1789117664.896518:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117664.897004:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572077312 00000100:00100000:3.0:1789117664.897027:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572077312 00000100:00100000:2.0:1789117664.899862:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 298 00000100:00100000:2.0:1789117664.899896:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90434450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+11:8726:x1876025572077312:12345-192.168.204.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789117664.900274:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90434450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+11:8726:x1876025572077312:12345-192.168.204.30@tcp:501:mount.lustre.0 Request processed in 394us (3768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117664.900587:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 298 00000100:00100000:0.0:1789117664.908952:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117664.909507:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572077440 00000100:00100000:1.0:1789117664.909527:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572077440 00000100:00100000:1.0:1789117664.909644:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 299 00000100:00100000:1.0:1789117664.909659:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+11:8726:x1876025572077440:12345-192.168.204.30@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789117664.909888:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+11:8726:x1876025572077440:12345-192.168.204.30@tcp:503:mount.lustre.0 Request processed in 231us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117664.909899:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 299 00000100:00100000:1.0:1789117664.920885:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117664.921816:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572077568 00000100:00100000:3.0:1789117664.921834:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572077568 00000100:00100000:3.0:1789117664.921979:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 300 00000100:00100000:3.0:1789117664.921992:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+11:8730:x1876025572077568:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789117664.922375:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+11:8730:x1876025572077568:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 384us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117664.922385:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 300 00000100:00100000:0.0:1789117664.972943:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117664.974189:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572077696 00000100:00100000:2.0:1789117664.974207:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572077696 00000100:00100000:2.0:1789117664.974756:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 301 00000100:00100000:2.0:1789117664.974773:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90434050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+11:8730:x1876025572077696:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789117664.976194:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90434050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+11:8730:x1876025572077696:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 1412us (3258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117664.976215:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 301 00000100:00100000:0.0:1789117664.982207:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117664.982909:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572077824 00000100:00100000:2.0:1789117664.982944:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572077824 00000100:00100000:2.0:1789117664.983008:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 302 00000100:00100000:2.0:1789117664.983019:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90436450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+11:8730:x1876025572077824:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789117664.983271:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90436450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+11:8730:x1876025572077824:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 252us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117664.983288:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 302 00000100:00100000:2.0:1789117664.991999:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117664.992468:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572077952 00000100:00100000:1.0:1789117664.992483:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572077952 00000100:00100000:1.0:1789117664.992568:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 303 00000100:00100000:1.0:1789117664.992582:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90436050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+11:8726:x1876025572077952:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789117664.992607:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117664.992635:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbf70cc00/0xaa253ed19be1fa22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ed77 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117664.992753:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbf70cc00/0xaa253ed19be1fa22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed77 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117664.992767:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbf70cc00/0xaa253ed19be1fa22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed77 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117664.992778:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70cc00, rc 0) 00000100:00100000:1.0:1789117664.992875:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90436050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+12:8726:x1876025572077952:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 296us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117664.992885:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 303 00000100:00100000:0.0:1789117664.998670:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117664.999003:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572078080 00000100:00100000:2.0:1789117664.999018:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572078080 00000100:00100000:2.0:1789117664.999139:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 304 00000100:00100000:2.0:1789117664.999154:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90434c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+12:8726:x1876025572078080:12345-192.168.204.30@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789117664.999555:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789117664.999585:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789117664.999591:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789117664.999594:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789117664.999597:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789117664.999599:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789117665.004101:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90434c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+12:8726:x1876025572078080:12345-192.168.204.30@tcp:256:mount.lustre.0 Request processed in 4898us (5409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117665.004128:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 304 00000100:00100000:1.0:1789117665.011345:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117665.011598:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572078208 00000100:00100000:0.0:1789117665.011621:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572078208 00000100:00100000:0.0:1789117665.011709:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 305 00000100:00100000:0.0:1789117665.011722:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+12:8726:x1876025572078208:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789117665.011747:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117665.011774:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813daa00/0xaa253ed19be1fa29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ed7e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117665.011823:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813daa00/0xaa253ed19be1fa29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed7e expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117665.011837:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813daa00/0xaa253ed19be1fa29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed7e expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117665.011849:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813daa00, rc 0) 00000100:00100000:0.0:1789117665.011938:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:8726:x1876025572078208:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 218us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117665.011946:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 305 00000100:00100000:1.0:1789117665.015762:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117665.016576:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572078336 00000100:00100000:3.0:1789117665.016592:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572078336 00000100:00100000:3.0:1789117665.016688:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 306 00000100:00100000:3.0:1789117665.016702:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90437c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+13:8726:x1876025572078336:12345-192.168.204.30@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789117665.019485:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90437c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+13:8726:x1876025572078336:12345-192.168.204.30@tcp:501:mount.lustre.0 Request processed in 284us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117665.019510:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 306 00000100:00100000:0.0:1789117665.025881:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117665.026590:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572078464 00000100:00100000:1.0:1789117665.026618:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572078464 00000100:00100000:1.0:1789117665.026741:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 307 00000100:00100000:1.0:1789117665.026775:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:8726:x1876025572078464:12345-192.168.204.30@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789117665.027247:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:8726:x1876025572078464:12345-192.168.204.30@tcp:503:mount.lustre.0 Request processed in 472us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117665.027258:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 307 00000100:00100000:1.0:1789117665.058099:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117665.058149:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572078592 00000100:00100000:0.0:1789117665.058160:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572078592 00000100:00100000:0.0:1789117665.058245:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 308 00000100:00100000:0.0:1789117665.058255:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90437050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:8734:x1876025572078592:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789117665.058420:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90437050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:8734:x1876025572078592:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 166us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117665.058437:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 308 00000100:00100000:3.0:1789117665.072139:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117665.073013:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572078720 00000100:00100000:1.0:1789117665.073027:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572078720 00000100:00100000:1.0:1789117665.073127:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 309 00000100:00100000:1.0:1789117665.073138:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:8734:x1876025572078720:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789117665.073338:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:8734:x1876025572078720:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 201us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117665.073348:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 309 00000100:00100000:1.0:1789117665.092437:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117665.092493:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117665.092529:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117665.092561:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117665.092667:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572078848 00000100:00100000:3.0:1789117665.092681:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572078848 00000100:00100000:3.0:1789117665.092732:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572079104 00000100:00100000:3.0:1789117665.092736:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572079104 00000100:00100000:3.0:1789117665.092743:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572079616 00000100:00100000:3.0:1789117665.092746:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572079616 00000100:00100000:3.0:1789117665.092768:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572079488 00000100:00100000:3.0:1789117665.092770:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572079488 00000100:00100000:3.0:1789117665.092785:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 157 00000100:00100000:3.0:1789117665.092792:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572079616:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117665.092891:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572079616:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 99us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117665.092898:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 157 00000100:00100000:3.0:1789117665.092918:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 158 00000100:00100000:3.0:1789117665.092924:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2407:x1876025572079488:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117665.092949:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2407:x1876025572079488:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 25us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117665.092955:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 158 00000100:00100000:3.0:1789117665.092967:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:3.0:1789117665.092988:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1876025572078848:12345-192.168.204.30@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789117665.093016:0:9533:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 100c793d-0063-4934-90f0-b04fc41ff903@192.168.204.30@tcp t0 exp 0000000000000000 cur 317 last 0 00000020:00000080:3.0:1789117665.093090:0:9533:0:(genops.c:1385:class_connect()) connect: client 100c793d-0063-4934-90f0-b04fc41ff903, cookie 0xaa253ed19be1fa30 00000004:00100000:3.0:1789117665.093118:0:9533:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789117665.093276:0:9533:0:(import.c:65:import_set_state_nolock()) ffff962a87eb0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789117665.093310:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+6:2403:x1876025572078848:12345-192.168.204.30@tcp:38:mount.lustre.0 Request processed in 320us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117665.093317:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:3.0:1789117665.093329:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:3.0:1789117665.093333:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1876025572079104:12345-192.168.204.30@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789117665.093398:0:9533:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 100c793d-0063-4934-90f0-b04fc41ff903@192.168.204.30@tcp t0 exp 0000000000000000 cur 317 last 0 00000020:00000080:3.0:1789117665.093421:0:9533:0:(genops.c:1385:class_connect()) connect: client 100c793d-0063-4934-90f0-b04fc41ff903, cookie 0xaa253ed19be1fa37 00000004:00100000:3.0:1789117665.093435:0:9533:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789117665.093498:0:9533:0:(import.c:65:import_set_state_nolock()) ffff962a87eb3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789117665.093521:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+6:2403:x1876025572079104:12345-192.168.204.30@tcp:38:mount.lustre.0 Request processed in 186us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117665.093527:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:3.0:1789117665.104312:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117665.104414:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117665.111147:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117665.112592:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572079360 00000100:00100000:2.0:1789117665.112609:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572079360 00000100:00100000:2.0:1789117665.112772:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572079232 00000100:00100000:2.0:1789117665.112776:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572079232 00000100:00080000:1.0:1789117665.114407:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789117665.114423:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117665.118694:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572078976 00000100:00100000:1.0:1789117665.118721:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572078976 00000100:00100000:1.0:1789117665.118789:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:1.0:1789117665.118799:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+7:8726:x1876025572079360:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789117665.118849:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789117665.118967:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+7:8726:x1876025572079360:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 168us (14665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117665.118976:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:1.0:1789117665.119016:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:1.0:1789117665.119022:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+6:0:x1876025572078976:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789117665.119035:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789117665.119084:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+6:0:x1876025572078976:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 62us (7949us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117665.119090:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:2.0:1789117665.126154:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:2.0:1789117665.126184:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+6:0:x1876025572079232:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789117665.126232:0:9533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789117665.126352:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+6:0:x1876025572079232:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 175us (21937us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117665.126509:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117665.128625:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572079744 00000100:00100000:0.0:1789117665.128638:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572079744 00000100:00100000:2.0:1789117665.140776:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:0.0:1789117665.142392:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:0.0:1789117665.142421:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+6:8726:x1876025572079744:12345-192.168.204.30@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789117665.142557:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+6:8726:x1876025572079744:12345-192.168.204.30@tcp:40:mount.lustre.0 Request processed in 150us (16049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117665.142565:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:1.0:1789117665.146576:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117665.146913:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572080128 00000100:00100000:3.0:1789117665.146931:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572080128 00000100:00100000:3.0:1789117665.147026:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:3.0:1789117665.147040:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:100c793d-0063-4934-90f0-b04fc41ff903+6:8726:x1876025572080128:12345-192.168.204.30@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789117665.147919:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:100c793d-0063-4934-90f0-b04fc41ff903+6:8726:x1876025572080128:12345-192.168.204.30@tcp:900:mount.lustre.0 Request processed in 876us (1352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117665.147953:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:1.0:1789117665.148137:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117665.148204:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117665.148414:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572079872 00000100:00100000:3.0:1789117665.148424:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572079872 00000100:00100000:3.0:1789117665.148467:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572080000 00000100:00100000:3.0:1789117665.148471:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572080000 00000100:00100000:3.0:1789117665.148499:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:3.0:1789117665.148508:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2403:x1876025572079872:12345-192.168.204.30@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789117665.148554:0:8433:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 100c793d-0063-4934-90f0-b04fc41ff903@192.168.204.30@tcp t0 exp 0000000000000000 cur 317 last 0 00000100:00100000:0.0:1789117665.148581:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:0.0:1789117665.148597:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2403:x1876025572080000:12345-192.168.204.30@tcp:8:mount.lustre.0 00000020:00000080:3.0:1789117665.148598:0:8433:0:(genops.c:1385:class_connect()) connect: client 100c793d-0063-4934-90f0-b04fc41ff903, cookie 0xaa253ed19be1fa3e 00010000:00080000:0.0:1789117665.148644:0:8437:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 100c793d-0063-4934-90f0-b04fc41ff903@192.168.204.30@tcp t0 exp 0000000000000000 cur 317 last 0 00000020:00000080:0.0:1789117665.148677:0:8437:0:(genops.c:1385:class_connect()) connect: client 100c793d-0063-4934-90f0-b04fc41ff903, cookie 0xaa253ed19be1fa45 00002000:00100000:0.0:1789117665.148690:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 100c793d-0063-4934-90f0-b04fc41ff903/ffff962a87fde800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789117665.148701:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789117665.148782:0:8437:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789117665.148820:0:8437:0:(import.c:65:import_set_state_nolock()) ffff962a87fdd000 : changing import state from RECOVER to FULL 00002000:00100000:3.0:1789117665.148874:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 100c793d-0063-4934-90f0-b04fc41ff903/ffff962a87eb7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789117665.148902:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789117665.148924:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:100c793d-0063-4934-90f0-b04fc41ff903+6:2403:x1876025572080000:12345-192.168.204.30@tcp:8:mount.lustre.0 Request processed in 327us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117665.148935:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 21 00002000:00080000:3.0:1789117665.148983:0:8433:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789117665.149018:0:8433:0:(import.c:65:import_set_state_nolock()) ffff962a87eb2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789117665.149108:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:100c793d-0063-4934-90f0-b04fc41ff903+6:2403:x1876025572079872:12345-192.168.204.30@tcp:8:mount.lustre.0 Request processed in 599us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117665.149118:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:2.0:1789117665.153599:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117665.153896:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572080256 00000100:00100000:3.0:1789117665.153912:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572080256 00000100:00100000:3.0:1789117665.154129:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00100000:3.0:1789117665.154146:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:100c793d-0063-4934-90f0-b04fc41ff903+6:8726:x1876025572080256:12345-192.168.204.30@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789117665.154332:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789117665.154495:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:100c793d-0063-4934-90f0-b04fc41ff903+6:8726:x1876025572080256:12345-192.168.204.30@tcp:33:mount.lustre.0 Request processed in 353us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117665.154505:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 1 00010000:00010000:1.0:1789117665.254001:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117666.150986:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b989cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593130752:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789117666.151120:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117666.151356:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593130752 00000100:00100000:2.0:1789117666.151366:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593130752 00000100:00100000:2.0:1789117666.151435:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789117666.151447:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a30f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593130752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789117666.151491:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789117666.151547:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a30f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593130752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117666.151555:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789117666.161030:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b989cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593130752:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789117666.277427:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117667.302588:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117668.201913:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593130880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789117668.202031:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117668.203898:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789117668.203920:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593131008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117668.203989:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117668.204038:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593130880 00000100:00100000:2.0:1789117668.204047:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593130880 00000100:00100000:3.0:1789117668.211491:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593131008 00000100:00100000:3.0:1789117668.211514:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593131008 00000100:00100000:3.0:1789117668.211699:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789117668.211721:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593131008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789117668.211769:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117668.211907:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593131008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 194us (7916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117668.211914:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:2.0:1789117668.211983:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a483c0 x1876025593131008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117684 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117668.212010:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593131008:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789117668.212078:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789117668.213254:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789117668.213267:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbff40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593130880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789117668.213287:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117668.213347:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbff40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593130880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (11317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117668.213363:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1789117668.214385:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a4bc00 x1876025593130880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117684 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117668.214413:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593130880:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789117668.330136:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117668.709322:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789117668.709351:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593131136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117668.709445:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117668.709918:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593131136 00000100:00100000:2.0:1789117668.709927:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593131136 00000100:00100000:2.0:1789117668.709999:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789117668.710012:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593131136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789117668.710093:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789117668.710168:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593131136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 160us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117668.710177:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789117668.710365:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593131136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117668.710728:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117668.710740:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593131264:0@lo:400:kworker.0 00000100:00100000:2.0:1789117668.710781:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117668.710922:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593131392:0@lo:400:kworker.0 00000100:00100000:1.0:1789117668.710982:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117668.711008:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593131904:0@lo:400:kworker.0 00000100:00100000:1.0:1789117668.711030:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117668.711046:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593132416:0@lo:400:kworker.0 00000100:00100000:1.0:1789117668.711106:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117668.711126:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789117668.711132:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593131520:0@lo:400:kworker.0 00000100:00100000:1.0:1789117668.711153:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117668.711168:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593132032:0@lo:400:kworker.0 00000100:00100000:1.0:1789117668.711187:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117668.711212:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593131392 00000100:00100000:1.0:1789117668.711217:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593131392 00000100:00100000:1.0:1789117668.711246:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593131904 00000100:00100000:1.0:1789117668.711256:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593131904 00000100:00100000:1.0:1789117668.711282:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593131520 00000100:00100000:1.0:1789117668.711285:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593131520 00000100:00100000:1.0:1789117668.711295:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593132032 00000100:00100000:1.0:1789117668.711297:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593132032 00000100:00100000:1.0:1789117668.711311:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789117668.711319:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593131392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117668.711363:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593131392:12345-0@lo:400:kworker.0 Request processed in 44us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117668.711370:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789117668.711384:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789117668.711390:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593131904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117668.712049:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593131904:12345-0@lo:400:kworker.0 Request processed in 655us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117668.712077:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789117668.712106:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789117668.712115:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593131520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117668.712145:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593131520:12345-0@lo:400:kworker.0 Request processed in 32us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117668.712151:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789117668.712163:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789117668.712168:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593132032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117668.712218:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593132032:12345-0@lo:400:kworker.0 Request processed in 49us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117668.712224:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789117668.712247:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593132416 00000100:00100000:1.0:1789117668.712252:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593132416 00000100:00100000:1.0:1789117668.712307:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789117668.712314:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593132416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117668.712344:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593132416:12345-0@lo:400:kworker.0 Request processed in 31us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117668.712350:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1789117668.712369:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789117668.712374:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789117668.712376:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789117668.712520:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593131776:0@lo:400:kworker.0 00000100:00100000:0.0:1789117668.712567:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117668.712597:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593132288:0@lo:400:kworker.0 00000100:00100000:0.0:1789117668.712619:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117668.712645:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789117668.712651:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593131648:0@lo:400:kworker.0 00000100:00100000:0.0:1789117668.712674:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117668.712693:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593132160:0@lo:400:kworker.0 00000100:00100000:0.0:1789117668.712713:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117668.712739:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593131264 00000100:00100000:0.0:1789117668.712744:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593131264 00000100:00100000:0.0:1789117668.712774:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789117668.712781:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90434850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593131264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117668.712811:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90434850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593131264:12345-0@lo:400:kworker.0 Request processed in 30us (2029us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117668.712818:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789117668.712844:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593131776 00000100:00100000:0.0:1789117668.712848:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593131776 00000100:00100000:0.0:1789117668.712871:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593132160 00000100:00100000:0.0:1789117668.712874:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593132160 00000100:00100000:0.0:1789117668.712887:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789117668.712893:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593131776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117668.712922:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593131776:12345-0@lo:400:kworker.0 Request processed in 29us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117668.712928:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789117668.712938:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789117668.712951:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593132160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117668.712977:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593132160:12345-0@lo:400:kworker.0 Request processed in 27us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117668.712984:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00010000:00080000:0.0:1789117668.713012:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7dd2c0 x1876025593132160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117668.713026:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593132160:0@lo:400:kworker.0 00000100:00100000:0.0:1789117668.713036:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593131776:0@lo:400:kworker.0 00000100:00100000:0.0:1789117668.713071:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593131648 00000100:00100000:0.0:1789117668.713075:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593131648 00000100:00100000:0.0:1789117668.713111:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789117668.713118:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593131648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117668.713152:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593131648:12345-0@lo:400:kworker.0 Request processed in 34us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117668.713172:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789117668.713197:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593131648:0@lo:400:kworker.0 00000100:00100000:1.0:1789117668.715549:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593131520:0@lo:400:kworker.0 00000100:00100000:0.0:1789117668.715707:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593132288 00000100:00100000:0.0:1789117668.715716:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593132288 00000100:00100000:0.0:1789117668.715792:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789117668.715802:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593132288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117668.715985:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593132032:0@lo:400:kworker.0 00000100:00100000:0.0:1789117668.716776:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593132288:12345-0@lo:400:kworker.0 Request processed in 972us (4152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117668.716785:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789117668.716829:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593131264:0@lo:400:kworker.0 00000100:00100000:1.0:1789117668.716965:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593131392:0@lo:400:kworker.0 00010000:00080000:1.0:1789117668.716981:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7dde00 x1876025593131904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117668.716992:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593131904:0@lo:400:kworker.0 00010000:00080000:1.0:1789117668.717006:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7dda40 x1876025593132416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117668.717013:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593132416:0@lo:400:kworker.0 00000100:00080000:1.0:1789117668.717048:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789117668.717082:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789117668.717085:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789117668.726785:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7dcb40 x1876025593132288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117668.726816:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593132288:0@lo:400:kworker.0 00000100:00100000:3.0:1789117669.226381:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117669.226408:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a30780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593132544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117669.226484:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117669.226574:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593132544 00000100:00100000:3.0:1789117669.226582:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593132544 00000100:00100000:3.0:1789117669.226645:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789117669.226655:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593132544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789117669.226693:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117669.226744:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593132544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117669.226753:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:3.0:1789117669.226803:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b98a30780 x1876025593132544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117669.226825:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a30780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593132544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117669.227299:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789117669.227310:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a30780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593132672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117669.227363:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117669.227395:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593132672 00000100:00100000:3.0:1789117669.227401:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593132672 00000100:00100000:3.0:1789117669.227429:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789117669.227437:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593132672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789117669.227451:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117669.227484:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593132672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117669.227491:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1789117669.227517:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b98a30780 x1876025593132672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117669.227545:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a30780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593132672:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789117669.352636:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117670.242587:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117670.242644:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117670.242677:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117670.242694:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117670.242709:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117670.242725:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117670.242747:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117670.242786:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572081152 00000100:00100000:3.0:1789117670.242796:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572081152 00000100:00100000:3.0:1789117670.242857:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572081024 00000100:00100000:3.0:1789117670.242860:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572081024 00000100:00100000:3.0:1789117670.242884:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00100000:3.0:1789117670.242896:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:100c793d-0063-4934-90f0-b04fc41ff903+6:2404:x1876025572081152:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117670.242995:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:100c793d-0063-4934-90f0-b04fc41ff903+6:2404:x1876025572081152:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 101us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117670.243022:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00100000:3.0:1789117670.243043:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 61 00000100:00100000:3.0:1789117670.243050:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:100c793d-0063-4934-90f0-b04fc41ff903+6:2405:x1876025572081024:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117670.243135:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:100c793d-0063-4934-90f0-b04fc41ff903+6:2405:x1876025572081024:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 85us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117670.243144:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 61 00000100:00100000:0.0:1789117670.243497:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572080512 00000100:00100000:0.0:1789117670.243504:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572080512 00000100:00100000:0.0:1789117670.243535:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572080768 00000100:00100000:0.0:1789117670.243538:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572080768 00000100:00100000:0.0:1789117670.243564:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572080640 00000100:00100000:0.0:1789117670.243566:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572080640 00000100:00100000:0.0:1789117670.243580:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572080896 00000100:00100000:0.0:1789117670.243585:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572080896 00000100:00100000:0.0:1789117670.243597:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 165 00000100:00100000:0.0:1789117670.243604:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a30780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2405:x1876025572080512:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117670.243649:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a30780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2405:x1876025572080512:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 45us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117670.243656:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 165 00000100:00100000:0.0:1789117670.243671:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 166 00000100:00100000:0.0:1789117670.243677:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+6:2405:x1876025572080768:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117670.243700:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+6:2405:x1876025572080768:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 24us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117670.243706:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 166 00000100:00100000:0.0:1789117670.243716:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 167 00000100:00100000:0.0:1789117670.243722:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2404:x1876025572080640:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117670.243742:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2404:x1876025572080640:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 21us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117670.243748:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 167 00000100:00100000:0.0:1789117670.243757:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 168 00000100:00100000:0.0:1789117670.243763:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+6:2404:x1876025572080896:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117670.243795:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+6:2404:x1876025572080896:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 32us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117670.243802:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 168 00000100:00100000:2.0:1789117670.244041:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572080384 00000100:00100000:2.0:1789117670.244047:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572080384 00000100:00100000:2.0:1789117670.244126:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 311 00000100:00100000:2.0:1789117670.244134:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2404:x1876025572080384:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117670.244164:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2404:x1876025572080384:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 32us (1520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117670.244179:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 311 00000100:00080000:1.0:1789117670.246810:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789117670.246826:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789117670.246832:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789117670.246836:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789117670.375565:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789117670.762813:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 100c793d-0063-4934-90f0-b04fc41ff903 00000001:00100000:2.0:1789117670.763340:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 100c793d-0063-4934-90f0-b04fc41ff903 00000001:00100000:0.0:1789117670.763436:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 100c793d-0063-4934-90f0-b04fc41ff903 00000001:00100000:3.0:1789117670.763651:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 100c793d-0063-4934-90f0-b04fc41ff903 00000100:00100000:3.0:1789117671.271478:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593132800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789117671.271556:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117671.271640:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593132800 00000100:00100000:3.0:1789117671.271647:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593132800 00000100:00100000:3.0:1789117671.271806:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789117671.271817:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593132800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789117671.271857:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789117671.271906:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593132800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117671.271913:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789117671.272094:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593132800:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789117671.397328:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789117671.939872:0:12192:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1789117672.421328:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117673.318320:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593133056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117673.318413:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117673.318497:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789117673.318504:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593132928:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789117673.318531:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117673.318576:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593133056 00000100:00100000:0.0:1789117673.318586:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593133056 00000100:00100000:0.0:1789117673.318654:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593132928 00000100:00100000:0.0:1789117673.318658:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593132928 00000100:00100000:0.0:1789117673.318679:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789117673.318688:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593133056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789117673.318729:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117673.318781:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593133056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117673.318789:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789117673.318806:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789117673.318813:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fabc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593132928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789117673.318823:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117673.318847:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fabc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593132928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117673.318853:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1789117673.318881:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789117673.318919:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a48780 x1876025593132928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117689 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117673.318940:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593132928:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1789117673.318951:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87fa9e00 x1876025593133056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117689 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117673.318961:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593133056:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789117673.445304:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117673.829463:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789117673.829498:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593133184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117673.829578:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117673.829649:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593133184 00000100:00100000:0.0:1789117673.829657:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593133184 00000100:00100000:0.0:1789117673.829706:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789117673.829716:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593133184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789117673.829753:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789117673.829799:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593133184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117673.829807:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789117673.829865:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593133184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117673.832318:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593133440:0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.832406:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117673.832465:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593133952:0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.832496:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117673.832518:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593134464:0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.832551:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117673.832578:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789117673.832584:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593133568:0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.832606:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117673.832624:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593134080:0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.832651:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117673.832670:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593134592:0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.832692:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117673.832727:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593133440 00000100:00100000:0.0:1789117673.832735:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593133440 00000100:00100000:0.0:1789117673.832778:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593133952 00000100:00100000:0.0:1789117673.832780:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593133952 00000100:00100000:0.0:1789117673.832802:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593134464 00000100:00100000:0.0:1789117673.832805:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593134464 00000100:00100000:0.0:1789117673.832816:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593133568 00000100:00100000:0.0:1789117673.832818:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593133568 00000100:00100000:0.0:1789117673.832830:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789117673.832839:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593133440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.832910:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593133440:12345-0@lo:400:kworker.0 Request processed in 58us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117673.832918:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789117673.832935:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789117673.832942:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593133952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.832968:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593133952:12345-0@lo:400:kworker.0 Request processed in 27us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117673.832974:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789117673.832983:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789117673.832995:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593134464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.833034:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593134464:12345-0@lo:400:kworker.0 Request processed in 39us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117673.833041:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789117673.833051:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789117673.833080:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593133568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.833105:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593133568:12345-0@lo:400:kworker.0 Request processed in 26us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117673.833111:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789117673.833140:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593134080 00000100:00100000:0.0:1789117673.833144:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593134080 00000100:00100000:0.0:1789117673.833169:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593134592 00000100:00100000:0.0:1789117673.833171:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593134592 00000100:00100000:0.0:1789117673.833191:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789117673.833197:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593134080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.833229:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593134080:12345-0@lo:400:kworker.0 Request processed in 31us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117673.833236:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789117673.833246:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789117673.833251:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593134592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.833276:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593134592:12345-0@lo:400:kworker.0 Request processed in 26us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117673.833282:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1789117673.833304:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789117673.833309:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789117673.833326:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593133696:0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.833361:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117673.833380:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593134208:0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.833403:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117673.833420:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593134720:0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.833440:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117673.833458:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789117673.833464:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593133312:0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.833491:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117673.833517:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593133824:0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.833536:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117673.833550:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593134336:0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.833568:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117673.833593:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593133312 00000100:00100000:0.0:1789117673.833597:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593133312 00000100:00100000:0.0:1789117673.833625:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789117673.833631:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593133312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.833667:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593133312:12345-0@lo:400:kworker.0 Request processed in 33us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117673.833673:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789117673.833705:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593133824 00000100:00100000:0.0:1789117673.833708:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593133824 00000100:00100000:0.0:1789117673.833729:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593134336 00000100:00100000:0.0:1789117673.833732:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593134336 00000100:00100000:0.0:1789117673.833748:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789117673.833754:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593133824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.833783:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593133824:12345-0@lo:400:kworker.0 Request processed in 29us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117673.833795:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789117673.833807:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789117673.833813:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593134336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.833840:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593134336:12345-0@lo:400:kworker.0 Request processed in 28us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117673.833846:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789117673.833865:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593134208 00000100:00100000:0.0:1789117673.833868:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593134208 00000100:00100000:0.0:1789117673.833887:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593134720 00000100:00100000:0.0:1789117673.833890:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593134720 00000100:00100000:0.0:1789117673.833905:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789117673.833910:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593134208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.833937:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593134208:12345-0@lo:400:kworker.0 Request processed in 27us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117673.833943:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789117673.833952:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789117673.833957:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593134720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.833977:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593134720:12345-0@lo:400:kworker.0 Request processed in 20us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117673.833983:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1789117673.834010:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789117673.834014:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117673.834026:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593133696 00000100:00100000:0.0:1789117673.834029:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593133696 00000100:00100000:0.0:1789117673.834074:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789117673.834081:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593133696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.834122:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593133696:12345-0@lo:400:kworker.0 Request processed in 42us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117673.834129:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789117673.834166:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593133312:0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.834178:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593133824:0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.834187:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593134336:0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.834195:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593133696:0@lo:400:kworker.0 00010000:00080000:0.0:1789117673.834207:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7dc000 x1876025593134208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117673.834218:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593134208:0@lo:400:kworker.0 00010000:00080000:0.0:1789117673.834227:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7dd2c0 x1876025593134720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117673.834236:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593134720:0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.834275:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593133568:0@lo:400:kworker.0 00010000:00080000:0.0:1789117673.834285:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7de580 x1876025593134080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117673.834294:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593134080:0@lo:400:kworker.0 00010000:00080000:0.0:1789117673.834304:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7df0c0 x1876025593134592/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117673.834311:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593134592:0@lo:400:kworker.0 00000100:00100000:0.0:1789117673.834323:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593133440:0@lo:400:kworker.0 00010000:00080000:0.0:1789117673.834340:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7dd680 x1876025593133952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117673.834349:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593133952:0@lo:400:kworker.0 00010000:00080000:0.0:1789117673.834359:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7de940 x1876025593134464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117673.834366:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593134464:0@lo:400:kworker.0 00000100:00100000:3.0:1789117674.341248:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117674.341273:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593134848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117674.341355:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117674.341605:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593134976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117674.341638:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117674.341676:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593134848 00000100:00100000:0.0:1789117674.341684:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593134848 00000100:00100000:0.0:1789117674.341733:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593134976 00000100:00100000:0.0:1789117674.341736:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593134976 00000100:00100000:0.0:1789117674.341750:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789117674.341759:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593134848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789117674.341798:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117674.341842:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593134848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117674.341850:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789117674.341866:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789117674.341872:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593134976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789117674.341882:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117674.341908:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593134976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117674.341914:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1789117674.341957:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7de940 x1876025593134976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117674.341976:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593134976:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789117674.342051:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b988a12c0 x1876025593134848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117674.342095:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593134848:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789117674.469392:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117675.385598:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117675.385643:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117675.385669:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117675.385690:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117675.385710:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117675.385729:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117675.385752:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117675.385781:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572081536 00000100:00100000:3.0:1789117675.385791:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572081536 00000100:00100000:3.0:1789117675.385844:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572081792 00000100:00100000:3.0:1789117675.385847:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572081792 00000100:00100000:3.0:1789117675.385859:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572081408 00000100:00100000:3.0:1789117675.385862:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572081408 00000100:00100000:3.0:1789117675.385872:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572081664 00000100:00100000:3.0:1789117675.385874:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572081664 00000100:00100000:3.0:1789117675.385890:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 175 00000100:00100000:3.0:1789117675.385901:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2405:x1876025572081536:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117675.386008:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2405:x1876025572081536:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 109us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117675.386015:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 175 00000100:00100000:3.0:1789117675.386033:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 176 00000100:00100000:3.0:1789117675.386039:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572081792:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117675.386106:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572081792:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 67us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117675.386113:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 176 00000100:00100000:3.0:1789117675.386126:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 177 00000100:00100000:3.0:1789117675.386132:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2405:x1876025572081408:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117675.386173:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2405:x1876025572081408:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 40us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117675.386179:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 177 00000100:00100000:3.0:1789117675.386191:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 178 00000100:00100000:3.0:1789117675.386198:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572081664:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117675.386220:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572081664:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 23us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117675.386226:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 178 00000100:00100000:3.0:1789117675.386247:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572082048 00000100:00100000:3.0:1789117675.386250:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572082048 00000100:00100000:3.0:1789117675.386275:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572081920 00000100:00100000:3.0:1789117675.386278:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572081920 00000100:00100000:3.0:1789117675.386298:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 66 00000100:00100000:3.0:1789117675.386304:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572082048:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117675.386330:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572082048:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 27us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117675.386336:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 66 00000100:00100000:3.0:1789117675.386346:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00100000:3.0:1789117675.386352:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572081920:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117675.386373:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572081920:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 22us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117675.386379:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00080000:3.0:1789117675.386401:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789117675.386406:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789117675.386408:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789117675.386417:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789117675.387338:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572081280 00000100:00100000:2.0:1789117675.387351:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572081280 00000100:00100000:2.0:1789117675.387406:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 313 00000100:00100000:2.0:1789117675.387414:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2405:x1876025572081280:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117675.387476:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2405:x1876025572081280:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 63us (1890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117675.387483:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 313 00010000:00010000:0.0:1789117675.493985:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117676.390471:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789117676.390496:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593135104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789117676.390566:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117676.390768:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593135104 00000100:00100000:2.0:1789117676.390776:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593135104 00000100:00100000:2.0:1789117676.390826:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789117676.390836:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593135104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789117676.390872:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789117676.390917:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593135104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117676.390925:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789117676.390982:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593135104:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789117676.518225:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117677.541254:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117678.443815:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593135232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117678.443936:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117678.446286:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593135232 00000100:00100000:0.0:1789117678.446301:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593135232 00000100:00100000:0.0:1789117678.446365:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789117678.446377:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593135232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789117678.446424:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117678.446464:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593135360:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789117678.446503:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593135232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (2568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117678.446511:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117678.446511:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789117678.446524:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593135360 00000100:00100000:0.0:1789117678.446528:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593135360 00000100:00100000:0.0:1789117678.446542:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789117678.446547:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593135360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789117678.446557:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1789117678.446874:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7df0c0 x1876025593135360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117694 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117678.446892:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593135360:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789117678.447047:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117678.447213:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593135360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117678.447222:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1789117678.447251:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf6ecb40 x1876025593135232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117694 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117678.447266:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593135232:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789117678.565745:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117678.949397:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593135488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789117678.949475:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117678.949731:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593135488 00000100:00100000:0.0:1789117678.949740:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593135488 00000100:00100000:0.0:1789117678.949806:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789117678.949816:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593135488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789117678.949853:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789117678.949918:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593135488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117678.949941:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789117678.950093:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593135488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117678.950840:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593135744:0@lo:400:kworker.0 00000100:00100000:0.0:1789117678.950881:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117678.950950:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593135616:0@lo:400:kworker.0 00000100:00100000:1.0:1789117678.950985:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117678.951042:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593135616 00000100:00100000:1.0:1789117678.951047:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593135616 00000100:00100000:1.0:1789117678.951101:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789117678.951108:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3647:x1876025593135616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117678.951159:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3647:x1876025593135616:12345-0@lo:400:kworker.0 Request processed in 50us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117678.951167:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789117678.951206:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593135616:0@lo:400:kworker.0 00000100:00100000:3.0:1789117678.951575:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593135744 00000100:00100000:3.0:1789117678.951580:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593135744 00000100:00100000:3.0:1789117678.951620:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789117678.951628:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593135744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117678.951788:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593135872:0@lo:400:kworker.0 00000100:00100000:1.0:1789117678.951821:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117678.952363:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593135744:12345-0@lo:400:kworker.0 Request processed in 733us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117678.952372:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789117678.952400:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593135872 00000100:00100000:3.0:1789117678.952405:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593135872 00000100:00100000:3.0:1789117678.952439:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789117678.952447:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593135872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117678.952488:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593135872:12345-0@lo:400:kworker.0 Request processed in 43us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117678.952495:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789117678.952529:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593135872:0@lo:400:kworker.0 00000100:00100000:0.0:1789117678.953960:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593135744:0@lo:400:kworker.0 00000100:00100000:1.0:1789117678.954516:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593136128:0@lo:400:kworker.0 00000100:00100000:1.0:1789117678.954586:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117678.954626:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876025593136640:0@lo:400:kworker.0 00000100:00100000:1.0:1789117678.954650:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117678.954668:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789117678.954674:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593136000:0@lo:400:kworker.0 00000100:00100000:1.0:1789117678.954700:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117678.954719:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593136512:0@lo:400:kworker.0 00000100:00100000:1.0:1789117678.954741:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117678.954754:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593137024:0@lo:400:kworker.0 00000100:00100000:1.0:1789117678.954772:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117678.954819:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593136000 00000100:00100000:1.0:1789117678.954825:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593136000 00000100:00100000:1.0:1789117678.954865:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789117678.954874:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593136000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117678.954935:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593136000:12345-0@lo:400:kworker.0 Request processed in 61us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117678.954942:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789117678.954975:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593136000:0@lo:400:kworker.0 00000100:00100000:0.0:1789117678.955305:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593136256:0@lo:400:kworker.0 00000100:00100000:0.0:1789117678.955337:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117678.955375:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593136768:0@lo:400:kworker.0 00000100:00100000:0.0:1789117678.955406:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117678.955424:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789117678.955431:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593136384:0@lo:400:kworker.0 00000100:00100000:0.0:1789117678.955453:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117678.955469:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593136896:0@lo:400:kworker.0 00000100:00100000:0.0:1789117678.955489:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117678.955601:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593136128 00000100:00100000:1.0:1789117678.955607:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593136128 00000100:00100000:1.0:1789117678.955645:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593136640 00000100:00100000:1.0:1789117678.955648:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593136640 00000100:00100000:1.0:1789117678.955660:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593136256 00000100:00100000:1.0:1789117678.955663:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593136256 00000100:00100000:1.0:1789117678.955676:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593136768 00000100:00100000:1.0:1789117678.955678:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593136768 00000100:00100000:1.0:1789117678.955691:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789117678.955698:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593136128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117678.955737:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593136128:12345-0@lo:400:kworker.0 Request processed in 39us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117678.955743:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789117678.955756:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789117678.955762:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876025593136640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117678.955790:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876025593136640:12345-0@lo:400:kworker.0 Request processed in 28us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117678.955796:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789117678.955807:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789117678.955813:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593136256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117678.955854:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593136256:12345-0@lo:400:kworker.0 Request processed in 41us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117678.955861:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789117678.955873:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789117678.955879:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593136768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117678.955913:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593136768:12345-0@lo:400:kworker.0 Request processed in 23us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117678.955919:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789117678.955949:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593136128:0@lo:400:kworker.0 00000100:00100000:1.0:1789117678.955959:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876025593136640:0@lo:400:kworker.0 00010000:00080000:1.0:1789117678.955985:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a48f00 x1876025593136256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117678.956008:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593136256:0@lo:400:kworker.0 00010000:00080000:1.0:1789117678.956019:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a49e00 x1876025593136768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117678.956028:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593136768:0@lo:400:kworker.0 00000100:00080000:0.0:1789117678.956482:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789117678.956487:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117678.956641:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593136512 00000100:00100000:3.0:1789117678.956647:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593136512 00000100:00100000:3.0:1789117678.956676:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593137024 00000100:00100000:3.0:1789117678.956679:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593137024 00000100:00100000:3.0:1789117678.956716:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593136384 00000100:00100000:3.0:1789117678.956719:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593136384 00000100:00100000:3.0:1789117678.956729:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593136896 00000100:00100000:3.0:1789117678.956732:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593136896 00000100:00100000:3.0:1789117678.956746:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789117678.956753:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593136512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117678.956805:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593136512:12345-0@lo:400:kworker.0 Request processed in 53us (2064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117678.956812:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789117678.956825:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789117678.956831:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593137024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117678.956856:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593137024:12345-0@lo:400:kworker.0 Request processed in 26us (2084us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117678.956862:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789117678.956872:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789117678.956877:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593136384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117678.956922:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593136384:12345-0@lo:400:kworker.0 Request processed in 44us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117678.956928:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789117678.956939:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789117678.956945:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593136896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117678.956971:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593136896:12345-0@lo:400:kworker.0 Request processed in 27us (1481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117678.956977:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1789117678.957106:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a48780 x1876025593136512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117678.957118:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593136512:0@lo:400:kworker.0 00010000:00080000:1.0:1789117678.957129:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87dbe580 x1876025593137024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117678.957139:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593137024:0@lo:400:kworker.0 00000100:00080000:0.0:1789117678.957276:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789117678.957369:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a4a1c0 x1876025593136384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117678.957379:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593136384:0@lo:400:kworker.0 00010000:00080000:2.0:1789117678.957511:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a4b480 x1876025593136896/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117678.957519:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593136896:0@lo:400:kworker.0 00000100:00100000:3.0:1789117679.461752:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117679.461780:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593137152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117679.461876:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117679.461952:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593137152 00000100:00100000:0.0:1789117679.461962:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593137152 00000100:00100000:0.0:1789117679.462030:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789117679.462042:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593137152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789117679.462101:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117679.462131:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789117679.462152:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593137280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789117679.462155:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593137152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117679.462163:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789117679.462178:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117679.462196:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593137280 00000100:00100000:0.0:1789117679.462206:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593137280 00010000:00080000:3.0:1789117679.462220:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7dcf00 x1876025593137152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117679.462227:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789117679.462233:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593137280:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117679.462238:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593137152:0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789117679.462242:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117679.462276:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593137280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (97us total) trans 0 rc 0/0 00010000:00080000:3.0:1789117679.462279:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf6ecb40 x1876025593137280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117679.462282:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789117679.462290:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593137280:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789117679.590326:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117680.479687:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117680.479738:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117680.479774:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117680.479813:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117680.480188:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572082304 00000100:00100000:1.0:1789117680.480197:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572082304 00000100:00100000:1.0:1789117680.480265:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572082560 00000100:00100000:1.0:1789117680.480268:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572082560 00000100:00100000:1.0:1789117680.480295:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 185 00000100:00100000:1.0:1789117680.480306:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2405:x1876025572082304:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117680.480569:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572082816 00000100:00100000:2.0:1789117680.480574:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572082816 00000100:00100000:2.0:1789117680.480612:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 72 00000100:00100000:2.0:1789117680.480620:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572082816:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117680.480700:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572082816:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 80us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117680.480709:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 72 00000100:00100000:2.0:1789117680.480741:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572082176 00000100:00100000:2.0:1789117680.480745:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572082176 00000100:00100000:2.0:1789117680.480775:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 315 00000100:00100000:2.0:1789117680.480781:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83ada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2405:x1876025572082176:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117680.480828:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83ada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2405:x1876025572082176:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 47us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117680.480850:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 315 00000100:00100000:1.0:1789117680.481171:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2405:x1876025572082304:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 864us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117680.481180:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 185 00000100:00100000:1.0:1789117680.481198:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 186 00000100:00100000:1.0:1789117680.481206:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572082560:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117680.481232:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572082560:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 27us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117680.481238:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 186 00000100:00080000:1.0:1789117680.481257:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789117680.481262:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117680.482759:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117680.487383:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117680.487445:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117680.489490:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572082432 00000100:00100000:0.0:1789117680.489504:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572082432 00000100:00100000:0.0:1789117680.489568:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572082688 00000100:00100000:0.0:1789117680.489572:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572082688 00000100:00100000:0.0:1789117680.489602:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 187 00000100:00100000:0.0:1789117680.489613:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2405:x1876025572082432:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117680.489703:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2405:x1876025572082432:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 91us (6953us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117680.489710:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 187 00000100:00100000:0.0:1789117680.489728:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 188 00000100:00100000:0.0:1789117680.489735:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572082688:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117680.489762:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572082688:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 28us (2390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117680.489769:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 188 00000100:00100000:0.0:1789117680.489847:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572082944 00000100:00100000:0.0:1789117680.489852:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572082944 00000100:00100000:0.0:1789117680.490721:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 73 00000100:00100000:0.0:1789117680.490731:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572082944:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117680.490781:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572082944:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 52us (3336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117680.490807:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 73 00000100:00080000:0.0:1789117680.490850:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789117680.490856:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789117680.613730:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789117681.383275:0:12508:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789117681.383831:0:12508:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789117681.509440:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117681.509471:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593137408:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789117681.509570:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117681.509717:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593137408 00000100:00100000:1.0:1789117681.509729:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593137408 00000100:00100000:1.0:1789117681.509802:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789117681.509815:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87889a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593137408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789117681.509871:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789117681.509935:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87889a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593137408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117681.509963:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789117681.510020:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593137408:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789117681.644488:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117682.674450:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117683.557400:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593137536:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789117683.557486:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117683.557608:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593137536 00000100:00100000:0.0:1789117683.557616:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593137536 00000100:00100000:0.0:1789117683.557683:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789117683.557694:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a878883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593137536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789117683.557726:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117683.557782:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a878883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593137536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117683.557789:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789117683.557992:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593137664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117683.558023:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117683.558110:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593137664 00000100:00100000:3.0:1789117683.558123:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593137664 00000100:00100000:3.0:1789117683.558159:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789117683.558167:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593137664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789117683.558178:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117683.558214:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593137664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117683.558221:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:3.0:1789117683.558256:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e16940 x1876025593137664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117699 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117683.558276:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593137664:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789117683.558888:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789117683.558919:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7dde00 x1876025593137536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117699 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117683.558934:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593137536:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789117683.685365:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789117683.933458:0:12606:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789117683.933682:0:12606:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789117684.069474:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789117684.069506:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593137792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117684.069595:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117684.069674:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593137792 00000100:00100000:0.0:1789117684.069684:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593137792 00000100:00100000:0.0:1789117684.069738:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789117684.069749:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593137792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789117684.069794:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789117684.069852:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593137792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117684.069859:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789117684.069910:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593137792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789117684.070488:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593138048:0@lo:400:kworker.0 00000100:00100000:3.0:1789117684.070534:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117684.070562:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593138560:0@lo:400:kworker.0 00000100:00100000:3.0:1789117684.070585:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117684.070605:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593139072:0@lo:400:kworker.0 00000100:00100000:3.0:1789117684.070625:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117684.070642:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789117684.070647:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593138176:0@lo:400:kworker.0 00000100:00100000:3.0:1789117684.070668:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117684.070682:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593138688:0@lo:400:kworker.0 00000100:00100000:3.0:1789117684.070706:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117684.070726:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593139200:0@lo:400:kworker.0 00000100:00100000:3.0:1789117684.070747:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117684.070779:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593138688 00000100:00100000:3.0:1789117684.070786:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593138688 00000100:00100000:3.0:1789117684.070832:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593139200 00000100:00100000:3.0:1789117684.070836:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593139200 00000100:00100000:3.0:1789117684.070864:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789117684.070872:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a76940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593138688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117684.070918:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a76940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593138688:12345-0@lo:400:kworker.0 Request processed in 47us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117684.070926:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789117684.070940:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789117684.070958:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593139200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117684.070989:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593139200:12345-0@lo:400:kworker.0 Request processed in 33us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117684.070995:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1789117684.071013:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789117684.071038:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a74f00 x1876025593138688/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117684.071083:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593138688:0@lo:400:kworker.0 00010000:00080000:3.0:1789117684.071096:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a77c00 x1876025593139200/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117684.071104:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593139200:0@lo:400:kworker.0 00000100:00100000:0.0:1789117684.071199:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593138048 00000100:00100000:0.0:1789117684.071203:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593138048 00000100:00100000:0.0:1789117684.071228:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593138560 00000100:00100000:0.0:1789117684.071231:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593138560 00000100:00100000:0.0:1789117684.071258:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593139072 00000100:00100000:0.0:1789117684.071262:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593139072 00000100:00100000:0.0:1789117684.071274:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593138176 00000100:00100000:0.0:1789117684.071276:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593138176 00000100:00100000:0.0:1789117684.071374:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789117684.071381:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593138048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117684.071425:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593138048:12345-0@lo:400:kworker.0 Request processed in 45us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117684.071431:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789117684.071443:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789117684.071449:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593138560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117684.071476:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593138560:12345-0@lo:400:kworker.0 Request processed in 28us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117684.071482:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789117684.071493:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789117684.071500:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593139072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117684.071715:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593139072:12345-0@lo:400:kworker.0 Request processed in 214us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117684.071722:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789117684.071735:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789117684.071741:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593138176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117684.071769:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593138176:12345-0@lo:400:kworker.0 Request processed in 28us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117684.071785:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789117684.071840:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593137920:0@lo:400:kworker.0 00000100:00100000:0.0:1789117684.071878:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117684.071909:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a76d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593138432:0@lo:400:kworker.0 00000100:00100000:0.0:1789117684.071930:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117684.071946:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593138944:0@lo:400:kworker.0 00000100:00100000:0.0:1789117684.071965:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117684.071981:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789117684.071988:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593138304:0@lo:400:kworker.0 00000100:00100000:0.0:1789117684.072010:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117684.072024:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593138816:0@lo:400:kworker.0 00000100:00100000:0.0:1789117684.072044:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117684.072089:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593139328:0@lo:400:kworker.0 00000100:00100000:0.0:1789117684.072108:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117684.072133:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593137920 00000100:00100000:0.0:1789117684.072137:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593137920 00000100:00100000:0.0:1789117684.072169:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1789117684.072175:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b904e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593137920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117684.072209:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b904e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593137920:12345-0@lo:400:kworker.0 Request processed in 35us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117684.072215:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1789117684.072247:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593138816 00000100:00100000:0.0:1789117684.072252:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593138816 00000100:00100000:0.0:1789117684.072274:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593139328 00000100:00100000:0.0:1789117684.072277:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593139328 00000100:00080000:3.0:1789117684.072396:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789117684.072557:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789117684.072563:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593138816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117684.072594:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593138816:12345-0@lo:400:kworker.0 Request processed in 31us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117684.072599:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789117684.072608:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789117684.072614:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87faa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593139328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117684.072638:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87faa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593139328:12345-0@lo:400:kworker.0 Request processed in 25us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117684.072643:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789117684.072662:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593138432 00000100:00100000:0.0:1789117684.072665:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593138432 00000100:00080000:3.0:1789117684.078939:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789117684.078950:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789117684.079462:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593138304 00000100:00100000:1.0:1789117684.079476:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593138304 00000100:00100000:1.0:1789117684.079547:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789117684.079558:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593138304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117684.079665:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593138304:12345-0@lo:400:kworker.0 Request processed in 109us (7653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117684.079673:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789117684.079734:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593138176:0@lo:400:kworker.0 00000100:00100000:1.0:1789117684.079750:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593138048:0@lo:400:kworker.0 00010000:00080000:1.0:1789117684.079765:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a74b40 x1876025593138560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117684.079776:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593138560:0@lo:400:kworker.0 00010000:00080000:1.0:1789117684.079789:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a75e00 x1876025593139072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117684.079797:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593139072:0@lo:400:kworker.0 00000100:00100000:1.0:1789117684.079853:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593138944 00000100:00100000:1.0:1789117684.079858:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593138944 00000100:00100000:1.0:1789117684.079900:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789117684.079907:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593138944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117684.079942:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593138944:12345-0@lo:400:kworker.0 Request processed in 37us (7977us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117684.079961:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:1.0:1789117684.079980:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117684.085133:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789117684.085149:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593138432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117684.085317:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593138432:12345-0@lo:400:kworker.0 Request processed in 172us (13384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117684.085325:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789117684.085382:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593138304:0@lo:400:kworker.0 00010000:00080000:0.0:1789117684.085399:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a76580 x1876025593138816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117684.085409:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593138816:0@lo:400:kworker.0 00010000:00080000:0.0:1789117684.085420:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a75a40 x1876025593139328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117684.085427:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593139328:0@lo:400:kworker.0 00000100:00100000:0.0:1789117684.085437:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593137920:0@lo:400:kworker.0 00000100:00100000:0.0:1789117684.085461:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a76d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593138432:0@lo:400:kworker.0 00000100:00100000:0.0:1789117684.085472:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593138944:0@lo:400:kworker.0 00000100:00100000:3.0:1789117684.582303:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117684.582326:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593139456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117684.582402:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117684.582474:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593139456 00000100:00100000:3.0:1789117684.582484:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593139456 00000100:00100000:3.0:1789117684.582531:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789117684.582542:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593139456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789117684.582587:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117684.582636:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593139456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117684.582645:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:3.0:1789117684.582702:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a77c00 x1876025593139456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117684.582747:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593139456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117684.586445:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593139584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117684.586562:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117684.586693:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593139584 00000100:00100000:3.0:1789117684.586702:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593139584 00000100:00100000:3.0:1789117684.586766:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789117684.586776:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a77c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593139584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789117684.586816:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117684.586869:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a77c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593139584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117684.586877:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:3.0:1789117684.586917:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87fa9e00 x1876025593139584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117684.586938:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593139584:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789117684.711973:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117685.601887:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117685.601939:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117685.601969:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117685.601993:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117685.602010:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117685.602031:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117685.602087:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117685.602115:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572083328 00000100:00100000:3.0:1789117685.602125:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572083328 00000100:00100000:3.0:1789117685.602189:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572083584 00000100:00100000:3.0:1789117685.602193:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572083584 00000100:00100000:3.0:1789117685.602220:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572083200 00000100:00100000:3.0:1789117685.602222:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572083200 00000100:00100000:3.0:1789117685.602232:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572083456 00000100:00100000:3.0:1789117685.602234:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572083456 00000100:00100000:3.0:1789117685.602248:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 195 00000100:00100000:3.0:1789117685.602268:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572083328:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117685.602342:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572083328:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 85us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117685.602349:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 195 00000100:00100000:3.0:1789117685.602366:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 196 00000100:00100000:3.0:1789117685.602371:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2406:x1876025572083584:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117685.602394:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2406:x1876025572083584:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 23us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117685.602399:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 196 00000100:00100000:3.0:1789117685.602422:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 197 00000100:00100000:3.0:1789117685.602428:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572083200:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117685.602450:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572083200:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 23us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117685.602456:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 197 00000100:00100000:3.0:1789117685.602466:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 198 00000100:00100000:3.0:1789117685.602471:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2406:x1876025572083456:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117685.602491:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2406:x1876025572083456:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 20us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117685.602496:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 198 00000100:00100000:3.0:1789117685.602523:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572083712 00000100:00100000:3.0:1789117685.602532:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572083712 00000100:00100000:3.0:1789117685.602560:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572083840 00000100:00100000:3.0:1789117685.602562:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572083840 00000100:00100000:3.0:1789117685.602581:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:3.0:1789117685.602586:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:100c793d-0063-4934-90f0-b04fc41ff903+5:2403:x1876025572083712:12345-192.168.204.30@tcp:9:kworker.0 00000020:00000080:3.0:1789117685.602605:0:8437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1fa3e 00000100:00080000:3.0:1789117685.602613:0:8437:0:(import.c:65:import_set_state_nolock()) ffff962a87eb2800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789117685.602651:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789117685.602758:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:100c793d-0063-4934-90f0-b04fc41ff903+2:2403:x1876025572083712:12345-192.168.204.30@tcp:9:kworker.0 Request processed in 171us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117685.602764:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:3.0:1789117685.602786:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:3.0:1789117685.602793:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a74b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:100c793d-0063-4934-90f0-b04fc41ff903+5:2403:x1876025572083840:12345-192.168.204.30@tcp:9:kworker.0 00000020:00000080:3.0:1789117685.602803:0:8437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1fa45 00000100:00080000:3.0:1789117685.602808:0:8437:0:(import.c:65:import_set_state_nolock()) ffff962a87fdd000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789117685.602829:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789117685.602889:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a74b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:100c793d-0063-4934-90f0-b04fc41ff903+2:2403:x1876025572083840:12345-192.168.204.30@tcp:9:kworker.0 Request processed in 97us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117685.602895:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00080000:3.0:1789117685.602914:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789117685.602918:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789117685.602920:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789117685.602922:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789117685.603036:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117685.603042:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117685.603145:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572083072 00000100:00100000:0.0:1789117685.603149:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572083072 00000100:00100000:0.0:1789117685.603187:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 317 00000100:00100000:0.0:1789117685.603193:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b904eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2406:x1876025572083072:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117685.603224:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b904eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2406:x1876025572083072:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 31us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117685.603230:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 317 00010000:00010000:1.0:1789117685.735407:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789117686.098911:0:12704:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789117686.099501:0:12704:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789117686.641082:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593139712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789117686.641207:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117686.641371:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593139712 00000100:00100000:3.0:1789117686.641383:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593139712 00000100:00100000:3.0:1789117686.641470:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789117686.641485:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593139712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789117686.641543:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789117686.641613:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593139712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117686.641623:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789117686.641703:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593139712:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789117686.764804:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117687.782442:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117688.678464:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593139840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117688.678562:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117688.678768:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593139840 00000100:00100000:1.0:1789117688.678778:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593139840 00000100:00100000:1.0:1789117688.678860:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789117688.678871:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f72940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593139840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789117688.678911:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117688.678969:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f72940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593139840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117688.678978:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:1.0:1789117688.679030:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f6a580 x1876025593139840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117704 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117688.679051:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593139840:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789117688.679129:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117688.680817:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593139968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789117688.680912:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117688.681275:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593139968 00000100:00100000:3.0:1789117688.681286:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593139968 00000100:00100000:3.0:1789117688.681361:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789117688.681372:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593139968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789117688.681402:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117688.681456:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593139968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117688.681464:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1789117688.682092:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87d83480 x1876025593139968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117704 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117688.682117:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593139968:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789117688.682170:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789117688.805591:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789117688.991467:0:12801:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789117688.991766:0:12801:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789117689.198198:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593140096:0@lo:400:kworker.0 00000100:00100000:1.0:1789117689.198285:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117689.198343:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593140608:0@lo:400:kworker.0 00000100:00100000:1.0:1789117689.198371:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117689.198391:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593141120:0@lo:400:kworker.0 00000100:00100000:1.0:1789117689.198420:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117689.198440:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593141632:0@lo:400:kworker.0 00000100:00100000:1.0:1789117689.198461:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117689.198489:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789117689.198494:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593140224:0@lo:400:kworker.0 00000100:00100000:1.0:1789117689.198536:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117689.198559:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593140736:0@lo:400:kworker.0 00000100:00100000:1.0:1789117689.198584:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117689.198603:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593141248:0@lo:400:kworker.0 00000100:00100000:1.0:1789117689.198637:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117689.198657:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593140224 00000100:00100000:3.0:1789117689.198666:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593140224 00000100:00100000:3.0:1789117689.198722:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593140736 00000100:00100000:3.0:1789117689.198726:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593140736 00000100:00100000:3.0:1789117689.198747:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593141248 00000100:00100000:3.0:1789117689.198749:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593141248 00000100:00100000:3.0:1789117689.198768:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789117689.198776:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593140224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117689.198826:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593140224:12345-0@lo:400:kworker.0 Request processed in 51us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117689.198834:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593140352:0@lo:400:kworker.0 00000100:00100000:3.0:1789117689.198843:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789117689.198859:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789117689.198865:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593140736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117689.198892:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593140736:12345-0@lo:400:kworker.0 Request processed in 27us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117689.198897:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789117689.198910:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789117689.198918:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593141248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117689.198948:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117689.198955:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593141248:12345-0@lo:400:kworker.0 Request processed in 37us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117689.198962:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789117689.198976:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593140864:0@lo:400:kworker.0 00000100:00080000:3.0:1789117689.198982:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117689.198999:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117689.199017:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593141376:0@lo:400:kworker.0 00000100:00100000:1.0:1789117689.199037:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117689.199050:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789117689.199080:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593140480:0@lo:400:kworker.0 00000100:00100000:3.0:1789117689.199082:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593140864 00000100:00100000:3.0:1789117689.199088:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593140864 00000100:00100000:1.0:1789117689.199109:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117689.199117:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593141376 00000100:00100000:3.0:1789117689.199121:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593141376 00000100:00100000:1.0:1789117689.199126:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593140992:0@lo:400:kworker.0 00000100:00100000:3.0:1789117689.199136:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593140480 00000100:00100000:3.0:1789117689.199140:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593140480 00000100:00100000:1.0:1789117689.199154:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117689.199158:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789117689.199165:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593140864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117689.199198:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593140864:12345-0@lo:400:kworker.0 Request processed in 34us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117689.199204:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789117689.199214:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789117689.199221:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593141376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117689.199245:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593141376:12345-0@lo:400:kworker.0 Request processed in 26us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117689.199256:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789117689.199267:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789117689.199273:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593140480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117689.199302:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593140480:12345-0@lo:400:kworker.0 Request processed in 30us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117689.199307:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:3.0:1789117689.199321:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789117689.200321:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593141504:0@lo:400:kworker.0 00000100:00100000:2.0:1789117689.200361:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593141120 00000100:00100000:1.0:1789117689.200363:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117689.200369:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593141120 00000100:00100000:2.0:1789117689.200401:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593141632 00000100:00100000:2.0:1789117689.200405:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593141632 00010000:00080000:1.0:1789117689.200410:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e16580 x1876025593140864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117689.200425:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593140992 00000100:00100000:1.0:1789117689.200426:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593140864:0@lo:400:kworker.0 00000100:00100000:3.0:1789117689.200429:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593141504 00000100:00100000:2.0:1789117689.200429:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593140992 00000100:00100000:3.0:1789117689.200445:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593141504 00010000:00080000:1.0:1789117689.200446:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a4a1c0 x1876025593141376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117689.200450:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789117689.200461:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593141120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117689.200464:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593141376:0@lo:400:kworker.0 00000100:00100000:3.0:1789117689.200472:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789117689.200482:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593141632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117689.200508:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593140480:0@lo:400:kworker.0 00000100:00100000:3.0:1789117689.200516:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593141632:12345-0@lo:400:kworker.0 Request processed in 34us (2052us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117689.200516:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593141120:12345-0@lo:400:kworker.0 Request processed in 55us (2093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117689.200523:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789117689.200531:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789117689.200538:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789117689.200541:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789117689.200544:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593140992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117689.200547:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593141504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117689.200575:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593140992:12345-0@lo:400:kworker.0 Request processed in 32us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117689.200581:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789117689.200589:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593141504:12345-0@lo:400:kworker.0 Request processed in 43us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117689.200595:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1789117689.200601:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117689.200616:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593140608 00000100:00100000:2.0:1789117689.200619:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593140608 00000100:00100000:2.0:1789117689.200636:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593140352 00000100:00100000:2.0:1789117689.200639:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593140352 00000100:00100000:2.0:1789117689.200651:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789117689.200656:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593140608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117689.200688:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593140608:12345-0@lo:400:kworker.0 Request processed in 32us (2317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117689.200694:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789117689.200718:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789117689.200725:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593140352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117689.200774:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593140352:12345-0@lo:400:kworker.0 Request processed in 49us (1826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117689.200780:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789117689.200798:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593140096 00000100:00100000:2.0:1789117689.200801:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593140096 00000100:00100000:2.0:1789117689.200827:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789117689.200833:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b904eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3646:x1876025593140096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117689.200878:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b904eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3646:x1876025593140096:12345-0@lo:400:kworker.0 Request processed in 44us (2593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117689.200885:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1789117689.209069:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593140224:0@lo:400:kworker.0 00000100:00100000:1.0:1789117689.209095:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593140736:0@lo:400:kworker.0 00000100:00100000:1.0:1789117689.209114:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593141248:0@lo:400:kworker.0 00000100:00100000:1.0:1789117689.209125:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593140096:0@lo:400:kworker.0 00000100:00100000:1.0:1789117689.209137:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593140608:0@lo:400:kworker.0 00010000:00080000:1.0:1789117689.209152:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87dbe580 x1876025593141120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117689.209163:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593141120:0@lo:400:kworker.0 00010000:00080000:1.0:1789117689.209175:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a49e00 x1876025593141632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117689.209182:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593141632:0@lo:400:kworker.0 00000100:00100000:1.0:1789117689.209227:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117689.209237:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593141760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117689.209297:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117689.209345:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593141760 00000100:00100000:1.0:1789117689.209352:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593141760 00000100:00100000:2.0:1789117689.209393:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789117689.209406:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593141760:12345-0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1789117689.209430:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e161c0 x1876025593140992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117689.209442:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593140992:0@lo:400:kworker.0 00000004:00000024:2.0:1789117689.209443:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00010000:00080000:1.0:1789117689.209456:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a48780 x1876025593141504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117689.209476:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593141504:0@lo:400:kworker.0 00000100:00100000:1.0:1789117689.209493:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593140352:0@lo:400:kworker.0 00000100:00100000:2.0:1789117689.209512:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593141760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117689.209520:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789117689.209630:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593141760:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789117689.701285:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8788ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593141888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117689.701388:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117689.701498:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593141888 00000100:00100000:3.0:1789117689.701508:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593141888 00000100:00100000:3.0:1789117689.701594:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789117689.701605:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593141888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789117689.701650:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117689.701718:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593141888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117689.701726:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:3.0:1789117689.701791:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a8788ad00 x1876025593141888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117689.701815:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8788ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593141888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789117689.702314:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789117689.702327:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593142016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117689.702370:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117689.702413:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593142016 00000100:00100000:0.0:1789117689.702418:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593142016 00000100:00100000:0.0:1789117689.702453:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789117689.702460:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d83c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593142016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789117689.702473:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117689.702518:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d83c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593142016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117689.702525:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1789117689.702556:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87d82580 x1876025593142016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117689.702570:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593142016:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789117689.829316:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117690.721199:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117690.721249:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117690.721281:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117690.721310:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117690.721344:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117690.721381:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572084224 00000100:00100000:0.0:1789117690.721393:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572084224 00000100:00100000:0.0:1789117690.721465:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572084480 00000100:00100000:0.0:1789117690.721469:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572084480 00000100:00100000:0.0:1789117690.721488:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572084096 00000100:00100000:0.0:1789117690.721491:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572084096 00000100:00100000:0.0:1789117690.721503:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572084352 00000100:00100000:0.0:1789117690.721505:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572084352 00000100:00100000:0.0:1789117690.721522:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 205 00000100:00100000:0.0:1789117690.721534:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572084224:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117690.721653:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572084224:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 121us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117690.721662:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 205 00000100:00100000:0.0:1789117690.721693:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 206 00000100:00100000:0.0:1789117690.721701:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572084480:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117690.721735:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572084480:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 34us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117690.721751:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 206 00000100:00100000:0.0:1789117690.721766:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 207 00000100:00100000:0.0:1789117690.721774:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2407:x1876025572084096:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117690.721805:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2407:x1876025572084096:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 33us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117690.721812:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 207 00000100:00100000:0.0:1789117690.721825:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 208 00000100:00100000:0.0:1789117690.721832:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572084352:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117690.721862:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572084352:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 30us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117690.721867:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 208 00000100:00080000:0.0:1789117690.721896:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789117690.721902:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789117690.722315:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572083968 00000100:00100000:1.0:1789117690.722324:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572083968 00000100:00100000:1.0:1789117690.722378:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 319 00000100:00100000:1.0:1789117690.722388:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b904e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572083968:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117690.722434:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b904e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572083968:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 49us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117690.722442:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 319 00010000:00010000:3.0:1789117690.853637:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789117691.486006:0:12899:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789117691.487393:0:12899:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789117691.750149:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789117691.750179:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593142144:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789117691.752279:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117691.752386:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593142144 00000100:00100000:1.0:1789117691.752397:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593142144 00000100:00100000:1.0:1789117691.752455:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789117691.752466:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593142144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789117691.752508:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789117691.752560:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593142144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117691.752579:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789117691.752633:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593142144:0@lo:41:osp-pre-1-0.0 00000001:00100000:3.0:1789117691.762101:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 100c793d-0063-4934-90f0-b04fc41ff903 00000020:00000080:3.0:1789117691.762114:0:8429:0:(genops.c:885:class_export_put()) final put ffff962a87eb7000/100c793d-0063-4934-90f0-b04fc41ff903 00000020:00000080:2.0:1789117691.762208:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff962a87eb7000/100c793d-0063-4934-90f0-b04fc41ff903 for lustre-OST0000 00000020:00000080:2.0:1789117691.762263:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a87eb2800 for lustre-OST0000 00000001:00100000:1.0:1789117691.768100:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 100c793d-0063-4934-90f0-b04fc41ff903 00000020:00000080:1.0:1789117691.768116:0:9514:0:(genops.c:885:class_export_put()) final put ffff962a87fde800/100c793d-0063-4934-90f0-b04fc41ff903 00000020:00000080:0.0:1789117691.768264:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962a87fde800/100c793d-0063-4934-90f0-b04fc41ff903 for lustre-OST0001 00000020:00000080:0.0:1789117691.768337:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a87fdd000 for lustre-OST0001 00010000:00010000:0.0:1789117691.877334:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117692.901459:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117693.798324:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593142272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117693.798396:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117693.799141:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593142272 00000100:00100000:1.0:1789117693.799158:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593142272 00000100:00100000:1.0:1789117693.799231:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789117693.799242:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593142272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789117693.799276:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117693.799344:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593142272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117693.799353:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1789117693.799423:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789117693.799460:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbfa861c0 x1876025593142272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117693.799484:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593142272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117693.801772:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789117693.801799:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593142400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789117693.801876:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117693.801997:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593142400 00000100:00100000:2.0:1789117693.802006:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593142400 00000100:00080000:3.0:1789117693.802134:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789117693.802216:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789117693.802227:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e49a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593142400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789117693.802254:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117693.802355:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e49a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593142400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117693.802363:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1789117693.804249:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f712c0 x1876025593142400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117693.804280:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593142400:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789117693.925155:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117694.309911:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593142528:0@lo:400:kworker.0 00000100:00100000:2.0:1789117694.309952:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593142784:0@lo:400:kworker.0 00000100:00100000:1.0:1789117694.310018:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593142656:0@lo:400:kworker.0 00000100:00100000:2.0:1789117694.317836:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117694.318129:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593142912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117694.318351:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593143296:0@lo:400:kworker.0 00000100:00100000:3.0:1789117694.318512:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593142784 00000100:00100000:3.0:1789117694.318520:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593142784 00000100:00100000:3.0:1789117694.318575:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789117694.318584:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593142784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117694.318651:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593142784:12345-0@lo:400:kworker.0 Request processed in 68us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117694.318658:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789117694.318681:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117694.318699:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593143424:0@lo:400:kworker.0 00000100:00100000:3.0:1789117694.318725:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593142912 00000100:00100000:3.0:1789117694.318728:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593142912 00000100:00100000:3.0:1789117694.318746:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789117694.318753:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593142912:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117694.318766:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1789117694.318779:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789117694.318811:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117694.318883:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593143040:0@lo:400:kworker.0 00000100:00100000:0.0:1789117694.318919:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593143296 00000100:00100000:0.0:1789117694.318936:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593143296 00000100:00100000:0.0:1789117694.318974:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789117694.318981:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593143296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117694.319015:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593143296:12345-0@lo:400:kworker.0 Request processed in 35us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117694.319021:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00080000:0.0:1789117694.319038:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117694.319142:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593142528 00000100:00100000:0.0:1789117694.319147:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593142528 00000100:00100000:0.0:1789117694.319176:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1789117694.319182:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593142528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117694.319219:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593142528:12345-0@lo:400:kworker.0 Request processed in 37us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117694.319226:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1789117694.324605:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593142912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5840us (5910us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117694.324795:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593143296:0@lo:400:kworker.0 00000100:00100000:2.0:1789117694.324836:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593143808:0@lo:400:kworker.0 00000100:00100000:0.0:1789117694.324976:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117694.325007:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593143936:0@lo:400:kworker.0 00000100:00100000:0.0:1789117694.325046:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117694.325543:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789117694.325584:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593143936 00000100:00100000:3.0:1789117694.325591:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593143936 00000100:00100000:3.0:1789117694.325780:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789117694.325790:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d80780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593143936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117694.325868:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593142912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117694.325899:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593143424 00000100:00100000:0.0:1789117694.325903:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593143424 00000100:00100000:0.0:1789117694.325936:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789117694.325944:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593143424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117694.325991:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593143424:12345-0@lo:400:kworker.0 Request processed in 49us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117694.325998:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00010000:00080000:0.0:1789117694.326028:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbfa86940 x1876025593143424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117694.326068:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593143424:0@lo:400:kworker.0 00000100:00100000:0.0:1789117694.326125:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117694.326151:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593143552:0@lo:400:kworker.0 00000100:00100000:0.0:1789117694.326178:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117694.326200:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593142528:0@lo:400:kworker.0 00000100:00100000:0.0:1789117694.326224:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593143040 00000100:00100000:0.0:1789117694.326228:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593143040 00000100:00100000:0.0:1789117694.326247:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593143552 00000100:00100000:0.0:1789117694.326249:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593143552 00000100:00100000:0.0:1789117694.326264:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789117694.326270:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593143040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117694.326304:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593143040:12345-0@lo:400:kworker.0 Request processed in 34us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117694.326310:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789117694.326321:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789117694.326327:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593143552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117694.326364:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593143552:12345-0@lo:400:kworker.0 Request processed in 39us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117694.326370:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789117694.326406:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593143040:0@lo:400:kworker.0 00000100:00100000:0.0:1789117694.326414:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593143552:0@lo:400:kworker.0 00000100:00080000:0.0:1789117694.326455:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789117694.326460:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789117694.326462:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789117694.327775:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117694.327902:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593142656 00000100:00100000:0.0:1789117694.327910:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593142656 00000100:00100000:0.0:1789117694.327958:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789117694.327966:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593142656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117694.331836:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d80780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593143936:12345-0@lo:400:kworker.0 Request processed in 6038us (6779us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117694.331958:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117694.332015:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593142784:0@lo:400:kworker.0 00000100:00100000:2.0:1789117694.332084:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593143808 00000100:00100000:3.0:1789117694.332178:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:3.0:1789117694.332239:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f6b840 x1876025593143936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117694.332250:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593143936:0@lo:400:kworker.0 00000100:00100000:2.0:1789117694.332697:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593143808 00000100:00100000:2.0:1789117694.332776:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789117694.332787:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593143808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117694.332797:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593143168:0@lo:400:kworker.0 00000100:00100000:1.0:1789117694.332852:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117694.332875:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593143680:0@lo:400:kworker.0 00000100:00100000:1.0:1789117694.332900:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117694.333011:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593143168 00000100:00100000:1.0:1789117694.333016:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593143168 00000100:00100000:1.0:1789117694.333043:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789117694.333049:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593143168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117694.333109:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593143168:12345-0@lo:400:kworker.0 Request processed in 59us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117694.333115:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789117694.333133:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593143680 00000100:00100000:1.0:1789117694.333136:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593143680 00000100:00100000:1.0:1789117694.333163:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789117694.333170:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593143680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117694.333200:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593143680:12345-0@lo:400:kworker.0 Request processed in 32us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117694.333218:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789117694.333348:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593143168:0@lo:400:kworker.0 00010000:00080000:1.0:1789117694.333361:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87dbe580 x1876025593143680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117694.333371:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593143680:0@lo:400:kworker.0 00000100:00100000:2.0:1789117694.333508:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593143808:12345-0@lo:400:kworker.0 Request processed in 722us (1549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117694.333516:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1789117694.333595:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789117694.333601:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789117694.333636:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f6a580 x1876025593143808/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117694.333648:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593143808:0@lo:400:kworker.0 00000100:00100000:0.0:1789117694.333809:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593142656:12345-0@lo:400:kworker.0 Request processed in 5842us (6037us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117694.333817:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789117694.333895:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593142656:0@lo:400:kworker.0 00000100:00100000:1.0:1789117694.821403:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593144064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117694.821509:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117694.822270:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593144064 00000100:00100000:0.0:1789117694.822283:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593144064 00000100:00100000:0.0:1789117694.822358:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789117694.822371:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593144064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789117694.822422:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117694.822514:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593144064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117694.822523:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:1.0:1789117694.822571:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87d82d00 x1876025593144064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117694.822595:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593144064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117694.823470:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593144192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789117694.823544:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117694.823678:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593144192 00000100:00100000:2.0:1789117694.823686:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593144192 00000100:00100000:2.0:1789117694.823747:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789117694.823757:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593144192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789117694.823779:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117694.832891:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593144192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 9121us (9331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117694.832911:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:1.0:1789117694.841099:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87d83480 x1876025593144192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117694.841139:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593144192:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789117694.949475:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789117695.434688:0:13044:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1789117695.844026:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117695.844211:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117695.844250:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117695.844280:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117695.844329:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117695.844367:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572084864 00000100:00100000:0.0:1789117695.844377:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572084864 00000100:00100000:0.0:1789117695.844431:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572085120 00000100:00100000:0.0:1789117695.844435:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572085120 00000100:00100000:0.0:1789117695.844448:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572084736 00000100:00100000:0.0:1789117695.844451:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572084736 00000100:00100000:0.0:1789117695.844461:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572084992 00000100:00100000:0.0:1789117695.844463:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572084992 00000100:00100000:0.0:1789117695.844492:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 215 00000100:00100000:0.0:1789117695.844503:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572084864:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117695.844578:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572084864:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 77us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117695.844597:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 215 00000100:00100000:0.0:1789117695.844617:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 216 00000100:00100000:0.0:1789117695.844624:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+5:2406:x1876025572085120:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117695.844637:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 217 00000100:00100000:2.0:1789117695.844650:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572084736:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117695.844656:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+5:2406:x1876025572085120:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 30us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117695.844665:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 216 00000100:00100000:2.0:1789117695.844688:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572084736:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 42us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117695.844695:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 218 00000100:00100000:2.0:1789117695.844990:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 217 00000100:00080000:2.0:1789117695.845031:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789117695.845035:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789117695.845697:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+5:2406:x1876025572084992:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117695.845759:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+5:2406:x1876025572084992:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 1056us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117695.845768:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 218 00000100:00100000:1.0:1789117695.845917:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572084608 00000100:00100000:1.0:1789117695.845926:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572084608 00000100:00100000:1.0:1789117695.845987:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 321 00000100:00100000:1.0:1789117695.845996:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2406:x1876025572084608:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117695.846027:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2406:x1876025572084608:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 34us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117695.846033:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 321 00010000:00010000:3.0:1789117695.973508:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117696.875430:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789117696.875453:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593144320:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789117696.875525:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117696.875610:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593144320 00000100:00100000:0.0:1789117696.875618:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593144320 00000100:00100000:0.0:1789117696.875680:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789117696.875690:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593144320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789117696.875728:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789117696.875775:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593144320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117696.875793:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789117696.875842:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593144320:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789117697.001191:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117698.021439:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117698.918368:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593144448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117698.918455:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117698.918544:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593144448 00000100:00100000:2.0:1789117698.918552:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593144448 00000100:00100000:2.0:1789117698.918622:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789117698.918633:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593144448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789117698.918665:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117698.918724:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593144448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117698.918732:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1789117698.918757:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789117698.918787:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e4a1c0 x1876025593144448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117698.918807:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593144448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117698.919340:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593144576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789117698.919383:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117698.919505:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593144576 00000100:00100000:3.0:1789117698.919511:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593144576 00000100:00100000:3.0:1789117698.919557:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789117698.919564:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593144576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789117698.919580:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789117698.919777:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789117698.920360:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593144576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 793us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117698.920369:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:0.0:1789117698.920535:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbfa85680 x1876025593144576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117698.920554:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593144576:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789117699.045182:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117699.432429:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593144704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789117699.432532:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117699.432693:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593144704 00000100:00100000:0.0:1789117699.432702:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593144704 00000100:00100000:0.0:1789117699.432753:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789117699.432763:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593144704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789117699.432799:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789117699.432842:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593144704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117699.432849:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789117699.432888:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593144960:0@lo:400:kworker.0 00000100:00100000:1.0:1789117699.432921:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117699.432955:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593145472:0@lo:400:kworker.0 00000100:00100000:1.0:1789117699.432978:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117699.433011:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593145984:0@lo:400:kworker.0 00000100:00100000:1.0:1789117699.433036:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117699.433072:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789117699.433079:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593145088:0@lo:400:kworker.0 00000100:00100000:3.0:1789117699.433083:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593144960 00000100:00100000:3.0:1789117699.433086:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593144960 00000100:00100000:3.0:1789117699.433112:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593145472 00000100:00100000:3.0:1789117699.433115:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593145472 00000100:00100000:1.0:1789117699.433115:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117699.433135:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593145600:0@lo:400:kworker.0 00000100:00100000:3.0:1789117699.433137:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593145088 00000100:00100000:3.0:1789117699.433139:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593145088 00000100:00100000:3.0:1789117699.433151:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789117699.433155:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117699.433168:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593144960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117699.433183:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593145984 00000100:00100000:1.0:1789117699.433186:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593145984 00000100:00100000:3.0:1789117699.433204:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593144960:12345-0@lo:400:kworker.0 Request processed in 47us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117699.433215:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789117699.433218:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789117699.433222:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593145984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117699.433228:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593145600 00000100:00100000:3.0:1789117699.433231:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593145600 00000100:00100000:3.0:1789117699.433245:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789117699.433251:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593145472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117699.433252:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593145984:12345-0@lo:400:kworker.0 Request processed in 32us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117699.433258:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789117699.433277:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593145472:12345-0@lo:400:kworker.0 Request processed in 26us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117699.433277:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789117699.433282:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789117699.433283:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593145088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117699.433292:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1789117699.433296:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593145600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117699.433318:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593145600:12345-0@lo:400:kworker.0 Request processed in 21us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117699.433318:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593145088:12345-0@lo:400:kworker.0 Request processed in 34us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117699.433324:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:3.0:1789117699.433445:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789117699.433450:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789117699.433452:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789117699.436152:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593144832:0@lo:400:kworker.0 00000100:00100000:0.0:1789117699.436254:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117699.436305:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593145344:0@lo:400:kworker.0 00000100:00100000:0.0:1789117699.436330:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117699.436345:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593145856:0@lo:400:kworker.0 00000100:00100000:0.0:1789117699.436365:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117699.436390:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789117699.436396:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593145216:0@lo:400:kworker.0 00000100:00100000:0.0:1789117699.436432:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117699.436448:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876025593145728:0@lo:400:kworker.0 00000100:00100000:0.0:1789117699.436465:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117699.436494:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593145856 00000100:00100000:0.0:1789117699.436500:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593145856 00000100:00100000:0.0:1789117699.436561:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789117699.436570:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593145856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117699.436625:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593145856:12345-0@lo:400:kworker.0 Request processed in 56us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117699.436632:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789117699.436653:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593145216 00000100:00100000:0.0:1789117699.436656:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593145216 00000100:00100000:0.0:1789117699.436677:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789117699.436683:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593145216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117699.436713:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593145216:12345-0@lo:400:kworker.0 Request processed in 31us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117699.436719:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789117699.436737:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593145344 00000100:00100000:0.0:1789117699.436741:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593145344 00000100:00100000:3.0:1789117699.436805:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593144832 00000100:00100000:3.0:1789117699.436809:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593144832 00000100:00100000:3.0:1789117699.436841:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789117699.436848:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3647:x1876025593144832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117699.436881:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3647:x1876025593144832:12345-0@lo:400:kworker.0 Request processed in 35us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117699.436887:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00080000:3.0:1789117699.436919:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789117699.436924:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789117699.436932:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593145728 00000100:00100000:3.0:1789117699.436935:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593145728 00000100:00080000:2.0:1789117699.438740:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789117699.440180:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789117699.440282:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593145088:0@lo:400:kworker.0 00000100:00100000:1.0:1789117699.440297:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593145600:0@lo:400:kworker.0 00000100:00100000:1.0:1789117699.440309:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593144960:0@lo:400:kworker.0 00010000:00080000:1.0:1789117699.440322:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e14780 x1876025593145472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117699.440333:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593145472:0@lo:400:kworker.0 00010000:00080000:1.0:1789117699.440344:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f47480 x1876025593145984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117699.440352:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593145984:0@lo:400:kworker.0 00000100:00100000:1.0:1789117699.441305:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593144704:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117699.442297:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593145216:0@lo:400:kworker.0 00000100:00100000:2.0:1789117699.442311:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593144832:0@lo:400:kworker.0 00010000:00080000:2.0:1789117699.442328:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f44b40 x1876025593145856/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117699.442339:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593145856:0@lo:400:kworker.0 00000100:00100000:3.0:1789117699.445708:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789117699.445733:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593145344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117699.445835:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593145344:12345-0@lo:400:kworker.0 Request processed in 115us (9503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117699.445842:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789117699.445861:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789117699.445868:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876025593145728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117699.445898:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876025593145728:12345-0@lo:400:kworker.0 Request processed in 31us (9432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117699.445904:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00010000:00080000:2.0:1789117699.445977:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f46940 x1876025593145728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117699.446005:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876025593145728:0@lo:400:kworker.0 00000100:00100000:2.0:1789117699.446020:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593145344:0@lo:400:kworker.0 00000020:00000080:2.0:1789117699.603010:0:13192:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc3572a360 20000000:00000080:2.0:1789117699.603028:0:13192:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff962bbfb9b400 uarg=0000000000000000 20000000:01000000:2.0:1789117699.603101:0:13192:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789117699.603108:0:13192:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789117699.603113:0:13192:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789117699.603912:0:13193:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789117699.604298:0:13192:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789117699.610334:0:13192:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789117699.610379:0:13192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962b813db400/0xaa253ed19be1fa4c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117699.610402:0:13192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962a87d92000/0xaa253ed19be1f9e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f9dc expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117699.610410:0:13192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962bbf70ca00/0xaa253ed19be1f9f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f9ea expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117699.610438:0:13192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962baea9b400/0xaa253ed19be1f9ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1f9f8 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117699.610449:0:13192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fa06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed3f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117699.610455:0:13192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962bbf70d000/0xaa253ed19be1fa14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fa0d expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117699.610462:0:13192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b813daa00/0xaa253ed19be1fa29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed7e expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117699.610468:0:13192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962b813db400/0xaa253ed19be1fa4c lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117699.610531:0:13192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b813daa00/0xaa253ed19be1fa29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed7e expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117699.610548:0:13192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962b813daa00/0xaa253ed19be1fa29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed7e expref: 12 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117699.610567:0:13192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13192:1876025593146112:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117699.610764:0:13192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962bbf70d000/0xaa253ed19be1fa14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1fa0d expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117699.610773:0:13192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962bbf70d000/0xaa253ed19be1fa14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1fa0d expref: 23 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117699.610782:0:13192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13192:1876025593146240:0@lo:104: 00000100:00100000:0.0:1789117699.610846:0:13192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789117699.610894:0:13192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fa06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed3f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117699.610903:0:13192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fa06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed3f expref: 12 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117699.610911:0:13192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13192:1876025593146368:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117699.610942:0:13192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962baea9b400/0xaa253ed19be1f9ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f9f8 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117699.610960:0:13192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962baea9b400/0xaa253ed19be1f9ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f9f8 expref: 23 pid: 6513 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117699.610969:0:13192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13192:1876025593146496:0@lo:104: 00000100:00100000:0.0:1789117699.610997:0:13192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789117699.611136:0:13192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962bbf70ca00/0xaa253ed19be1f9f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f9ea expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117699.611144:0:13192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962bbf70ca00/0xaa253ed19be1f9f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f9ea expref: 23 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117699.611152:0:13192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13192:1876025593146624:0@lo:104: 00000100:00100000:0.0:1789117699.611184:0:13192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789117699.612277:0:13192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962a87d92000/0xaa253ed19be1f9e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1f9dc expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117699.612289:0:13192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962a87d92000/0xaa253ed19be1f9e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1f9dc expref: 23 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117699.612317:0:13192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13192:1876025593146752:0@lo:104: 00000100:00100000:0.0:1789117699.612380:0:13192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117699.617979:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593146240 00000100:00100000:2.0:1789117699.618000:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593146240 00000100:00100000:2.0:1789117699.618085:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593146496 00000100:00100000:2.0:1789117699.618089:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593146496 00000100:00100000:2.0:1789117699.618102:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593146624 00000100:00100000:2.0:1789117699.618105:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593146624 00000100:00100000:2.0:1789117699.618123:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789117699.618133:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+5:13192:x1876025593146240:12345-0@lo:104: 00010000:00010000:2.0:1789117699.618157:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1fa0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fa14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117699.618260:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789117699.618267:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+5:13192:x1876025593146240:12345-0@lo:104: Request processed in 136us (7421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117699.618276:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789117699.618298:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789117699.618304:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+4:13192:x1876025593146496:12345-0@lo:104: 00010000:00010000:2.0:1789117699.618312:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962baea9bc00/0xaa253ed19be1f9f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f9ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117699.618354:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789117699.618360:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+4:13192:x1876025593146496:12345-0@lo:104: Request processed in 56us (7362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117699.618386:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789117699.618396:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789117699.618402:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+3:13192:x1876025593146624:12345-0@lo:104: 00010000:00010000:2.0:1789117699.618409:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b89b69600/0xaa253ed19be1f9ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f9f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117699.618436:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789117699.618441:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+3:13192:x1876025593146624:12345-0@lo:104: Request processed in 40us (7257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117699.618446:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:2.0:1789117699.618465:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789117699.618472:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1fa0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fa14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117699.618479:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db600 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:2.0:1789117699.618483:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1fa0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1fa14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117699.618492:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1fa0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1fa14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117699.618500:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1fa0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1fa14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117699.618505:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789117699.618560:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1fa0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fa14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117699.618566:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789117699.618591:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1fa0d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fa14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117699.618599:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b813db600/0xaa253ed19be1fa0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fa14 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117699.618613:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789117699.618616:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962baea9bc00/0xaa253ed19be1f9f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f9ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117699.618621:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9bc00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:2.0:1789117699.618624:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962baea9bc00/0xaa253ed19be1f9f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f9ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117699.618631:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962baea9bc00/0xaa253ed19be1f9f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f9ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117699.618637:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962baea9bc00/0xaa253ed19be1f9f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f9ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117699.618642:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789117699.618651:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962baea9bc00/0xaa253ed19be1f9f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f9ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117699.618656:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789117699.618668:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962baea9bc00/0xaa253ed19be1f9f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f9ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117699.618675:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962baea9bc00/0xaa253ed19be1f9f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f9ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117699.618682:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117699.618689:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b89b69600/0xaa253ed19be1f9ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f9f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117699.618694:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69600 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:2.0:1789117699.618697:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b89b69600/0xaa253ed19be1f9ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f9f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117699.618704:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b89b69600/0xaa253ed19be1f9ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f9f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117699.618710:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b89b69600/0xaa253ed19be1f9ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f9f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117699.618714:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789117699.618723:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b89b69600/0xaa253ed19be1f9ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f9f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117699.618728:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789117699.618733:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b89b69600/0xaa253ed19be1f9ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f9f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117699.618739:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b89b69600/0xaa253ed19be1f9ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f9f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117699.618747:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117699.618749:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117699.618751:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117699.618764:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593147136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789117699.618796:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117699.618829:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789117699.618833:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593147008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789117699.618856:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117699.618879:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593147136 00000100:00100000:2.0:1789117699.618883:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593147136 00010000:00010000:2.0:1789117699.618899:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962bbf70ca00/0xaa253ed19be1f9f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f9ea expref: 24 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117699.618915:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593147008 00000100:00100000:2.0:1789117699.618917:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593147008 00010000:00010000:2.0:1789117699.618924:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962baea9b400/0xaa253ed19be1f9ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f9f8 expref: 25 pid: 6513 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117699.618940:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789117699.618945:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+25:3647:x1876025593147136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789117699.618954:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117699.618959:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962bbf70ca00/0xaa253ed19be1f9f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f9ea expref: 25 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117699.618968:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962bbf70ca00/0xaa253ed19be1f9f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f9ea expref: 25 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117699.618985:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117699.619009:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+25:3647:x1876025593147136:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117699.619015:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789117699.619026:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789117699.619032:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa85e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3647:x1876025593147008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789117699.619039:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117699.619043:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962baea9b400/0xaa253ed19be1f9ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f9f8 expref: 24 pid: 6513 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117699.619085:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962baea9b400/0xaa253ed19be1f9ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f9f8 expref: 24 pid: 6513 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117699.619094:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117699.619118:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa85e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3647:x1876025593147008:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117699.619124:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789117699.619162:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593147008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789117699.619171:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593147136:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789117699.619426:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117699.619433:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117699.619608:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117699.619632:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572085376 00000100:00100000:3.0:1789117699.619636:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572085376 00010000:00010000:3.0:1789117699.619657:0:7470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fa06 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed3f expref: 13 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117699.619678:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 42 00000100:00100000:3.0:1789117699.619685:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2406:x1876025572085376:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117699.619693:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117699.619698:0:7470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fa06 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed3f expref: 13 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117699.619706:0:7470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fa06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed3f expref: 13 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117699.619717:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117699.619763:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2406:x1876025572085376:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 78us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117699.619771:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 42 00000100:00100000:1.0:1789117699.622221:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593146880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117699.622308:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117699.622462:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593146880 00000100:00100000:3.0:1789117699.622470:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593146880 00010000:00010000:3.0:1789117699.622504:0:9524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962bbf70d000/0xaa253ed19be1fa14 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1fa0d expref: 24 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117699.622551:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789117699.622559:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593146880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789117699.622572:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117699.622576:0:9524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962bbf70d000/0xaa253ed19be1fa14 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1fa0d expref: 24 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117699.622586:0:9524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962bbf70d000/0xaa253ed19be1fa14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1fa0d expref: 24 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117699.622604:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117699.622636:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593146880:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117699.622642:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789117699.622677:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593146880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117699.626262:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117699.626398:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572085248 00000100:00100000:3.0:1789117699.626410:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572085248 00010000:00010000:3.0:1789117699.626456:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b813daa00/0xaa253ed19be1fa29 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed7e expref: 13 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117699.626499:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 44 00000100:00100000:3.0:1789117699.626520:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f47c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572085248:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117699.626556:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117699.626563:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b813daa00/0xaa253ed19be1fa29 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed7e expref: 13 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117699.626578:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b813daa00/0xaa253ed19be1fa29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed7e expref: 13 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117699.626602:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117699.626666:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f47c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572085248:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 158us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117699.626675:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 44 00000100:00100000:0.0:1789117699.627487:0:13192:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85fa0cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1789117699.627528:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813daa00/0xaa253ed19be1fa29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed7e expref: 12 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117699.627546:0:13192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13192:1876025593146112:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117699.627560:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bbf70d000/0xaa253ed19be1fa14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1fa0d expref: 23 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117699.627570:0:13192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13192:1876025593146240:0@lo:104: 00010000:00010000:0.0:1789117699.627582:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fa06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed3f expref: 11 pid: 6514 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117699.627590:0:13192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13192:1876025593146368:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117699.627601:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962baea9b400/0xaa253ed19be1f9ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f9f8 expref: 22 pid: 6513 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117699.627609:0:13192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13192:1876025593146496:0@lo:104: 00010000:00010000:0.0:1789117699.627619:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bbf70ca00/0xaa253ed19be1f9f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f9ea expref: 21 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117699.627628:0:13192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13192:1876025593146624:0@lo:104: 00000100:00100000:2.0:1789117699.634483:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593146752 00000100:00100000:2.0:1789117699.634499:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593146752 00000100:00100000:2.0:1789117699.634624:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789117699.634635:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+3:13192:x1876025593146752:12345-0@lo:104: 00010000:00010000:2.0:1789117699.634653:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f9dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f9e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117699.634759:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789117699.634765:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+3:13192:x1876025593146752:12345-0@lo:104: Request processed in 133us (22386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117699.634773:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789117699.634983:0:13192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13192:1876025593146752:0@lo:104: 00010000:00010000:0.0:1789117699.635043:0:13192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962b813db400/0xaa253ed19be1fa4c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117699.635368:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117699.635376:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f9dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1f9e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117699.635384:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9ba00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:3.0:1789117699.635388:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f9dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1f9e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117699.635397:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f9dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1f9e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789117699.635404:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f9dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1f9e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117699.635410:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789117699.635457:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f9dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f9e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117699.635464:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789117699.635493:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f9dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f9e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117699.635500:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962baea9ba00/0xaa253ed19be1f9dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1f9e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117699.635526:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117699.635528:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117699.635530:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117699.635543:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8788ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593147264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789117699.635592:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117699.635643:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593147264 00000100:00100000:3.0:1789117699.635647:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593147264 00010000:00010000:3.0:1789117699.635668:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962a87d92000/0xaa253ed19be1f9e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f9dc expref: 21 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117699.635690:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789117699.635698:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb0939850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+21:3644:x1876025593147264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789117699.635710:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117699.635715:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962a87d92000/0xaa253ed19be1f9e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1f9dc expref: 21 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117699.635725:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962a87d92000/0xaa253ed19be1f9e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1f9dc expref: 21 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117699.635740:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d92000/0xaa253ed19be1f9e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1f9dc expref: 21 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117699.635753:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962b813db400/0xaa253ed19be1fa4c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117699.635771:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813db400/0xaa253ed19be1fa4c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117699.635786:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962b813db400/0xaa253ed19be1fa4c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117699.635793:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962b813db400/0xaa253ed19be1fa4c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117699.635799:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962b813db400/0xaa253ed19be1fa4c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117699.635805:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962b813db400/0xaa253ed19be1fa4c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117699.635810:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db400 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789117699.635813:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962b813db400/0xaa253ed19be1fa4c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117699.635821:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962b813db400/0xaa253ed19be1fa4c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117699.635832:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962b813db400/0xaa253ed19be1fa4c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117699.635841:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117699.635870:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb0939850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+20:3644:x1876025593147264:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117699.635877:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789117699.635925:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8788ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593147264:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789117699.636020:0:13192:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962b813db400/0xaa253ed19be1fa4c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117699.636028:0:13192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962b813db400/0xaa253ed19be1fa4c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117699.636035:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813db400/0xaa253ed19be1fa4c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117699.942343:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117699.942370:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593147392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117699.942444:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117699.945403:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593147392 00000100:00100000:1.0:1789117699.945425:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593147392 00000100:00100000:1.0:1789117699.945527:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789117699.945540:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593147392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789117699.945590:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117699.945692:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593147392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (3247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117699.945716:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:2.0:1789117699.945733:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f452c0 x1876025593147392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117699.945758:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593147392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117699.945934:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789117699.945947:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593147520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789117699.945991:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117699.946037:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593147520 00000100:00100000:0.0:1789117699.946041:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593147520 00000100:00100000:0.0:1789117699.946096:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789117699.946104:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593147520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789117699.946132:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117699.946174:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593147520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117699.946181:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:2.0:1789117699.946265:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87fa3c00 x1876025593147520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117699.946278:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593147520:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789117700.069245:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117700.961768:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117700.961810:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117700.961840:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117700.961865:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117700.961888:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117700.961923:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572085632 00000100:00100000:3.0:1789117700.962102:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572085632 00000100:00100000:3.0:1789117700.962164:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572085888 00000100:00100000:3.0:1789117700.962168:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572085888 00000100:00100000:3.0:1789117700.962262:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572085760 00000100:00100000:3.0:1789117700.962266:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572085760 00000100:00100000:3.0:1789117700.962283:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572086016 00000100:00100000:3.0:1789117700.962285:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572086016 00000100:00100000:3.0:1789117700.962304:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 225 00000100:00100000:3.0:1789117700.962316:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8788ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2404:x1876025572085632:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117700.962423:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8788ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2404:x1876025572085632:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 108us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117700.962433:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 225 00000100:00100000:0.0:1789117700.962907:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 226 00000100:00100000:0.0:1789117700.962918:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2404:x1876025572085888:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117700.962956:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2404:x1876025572085888:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 41us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117700.962963:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 226 00000100:00100000:0.0:1789117700.962981:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 227 00000100:00100000:0.0:1789117700.962996:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2404:x1876025572085760:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117700.963023:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2404:x1876025572085760:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 29us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117700.963030:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 227 00000100:00100000:0.0:1789117700.963042:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 228 00000100:00100000:0.0:1789117700.963049:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2404:x1876025572086016:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117700.963093:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572085504 00000100:00100000:0.0:1789117700.963097:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2404:x1876025572086016:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 48us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117700.963098:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572085504 00000100:00100000:0.0:1789117700.963103:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 228 00000100:00100000:3.0:1789117700.963126:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 323 00000100:00100000:3.0:1789117700.963133:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+11:2404:x1876025572085504:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117700.963159:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+11:2404:x1876025572085504:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 27us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117700.963165:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 323 00000100:00080000:3.0:1789117700.963543:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789117700.963556:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:0.0:1789117701.031402:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789117701.031413:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962b872f5000 from 7 10000000:01000000:0.0:1789117701.031419:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789117701.031502:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1fa53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117701.031515:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1fa53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117701.031528:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1fa53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117701.031563:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593147648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789117701.031657:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117701.031719:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bad82a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789117701.031783:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593147648 00000100:00100000:2.0:1789117701.031791:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593147648 00000100:00100000:2.0:1789117701.031847:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789117701.031858:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+20:6517:x1876025593147648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117701.031875:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117701.031890:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b89b69600/0xaa253ed19be1fa5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1fa53 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117701.031922:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b89b69600/0xaa253ed19be1fa5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1fa53 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117701.031934:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b89b69600/0xaa253ed19be1fa5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fa53 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117701.031943:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69600, rc 0) 00000100:00100000:2.0:1789117701.031983:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593147648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117701.031996:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1789117701.032745:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593147648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117701.032764:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1fa53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fa5a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117701.032784:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1fa53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1fa5a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117701.032854:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593147776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117701.032891:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117701.032928:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bad82a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789117701.032977:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593147776 00000100:00100000:2.0:1789117701.032983:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593147776 00000100:00100000:2.0:1789117701.033019:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789117701.033027:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593147776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117701.033169:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593147776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117701.033186:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1789117701.033756:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593147776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117701.033798:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593147904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117701.033845:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117701.033878:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bad82a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789117701.033924:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593147904 00000100:00100000:2.0:1789117701.033929:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593147904 00000100:00100000:2.0:1789117701.033965:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789117701.033972:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593147904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117701.034090:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593147904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117701.034098:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789117701.034249:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593147904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789117701.035947:0:13222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789117701.036510:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789117701.036540:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789117701.036554:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1fa53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fa5a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117701.036566:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1fa53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fa5a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117701.036578:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789117701.036581:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962bbf4b3000 from 7 10000000:01000000:2.0:1789117701.036584:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789117701.036826:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b89b69a00/0xaa253ed19be1fa61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117701.036837:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b89b69a00/0xaa253ed19be1fa61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117701.036851:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b89b69a00/0xaa253ed19be1fa61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117701.036889:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa85a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593148032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789117701.037007:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117701.037110:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85fec600 going to sleep for 11 seconds 00000100:00100000:0.0:1789117701.037383:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593148032 00000100:00100000:0.0:1789117701.037392:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593148032 00000100:00100000:0.0:1789117701.037535:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789117701.037547:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593148032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117701.037564:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117701.037585:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fa68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1fa61 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117701.037616:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fa68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1fa61 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117701.038386:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fa68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fa61 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117701.038410:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813dba00, rc 0) 00000100:00100000:0.0:1789117701.038570:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593148032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1022us (1561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117701.038578:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1789117701.038934:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa85a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593148032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117701.038958:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b89b69a00/0xaa253ed19be1fa61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fa68 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117701.038969:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b89b69a00/0xaa253ed19be1fa61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1fa68 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117701.039101:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa85a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593148160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117701.039142:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117701.039180:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85fec600 going to sleep for 11 seconds 00000100:00100000:3.0:1789117701.039363:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593148160 00000100:00100000:3.0:1789117701.039371:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593148160 00000100:00100000:3.0:1789117701.039415:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1789117701.039424:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593148160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117701.039574:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593148160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117701.039582:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789117701.039750:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa85a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593148160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117701.039782:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa85a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593148288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117701.039830:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117701.039911:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85fec600 going to sleep for 11 seconds 00000100:00100000:3.0:1789117701.039983:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593148288 00000100:00100000:3.0:1789117701.039989:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593148288 00000100:00100000:3.0:1789117701.040026:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1789117701.040033:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593148288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117701.040158:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593148288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117701.040166:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1789117701.040209:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa85a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593148288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789117701.040940:0:13223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789117701.041013:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789117701.041043:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789117701.041078:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b89b69a00/0xaa253ed19be1fa61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fa68 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117701.041091:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b89b69a00/0xaa253ed19be1fa61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fa68 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117701.041102:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789117701.041106:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962bbcf27000 from 7 10000000:01000000:3.0:1789117701.041108:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789117701.041154:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d92000/0xaa253ed19be1fa6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117701.041163:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a87d92000/0xaa253ed19be1fa6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117701.041173:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a87d92000/0xaa253ed19be1fa6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117701.041196:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8680b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593148416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789117701.041248:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117701.041268:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c1e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117701.041285:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593148416 00000100:00100000:3.0:1789117701.041290:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593148416 00000100:00100000:3.0:1789117701.041320:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789117701.041328:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593148416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117701.041337:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117701.041351:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d92800/0xaa253ed19be1fa76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1fa6f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117701.041373:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d92800/0xaa253ed19be1fa76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1fa6f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117701.041383:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d92800/0xaa253ed19be1fa76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fa6f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117701.041392:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92800, rc 0) 00000100:00100000:3.0:1789117701.041424:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593148416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117701.041431:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789117701.041477:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8680b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593148416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117701.041503:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a87d92000/0xaa253ed19be1fa6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fa76 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117701.041512:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a87d92000/0xaa253ed19be1fa6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1fa76 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117701.041560:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8680b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593148544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117701.041588:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117701.041602:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c1e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117701.041614:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593148544 00000100:00100000:3.0:1789117701.041617:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593148544 00000100:00100000:3.0:1789117701.041639:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1789117701.041645:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593148544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117701.041746:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593148544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117701.041752:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1789117701.041783:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8680b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593148544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117701.041809:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8680b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593148672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117701.041849:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117701.041864:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c1e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117701.041874:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593148672 00000100:00100000:3.0:1789117701.041877:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593148672 00000100:00100000:3.0:1789117701.041898:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1789117701.041903:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593148672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117701.041971:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593148672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117701.041982:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1789117701.042018:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8680b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593148672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789117701.045892:0:13224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789117701.046020:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789117701.046046:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789117701.046076:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d92000/0xaa253ed19be1fa6f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fa76 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117701.046089:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a87d92000/0xaa253ed19be1fa6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fa76 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117701.046099:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789117701.046102:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962b9832f800 from 7 10000000:01000000:3.0:1789117701.046104:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789117701.046142:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1fa7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117701.046150:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1fa7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117701.046161:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1fa7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117701.046189:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8680b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593148800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789117701.046272:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117701.046314:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c1e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117701.046335:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593148800 00000100:00100000:3.0:1789117701.046340:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593148800 00000100:00100000:3.0:1789117701.046378:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1789117701.046386:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593148800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117701.046411:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117701.046424:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d92e00/0xaa253ed19be1fa84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1fa7d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117701.046592:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d92e00/0xaa253ed19be1fa84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1fa7d expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117701.046604:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d92e00/0xaa253ed19be1fa84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fa7d expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117701.046613:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92e00, rc 0) 00000100:00100000:3.0:1789117701.046664:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593148800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 278us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117701.046672:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1789117701.046723:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8680b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593148800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117701.046739:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1fa7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fa84 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117701.046748:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1fa7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1fa84 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117701.046806:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8680b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593148928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117701.046831:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117701.046847:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c1e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117701.047018:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593148928 00000100:00100000:0.0:1789117701.047023:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593148928 00000100:00100000:0.0:1789117701.047068:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1789117701.047077:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593148928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117701.047194:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593148928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117701.047201:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1789117701.049117:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8680b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593148928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117701.049179:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8680b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593149056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117701.049367:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117701.049413:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c1e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117701.049541:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593149056 00000100:00100000:0.0:1789117701.049547:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593149056 00000100:00100000:0.0:1789117701.049592:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1789117701.049601:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593149056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117701.049744:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593149056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117701.049753:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1789117701.050214:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8680b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593149056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789117701.056606:0:13225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789117701.060855:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789117701.060895:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789117701.060906:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1fa7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fa84 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117701.060920:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1fa7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fa84 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117701.093275:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117701.218374:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117701.218468:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572086144 00000100:00100000:0.0:1789117701.218491:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572086144 00000100:00100000:0.0:1789117701.218561:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 336 00000100:00100000:0.0:1789117701.218577:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+11:6181:x1876025572086144:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117701.218608:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117701.218629:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813db600/0xaa253ed19be1fa8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0edaf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117701.218662:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813db600/0xaa253ed19be1fa8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edaf expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117701.218675:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813db600/0xaa253ed19be1fa8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edaf expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117701.218685:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813db600, rc 0) 00000100:00100000:0.0:1789117701.218757:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+12:6181:x1876025572086144:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 Request processed in 182us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117701.218765:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 336 00000100:00100000:1.0:1789117701.222380:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117701.222513:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572086272 00000100:00100000:0.0:1789117701.222524:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572086272 00000100:00100000:0.0:1789117701.222633:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 337 00000100:00100000:0.0:1789117701.222646:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+12:6181:x1876025572086272:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117701.222868:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+12:6181:x1876025572086272:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 Request processed in 224us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117701.222877:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 337 00000100:00100000:1.0:1789117701.227775:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117701.229427:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572086400 00000100:00100000:2.0:1789117701.229445:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572086400 00000100:00100000:2.0:1789117701.229530:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 338 00000100:00100000:2.0:1789117701.229540:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+12:6181:x1876025572086400:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117701.230469:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+12:6181:x1876025572086400:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 Request processed in 925us (2706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117701.230491:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 338 00000100:00100000:2.0:1789117701.238451:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117701.238972:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572086528 00000100:00100000:1.0:1789117701.238987:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572086528 00000100:00100000:1.0:1789117701.239111:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 339 00000100:00100000:1.0:1789117701.239126:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+12:6181:x1876025572086528:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117701.239151:0:9525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117701.239174:0:9525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbf70d400/0xaa253ed19be1fa92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0edb6 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117701.239204:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbf70d400/0xaa253ed19be1fa92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edb6 expref: 13 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117701.239216:0:9525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbf70d400/0xaa253ed19be1fa92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edb6 expref: 13 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117701.239226:0:9525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70d400, rc 0) 00000100:00100000:1.0:1789117701.240040:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+13:6181:x1876025572086528:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 Request processed in 909us (1605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117701.240050:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 339 00000100:00100000:1.0:1789117701.244784:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117701.245291:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572086656 00000100:00100000:3.0:1789117701.245311:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572086656 00000100:00100000:3.0:1789117701.245566:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 340 00000100:00100000:3.0:1789117701.245582:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+13:6181:x1876025572086656:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117701.245821:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+13:6181:x1876025572086656:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 Request processed in 242us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117701.245830:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 340 00000100:00100000:2.0:1789117701.250350:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117701.250663:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572086784 00000100:00100000:3.0:1789117701.250679:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572086784 00000100:00100000:3.0:1789117701.250760:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 341 00000100:00100000:3.0:1789117701.250773:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:6181:x1876025572086784:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117701.251176:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:6181:x1876025572086784:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 Request processed in 404us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117701.251187:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 341 00000100:00100000:2.0:1789117701.994633:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593149184:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789117701.994750:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117701.995017:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593149184 00000100:00100000:0.0:1789117701.995034:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593149184 00000100:00100000:0.0:1789117701.996324:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789117701.996339:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593149184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789117701.996389:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789117701.996488:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593149184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 155us (1739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117701.996496:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789117701.999121:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593149184:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789117702.118204:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117703.147254:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789117703.667002:0:13391:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1789117704.037547:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86808780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593149312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117704.037647:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117704.037730:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593149312 00000100:00100000:1.0:1789117704.037743:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593149312 00000100:00100000:1.0:1789117704.037824:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789117704.037837:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593149312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789117704.037901:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117704.037956:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593149312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117704.037964:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1789117704.038002:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789117704.038003:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a86808780 x1876025593149312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117704.038021:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86808780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593149312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117704.039494:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593149440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789117704.039585:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117704.043974:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593149440 00000100:00100000:1.0:1789117704.043991:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593149440 00000100:00100000:1.0:1789117704.044170:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789117704.044181:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593149440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789117704.044209:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117704.045840:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593149440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1648us (6243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117704.045858:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1789117704.045972:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789117704.046050:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f461c0 x1876025593149440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117704.046126:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593149440:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789117704.165391:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117704.549367:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593149824:0@lo:400:kworker.0 00000100:00100000:1.0:1789117704.549482:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117704.549557:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593150336:0@lo:400:kworker.0 00000100:00100000:1.0:1789117704.549590:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117704.549614:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593150848:0@lo:400:kworker.0 00000100:00100000:1.0:1789117704.549640:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117704.549670:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789117704.549676:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593149952:0@lo:400:kworker.0 00000100:00100000:1.0:1789117704.549700:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117704.549716:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593150464:0@lo:400:kworker.0 00000100:00100000:1.0:1789117704.549754:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117704.549789:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593149824 00000100:00100000:1.0:1789117704.549798:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593149824 00000100:00100000:1.0:1789117704.549855:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789117704.549867:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593149824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117704.550124:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593149824:12345-0@lo:400:kworker.0 Request processed in 259us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117704.550133:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789117704.550159:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593150848 00000100:00100000:1.0:1789117704.550162:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593150848 00000100:00100000:1.0:1789117704.550194:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789117704.550201:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593150848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117704.550234:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593150848:12345-0@lo:400:kworker.0 Request processed in 34us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117704.550242:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789117704.550280:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593149824:0@lo:400:kworker.0 00010000:00080000:1.0:1789117704.550307:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f46940 x1876025593150848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117704.550320:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593150848:0@lo:400:kworker.0 00000100:00100000:0.0:1789117704.550545:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593150336 00000100:00100000:0.0:1789117704.550550:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593150336 00000100:00100000:0.0:1789117704.550595:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593149952 00000100:00100000:0.0:1789117704.550597:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593149952 00000100:00100000:0.0:1789117704.550609:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593150464 00000100:00100000:0.0:1789117704.550611:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593150464 00000100:00100000:0.0:1789117704.550626:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789117704.550632:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593150336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117704.550671:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593150336:12345-0@lo:400:kworker.0 Request processed in 40us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117704.550678:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789117704.550690:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789117704.550696:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593149952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117704.550724:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593149952:12345-0@lo:400:kworker.0 Request processed in 28us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117704.550741:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789117704.550753:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789117704.550759:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593150464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117704.550786:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593150464:12345-0@lo:400:kworker.0 Request processed in 28us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117704.550792:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789117704.550825:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593150976:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117704.550855:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117704.550888:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593150976 00000100:00100000:0.0:1789117704.550891:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593150976 00000100:00100000:0.0:1789117704.550925:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789117704.550932:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593150976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789117704.550959:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789117704.550997:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593150976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117704.551004:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789117704.551036:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593150976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117704.551628:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593149568:0@lo:400:kworker.0 00000100:00100000:2.0:1789117704.551684:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117704.551731:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593150080:0@lo:400:kworker.0 00000100:00100000:2.0:1789117704.551758:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117704.551779:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593150592:0@lo:400:kworker.0 00000100:00100000:2.0:1789117704.551804:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117704.551828:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789117704.551834:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593149696:0@lo:400:kworker.0 00000100:00100000:2.0:1789117704.551857:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117704.551876:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593150208:0@lo:400:kworker.0 00000100:00100000:0.0:1789117704.552036:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593149568 00000100:00100000:0.0:1789117704.552043:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593149568 00000100:00100000:0.0:1789117704.552096:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1789117704.552104:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3646:x1876025593149568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117704.552144:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3646:x1876025593149568:12345-0@lo:400:kworker.0 Request processed in 41us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117704.552151:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1789117704.552204:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593150592 00000100:00100000:0.0:1789117704.552221:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593150592 00000100:00100000:0.0:1789117704.552247:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593149696 00000100:00100000:0.0:1789117704.552250:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593149696 00000100:00100000:0.0:1789117704.552262:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789117704.552267:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593150592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117704.552378:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593150592:12345-0@lo:400:kworker.0 Request processed in 110us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117704.552386:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789117704.552399:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789117704.552405:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593149696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117704.552446:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593149696:12345-0@lo:400:kworker.0 Request processed in 41us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117704.552452:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789117704.552470:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593150080 00000100:00100000:0.0:1789117704.552474:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593150080 00000100:00100000:0.0:1789117704.552497:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789117704.552502:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593150080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117704.552531:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593150080:12345-0@lo:400:kworker.0 Request processed in 29us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117704.552537:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789117704.552661:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117704.552693:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593150720:0@lo:400:kworker.0 00000100:00100000:2.0:1789117704.552721:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117704.552753:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593149568:0@lo:400:kworker.0 00000100:00100000:2.0:1789117704.552764:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593150080:0@lo:400:kworker.0 00010000:00080000:2.0:1789117704.552778:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f47480 x1876025593150592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117704.552807:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593150592:0@lo:400:kworker.0 00000100:00100000:2.0:1789117704.552832:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593149696:0@lo:400:kworker.0 00000100:00100000:2.0:1789117704.552855:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593150720 00000100:00100000:2.0:1789117704.552859:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593150720 00000100:00100000:2.0:1789117704.552893:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789117704.553044:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8841bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593150720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117704.553111:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8841bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593150720:12345-0@lo:400:kworker.0 Request processed in 69us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117704.553207:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593150208 00000100:00100000:3.0:1789117704.553212:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593150208 00000100:00100000:3.0:1789117704.553251:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789117704.553258:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593150208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117704.553309:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593150208:12345-0@lo:400:kworker.0 Request processed in 39us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117704.553314:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00080000:3.0:1789117704.553376:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789117704.553382:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789117704.553386:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789117704.553497:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593150208:0@lo:400:kworker.0 00010000:00080000:3.0:1789117704.553510:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f47c00 x1876025593150720/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117704.553518:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593150720:0@lo:400:kworker.0 00000100:00100000:0.0:1789117704.554700:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593149952:0@lo:400:kworker.0 00000100:00100000:0.0:1789117704.554720:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593150464:0@lo:400:kworker.0 00010000:00080000:0.0:1789117704.554737:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f461c0 x1876025593150336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117704.554748:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593150336:0@lo:400:kworker.0 00000100:00100000:2.0:1789117704.561631:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789117705.061455:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593151104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117705.061549:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117705.061628:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117705.061636:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593151232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117705.061662:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117705.061690:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593151104 00000100:00100000:1.0:1789117705.061700:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593151104 00000100:00100000:1.0:1789117705.061760:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593151232 00000100:00100000:1.0:1789117705.061764:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593151232 00000100:00100000:1.0:1789117705.061782:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789117705.061790:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86809e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593151104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789117705.061830:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117705.061934:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86809e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593151104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117705.061943:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789117705.061960:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00010000:00080000:3.0:1789117705.061964:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f461c0 x1876025593151104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117705.061966:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593151232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789117705.061976:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117705.061985:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593151104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117705.061998:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593151232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117705.062004:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:3.0:1789117705.062006:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87fa0780 x1876025593151232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117705.062018:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593151232:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789117705.189280:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117706.092869:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117706.092907:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117706.092928:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117706.092947:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117706.092966:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117706.092999:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572087168 00000100:00100000:0.0:1789117706.093009:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572087168 00000100:00100000:0.0:1789117706.093093:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572087424 00000100:00100000:0.0:1789117706.093096:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572087424 00000100:00100000:0.0:1789117706.093111:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572087040 00000100:00100000:0.0:1789117706.093113:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572087040 00000100:00100000:0.0:1789117706.093124:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572087296 00000100:00100000:0.0:1789117706.093126:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572087296 00000100:00100000:0.0:1789117706.093144:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 235 00000100:00100000:0.0:1789117706.093155:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572087168:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117706.093250:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572087168:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 94us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117706.093259:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 235 00000100:00100000:0.0:1789117706.093279:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 236 00000100:00100000:0.0:1789117706.093286:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572087424:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117706.093310:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572087424:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 26us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117706.093316:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 236 00000100:00100000:0.0:1789117706.093327:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 237 00000100:00100000:0.0:1789117706.093332:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2407:x1876025572087040:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117706.093354:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2407:x1876025572087040:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 22us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117706.093371:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 237 00000100:00100000:0.0:1789117706.093383:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 238 00000100:00100000:0.0:1789117706.093400:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572087296:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117706.093424:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572087296:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 26us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117706.093430:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 238 00000100:00080000:3.0:1789117706.093686:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789117706.093692:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789117706.094598:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572086912 00000100:00100000:1.0:1789117706.094606:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572086912 00000100:00100000:1.0:1789117706.094658:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 343 00000100:00100000:1.0:1789117706.094668:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572086912:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117706.094728:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572086912:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 62us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117706.094735:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 343 00010000:00010000:0.0:1789117706.216414:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117707.109307:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8841a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593151360:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789117707.109390:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117707.109572:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593151360 00000100:00100000:2.0:1789117707.109579:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593151360 00000100:00100000:2.0:1789117707.109628:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789117707.109637:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593151360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789117707.109671:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789117707.109728:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593151360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117707.109735:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789117707.109864:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8841a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593151360:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789117707.237518:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117708.261188:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117709.157931:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117709.157965:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8680b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593151488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117709.158108:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117709.158424:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593151488 00000100:00100000:3.0:1789117709.158436:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593151488 00000100:00100000:3.0:1789117709.158517:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789117709.158527:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593151488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789117709.158571:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117709.158631:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593151488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117709.158639:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1789117709.158664:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789117709.158753:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a8680b0c0 x1876025593151488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117725 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117709.158781:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8680b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593151488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117709.159762:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789117709.159780:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593151616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789117709.159835:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117709.159952:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593151616 00000100:00100000:0.0:1789117709.159958:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593151616 00000100:00100000:0.0:1789117709.160016:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789117709.160024:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f45e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593151616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789117709.160043:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117709.160101:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f45e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593151616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117709.160108:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:0.0:1789117709.160142:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f47c00 x1876025593151616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117725 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117709.160158:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593151616:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789117709.160376:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789117709.285886:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117709.669952:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789117709.669982:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593151744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117709.670097:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117709.670192:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593152128:0@lo:400:kworker.0 00000100:00100000:0.0:1789117709.670239:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117709.670270:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593151872:0@lo:400:kworker.0 00000100:00100000:0.0:1789117709.670273:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593152640:0@lo:400:kworker.0 00000100:00100000:0.0:1789117709.670313:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117709.670334:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117709.670359:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789117709.670368:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593152256:0@lo:400:kworker.0 00000100:00100000:1.0:1789117709.670376:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593152384:0@lo:400:kworker.0 00000100:00100000:0.0:1789117709.670396:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117709.670412:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117709.670419:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593152768:0@lo:400:kworker.0 00000100:00100000:0.0:1789117709.670447:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117709.670450:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593152896:0@lo:400:kworker.0 00000100:00100000:0.0:1789117709.670483:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593152128 00000100:00100000:1.0:1789117709.670484:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117709.670492:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593152128 00000100:00100000:1.0:1789117709.670512:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789117709.670519:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593152000:0@lo:400:kworker.0 00000100:00100000:0.0:1789117709.670540:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593152640 00000100:00100000:0.0:1789117709.670544:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593152640 00000100:00100000:1.0:1789117709.670549:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117709.670573:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593152384 00000100:00100000:0.0:1789117709.670577:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593152384 00000100:00100000:1.0:1789117709.670578:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593152512:0@lo:400:kworker.0 00000100:00100000:0.0:1789117709.670593:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593152768 00000100:00100000:0.0:1789117709.670597:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593152768 00000100:00100000:0.0:1789117709.670624:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593152000 00000100:00100000:1.0:1789117709.670625:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117709.670628:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593152000 00000100:00100000:0.0:1789117709.670644:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593152512 00000100:00100000:1.0:1789117709.670645:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593153024:0@lo:400:kworker.0 00000100:00100000:0.0:1789117709.670648:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593152512 00000100:00100000:0.0:1789117709.670671:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789117709.670677:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117709.670684:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593152128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117709.670717:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593151872 00000100:00100000:1.0:1789117709.670723:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593151872 00000100:00100000:0.0:1789117709.670743:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593152128:12345-0@lo:400:kworker.0 Request processed in 61us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117709.670751:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789117709.670759:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1789117709.670769:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593151872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117709.670773:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789117709.670784:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593152640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117709.670822:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593152640:12345-0@lo:400:kworker.0 Request processed in 40us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117709.670835:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593151872:12345-0@lo:400:kworker.0 Request processed in 66us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117709.670842:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789117709.670849:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1789117709.670860:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789117709.670868:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593152384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117709.670891:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789117709.670900:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593152768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117709.670906:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593152384:12345-0@lo:400:kworker.0 Request processed in 38us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117709.670914:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789117709.670928:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789117709.670936:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593152000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117709.670943:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593152768:12345-0@lo:400:kworker.0 Request processed in 43us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117709.670950:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789117709.670969:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789117709.670972:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593152000:12345-0@lo:400:kworker.0 Request processed in 36us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117709.670981:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789117709.670982:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593152512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117709.671007:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593151744 00000100:00100000:0.0:1789117709.671012:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593151744 00000100:00100000:1.0:1789117709.671018:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593152512:12345-0@lo:400:kworker.0 Request processed in 41us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117709.671029:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593152256 00000100:00100000:1.0:1789117709.671033:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789117709.671033:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593152256 00000100:00100000:0.0:1789117709.671049:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789117709.671084:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593152896 00000100:00100000:0.0:1789117709.671089:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593151744:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117709.671090:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593152896 00000004:00000024:0.0:1789117709.671119:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789117709.671120:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593153024 00000100:00100000:1.0:1789117709.671125:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593153024 00000100:00100000:1.0:1789117709.671147:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789117709.671157:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593151744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117709.671158:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593152896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117709.671170:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789117709.671184:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789117709.671191:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593152256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117709.671202:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593152896:12345-0@lo:400:kworker.0 Request processed in 48us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117709.671208:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789117709.671227:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593152256:12345-0@lo:400:kworker.0 Request processed in 35us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117709.671228:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789117709.671238:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593153024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117709.671252:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789117709.671274:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593153024:12345-0@lo:400:kworker.0 Request processed in 36us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117709.671282:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789117709.671298:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593152256:0@lo:400:kworker.0 00000100:00080000:1.0:1789117709.671304:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789117709.671310:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789117709.671312:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789117709.671315:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f452c0 x1876025593152768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117709.671339:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593152768:0@lo:400:kworker.0 00000100:00100000:1.0:1789117709.671356:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593152000:0@lo:400:kworker.0 00000100:00100000:0.0:1789117709.671357:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593152640:0@lo:400:kworker.0 00010000:00080000:1.0:1789117709.671381:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f45680 x1876025593152512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117709.671384:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593152128:0@lo:400:kworker.0 00000100:00100000:1.0:1789117709.671400:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593152512:0@lo:400:kworker.0 00000100:00100000:0.0:1789117709.671404:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593151744:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1789117709.671417:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a48780 x1876025593153024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117709.671427:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593153024:0@lo:400:kworker.0 00000100:00100000:1.0:1789117709.671445:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593151872:0@lo:400:kworker.0 00000100:00100000:1.0:1789117709.671454:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593152384:0@lo:400:kworker.0 00010000:00080000:1.0:1789117709.671463:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f461c0 x1876025593152896/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117709.671470:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593152896:0@lo:400:kworker.0 00000100:00100000:3.0:1789117710.181230:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8680b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593153152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117710.181334:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117710.181418:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593153152 00000100:00100000:3.0:1789117710.181427:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593153152 00000100:00100000:3.0:1789117710.181479:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789117710.181488:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86808780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593153152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789117710.181523:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117710.182121:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86808780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593153152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 631us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117710.182131:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:3.0:1789117710.182189:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a8680b0c0 x1876025593153152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117710.182211:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8680b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593153152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117710.182681:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593153280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117710.182717:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117710.191255:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593153280 00000100:00100000:0.0:1789117710.191630:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593153280 00000100:00100000:0.0:1789117710.191764:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789117710.191785:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593153280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789117710.191819:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117710.191921:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593153280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (9203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117710.191929:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:1.0:1789117710.192008:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a884e43c0 x1876025593153280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117710.192030:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593153280:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789117710.310604:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117711.204434:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117711.204477:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117711.204508:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117711.204531:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117711.204555:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117711.204585:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572087808 00000100:00100000:0.0:1789117711.204595:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572087808 00000100:00100000:0.0:1789117711.204649:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572087680 00000100:00100000:0.0:1789117711.204662:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572087680 00000100:00100000:0.0:1789117711.204679:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572087936 00000100:00100000:0.0:1789117711.204681:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572087936 00000100:00100000:0.0:1789117711.204693:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572088064 00000100:00100000:0.0:1789117711.204696:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572088064 00000100:00100000:0.0:1789117711.204710:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 245 00000100:00100000:0.0:1789117711.204718:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572087808:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117711.204873:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572087552 00000100:00100000:1.0:1789117711.204877:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572087552 00000100:00100000:1.0:1789117711.204912:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 345 00000100:00100000:1.0:1789117711.204919:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2406:x1876025572087552:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117711.204983:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2406:x1876025572087552:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 65us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117711.204990:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 345 00000100:00100000:1.0:1789117711.205023:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 246 00000100:00100000:1.0:1789117711.205029:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572087680:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117711.205091:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572087680:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 24us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117711.205098:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 246 00000100:00100000:1.0:1789117711.205111:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 247 00000100:00100000:1.0:1789117711.205117:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+5:2406:x1876025572087936:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117711.205149:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+5:2406:x1876025572087936:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 33us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117711.205156:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 247 00000100:00100000:1.0:1789117711.205166:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 248 00000100:00100000:1.0:1789117711.205173:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572088064:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117711.205194:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572088064:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 22us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117711.205200:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 248 00000100:00080000:1.0:1789117711.205216:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789117711.205220:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789117711.208115:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572087808:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 3377us (3616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117711.208134:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 245 00010000:00010000:0.0:1789117711.335314:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117712.237372:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593153408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789117712.237465:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117712.237547:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593153408 00000100:00100000:0.0:1789117712.237554:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593153408 00000100:00100000:0.0:1789117712.237613:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789117712.237624:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593153408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789117712.237673:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789117712.245285:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593153408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2983us (3140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117712.245308:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789117712.245443:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593153408:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789117712.378826:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789117712.807557:0:13685:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff2995fa90 20000000:00000080:0.0:1789117712.807579:0:13685:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff962a88537400 uarg=0000000000000000 20000000:01000000:0.0:1789117712.807924:0:13685:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:0.0:1789117712.807933:0:13685:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:0.0:1789117712.807939:0:13685:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 del=0 00000040:00080000:2.0:1789117712.808646:0:13686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789117712.809929:0:13685:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 in log params 00000040:00080000:0.0:1789117712.822387:0:13685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789117712.822426:0:13685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 144 off9680 00000040:00080000:0.0:1789117712.822454:0:13685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9904 10000000:01000000:0.0:1789117712.822469:0:13685:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789117712.822489:0:13685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962b813dbe00/0xaa253ed19be1fa99 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117712.822506:0:13685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b89b69600/0xaa253ed19be1fa5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fa53 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117712.822514:0:13685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fa68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fa61 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117712.822522:0:13685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962a87d92800/0xaa253ed19be1fa76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fa6f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117712.822529:0:13685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962a87d92e00/0xaa253ed19be1fa84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fa7d expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117712.822538:0:13685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b813db600/0xaa253ed19be1fa8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edaf expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117712.822544:0:13685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962bbf70d400/0xaa253ed19be1fa92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edb6 expref: 12 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117712.822550:0:13685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962b813dbe00/0xaa253ed19be1fa99 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117712.822588:0:13685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962bbf70d400/0xaa253ed19be1fa92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edb6 expref: 12 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117712.822621:0:13685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962bbf70d400/0xaa253ed19be1fa92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edb6 expref: 12 pid: 9525 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117712.822635:0:13685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f461c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13685:1876025593153536:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117712.822760:0:13685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b813db600/0xaa253ed19be1fa8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edaf expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117712.822769:0:13685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962b813db600/0xaa253ed19be1fa8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edaf expref: 12 pid: 6513 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117712.822779:0:13685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f44780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13685:1876025593153664:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117712.822812:0:13685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962a87d92e00/0xaa253ed19be1fa84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1fa7d expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117712.822822:0:13685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962a87d92e00/0xaa253ed19be1fa84 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1fa7d expref: 23 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117712.822831:0:13685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f45680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13685:1876025593153792:0@lo:104: 00000100:00100000:0.0:1789117712.826601:0:13685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789117712.826681:0:13685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962a87d92800/0xaa253ed19be1fa76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1fa6f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117712.826698:0:13685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962a87d92800/0xaa253ed19be1fa76 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1fa6f expref: 23 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117712.826714:0:13685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f47480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13685:1876025593153920:0@lo:104: 00000100:00100000:3.0:1789117712.826843:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789117712.826856:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593153792 00000100:00100000:3.0:1789117712.826863:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593153792 00000100:00100000:3.0:1789117712.826914:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789117712.826924:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86d95050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+3:13685:x1876025593153792:12345-0@lo:104: 00010000:00010000:3.0:1789117712.826937:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1fa7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fa84 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117712.826988:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789117712.826993:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86d95050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+3:13685:x1876025593153792:12345-0@lo:104: Request processed in 72us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117712.827000:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1789117712.827087:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117712.827094:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1fa7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fa84 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117712.827102:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93400 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:3.0:1789117712.827108:0:9523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1fa7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1fa84 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117712.827118:0:9523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1fa7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1fa84 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789117712.827125:0:9523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1fa7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1fa84 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117712.827154:0:9523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789117712.827187:0:9523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1fa7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fa84 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117712.827194:0:9523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789117712.827218:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1fa7d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fa84 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117712.827226:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1fa7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fa84 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117712.827241:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117712.827243:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117712.827245:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117712.827276:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593154048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789117712.827318:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117712.827357:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593154048 00000100:00100000:3.0:1789117712.827361:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593154048 00010000:00010000:3.0:1789117712.827381:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962a87d92e00/0xaa253ed19be1fa84 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1fa7d expref: 24 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117712.827404:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789117712.827411:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593154048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789117712.827420:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117712.827425:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962a87d92e00/0xaa253ed19be1fa84 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1fa7d expref: 24 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117712.827632:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962a87d92e00/0xaa253ed19be1fa84 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1fa7d expref: 24 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117712.827659:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117712.827690:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593154048:12345-0@lo:103:ldlm_bl.0 Request processed in 280us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117712.827698:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789117712.827735:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593154048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789117712.828240:0:13685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789117712.828558:0:13685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fa68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1fa61 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117712.828569:0:13685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fa68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1fa61 expref: 23 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117712.828581:0:13685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13685:1876025593154176:0@lo:104: 00000100:00100000:0.0:1789117712.828613:0:13685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789117712.828636:0:13685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b89b69600/0xaa253ed19be1fa5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1fa53 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117712.828644:0:13685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962b89b69600/0xaa253ed19be1fa5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1fa53 expref: 23 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117712.828652:0:13685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f470c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13685:1876025593154304:0@lo:104: 00000100:00100000:0.0:1789117712.828673:0:13685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117712.828685:0:13685:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86dce300 going to sleep for 11 seconds 00010000:00010000:0.0:1789117712.828701:0:13685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d92e00/0xaa253ed19be1fa84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1fa7d expref: 23 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117712.828714:0:13685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f45680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13685:1876025593153792:0@lo:104: 00000100:00100000:3.0:1789117712.828909:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593153920 00000100:00100000:3.0:1789117712.828914:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593153920 00000100:00100000:3.0:1789117712.829012:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593154176 00000100:00100000:3.0:1789117712.829015:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593154176 00000100:00100000:3.0:1789117712.829024:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593154304 00000100:00100000:3.0:1789117712.829026:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593154304 00000100:00100000:3.0:1789117712.829037:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789117712.829044:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f46d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+5:13685:x1876025593153920:12345-0@lo:104: 00010000:00010000:3.0:1789117712.829084:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962a87d92000/0xaa253ed19be1fa6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fa76 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117712.829153:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789117712.829158:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f46d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+5:13685:x1876025593153920:12345-0@lo:104: Request processed in 115us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117712.829166:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789117712.829180:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789117712.829186:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f452c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+4:13685:x1876025593154176:12345-0@lo:104: 00010000:00010000:3.0:1789117712.829193:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b89b69a00/0xaa253ed19be1fa61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fa68 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117712.829226:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789117712.829231:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f452c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+4:13685:x1876025593154176:12345-0@lo:104: Request processed in 46us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117712.829247:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789117712.829269:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789117712.829275:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+3:13685:x1876025593154304:12345-0@lo:104: 00010000:00010000:3.0:1789117712.829283:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1fa53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fa5a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117712.829572:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789117712.829578:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+3:13685:x1876025593154304:12345-0@lo:104: Request processed in 303us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117712.829583:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1789117712.829602:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789117712.829607:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962a87d92000/0xaa253ed19be1fa6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fa76 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117712.829614:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92000 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:3.0:1789117712.829617:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962a87d92000/0xaa253ed19be1fa6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1fa76 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117712.829625:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962a87d92000/0xaa253ed19be1fa6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1fa76 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789117712.829631:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962a87d92000/0xaa253ed19be1fa6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1fa76 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117712.829637:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789117712.829666:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962a87d92000/0xaa253ed19be1fa6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fa76 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117712.829672:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789117712.829699:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962a87d92000/0xaa253ed19be1fa6f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fa76 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117712.829706:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962a87d92000/0xaa253ed19be1fa6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fa76 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117712.829718:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789117712.829722:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b89b69a00/0xaa253ed19be1fa61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fa68 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117712.829728:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69a00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:3.0:1789117712.829731:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b89b69a00/0xaa253ed19be1fa61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1fa68 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117712.830040:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789117712.830086:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593154432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117712.830240:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117712.830521:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593154432 00000100:00100000:1.0:1789117712.830528:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593154432 00010000:00010000:1.0:1789117712.830553:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962a87d92800/0xaa253ed19be1fa76 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1fa6f expref: 23 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117712.830579:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789117712.830586:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+23:3647:x1876025593154432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789117712.830597:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117712.830603:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962a87d92800/0xaa253ed19be1fa76 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1fa6f expref: 23 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117712.830612:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962a87d92800/0xaa253ed19be1fa76 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1fa6f expref: 23 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117712.830640:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789117712.831398:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b89b69a00/0xaa253ed19be1fa61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1fa68 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789117712.831415:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b89b69a00/0xaa253ed19be1fa61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1fa68 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117712.831421:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789117712.831544:0:13685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d92800/0xaa253ed19be1fa76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1fa6f expref: 23 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117712.831559:0:13685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f47480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13685:1876025593153920:0@lo:104: 00010000:00010000:3.0:1789117712.831613:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b89b69a00/0xaa253ed19be1fa61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fa68 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117712.831619:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789117712.831642:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b89b69a00/0xaa253ed19be1fa61 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fa68 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117712.831650:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b89b69a00/0xaa253ed19be1fa61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fa68 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117712.831665:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117712.831681:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1fa53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fa5a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117712.831689:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813daa00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:3.0:1789117712.831692:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1fa53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1fa5a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117712.831701:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1fa53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1fa5a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789117712.831706:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1fa53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1fa5a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117712.831712:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789117712.831726:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1fa53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fa5a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117712.831731:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789117712.831759:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1fa53 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fa5a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117712.831765:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b813daa00/0xaa253ed19be1fa53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fa5a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117712.831782:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117712.831784:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117712.831787:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117712.831800:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117712.831810:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117712.831827:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593154560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117712.831935:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7945443b-b7e4-4157-aee9-c9b2172613e6+22:3647:x1876025593154432:12345-0@lo:103:ldlm_bl.0 Request processed in 1349us (1802us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117712.831945:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789117712.831988:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593154432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117712.832043:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593154688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117712.832092:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117712.832154:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593154688 00000100:00100000:1.0:1789117712.832160:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593154688 00010000:00010000:1.0:1789117712.832186:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b89b69600/0xaa253ed19be1fa5a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1fa53 expref: 22 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117712.832212:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789117712.832221:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+22:3644:x1876025593154688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789117712.832233:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117712.832238:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b89b69600/0xaa253ed19be1fa5a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1fa53 expref: 22 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117712.832248:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b89b69600/0xaa253ed19be1fa5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1fa53 expref: 22 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117712.832278:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117712.832315:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+22:3644:x1876025593154688:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117712.832321:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789117712.832344:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593154688:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789117712.832383:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117712.839320:0:13685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13685:1876025593154176:0@lo:104: 00010000:00010000:0.0:1789117712.839436:0:13685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b89b69600/0xaa253ed19be1fa5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1fa53 expref: 21 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117712.839456:0:13685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f470c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13685:1876025593154304:0@lo:104: 00000100:00100000:3.0:1789117712.840547:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117712.840813:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117712.841138:0:13685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f461c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13685:1876025593153536:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789117712.841152:0:13685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f44780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13685:1876025593153664:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789117712.841187:0:13685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962b813dbe00/0xaa253ed19be1fa99 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117712.842213:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593154560 00000100:00100000:0.0:1789117712.842228:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593154560 00010000:00010000:0.0:1789117712.842286:0:7470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fa68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1fa61 expref: 21 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117712.842318:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572088192 00000100:00100000:0.0:1789117712.842321:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572088192 00010000:00010000:0.0:1789117712.842335:0:7470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962bbf70d400/0xaa253ed19be1fa92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edb6 expref: 13 pid: 9525 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117712.842369:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789117712.842378:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+21:3646:x1876025593154560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789117712.842396:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117712.842401:0:7470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fa68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1fa61 expref: 21 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117712.842411:0:7470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fa68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1fa61 expref: 21 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117712.842429:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fa68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1fa61 expref: 21 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117712.842445:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117712.842460:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 50 00000100:00100000:2.0:1789117712.842472:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572088192:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117712.842485:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117712.842491:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962bbf70d400/0xaa253ed19be1fa92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edb6 expref: 13 pid: 9525 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117712.842505:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962bbf70d400/0xaa253ed19be1fa92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edb6 expref: 13 pid: 9525 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117712.842515:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+20:3646:x1876025593154560:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (1973us total) trans 0 rc 0/0 00010000:00010000:2.0:1789117712.842521:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bbf70d400/0xaa253ed19be1fa92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edb6 expref: 13 pid: 9525 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117712.842528:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:2.0:1789117712.842538:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117712.842597:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b51ebb8-b89b-4376-982e-072902ca33a8+12:2407:x1876025572088192:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 127us (1786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117712.842721:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 50 00000100:00100000:3.0:1789117712.843030:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593154560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789117712.844460:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117712.844552:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572088320 00000100:00100000:1.0:1789117712.844561:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572088320 00010000:00010000:1.0:1789117712.844606:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b813db600/0xaa253ed19be1fa8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edaf expref: 12 pid: 6513 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117712.844654:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00100000:1.0:1789117712.844666:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b51ebb8-b89b-4376-982e-072902ca33a8+12:2406:x1876025572088320:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117712.844686:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117712.844692:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b813db600/0xaa253ed19be1fa8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edaf expref: 12 pid: 6513 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117712.844705:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b813db600/0xaa253ed19be1fa8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edaf expref: 12 pid: 6513 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117712.844727:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813db600/0xaa253ed19be1fa8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edaf expref: 12 pid: 6513 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117712.844746:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962b813dbe00/0xaa253ed19be1fa99 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117712.844755:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813dbe00/0xaa253ed19be1fa99 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117712.844775:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962b813dbe00/0xaa253ed19be1fa99 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117712.844783:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962b813dbe00/0xaa253ed19be1fa99 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117712.844806:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962b813dbe00/0xaa253ed19be1fa99 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117712.844814:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962b813dbe00/0xaa253ed19be1fa99 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117712.844822:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dbe00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117712.844826:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962b813dbe00/0xaa253ed19be1fa99 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117712.844835:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962b813dbe00/0xaa253ed19be1fa99 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117712.844861:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962b813dbe00/0xaa253ed19be1fa99 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117712.844873:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117712.844941:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b51ebb8-b89b-4376-982e-072902ca33a8+11:2406:x1876025572088320:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 277us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117712.844950:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 51 00010000:00010000:2.0:1789117712.845129:0:13685:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962b813dbe00/0xaa253ed19be1fa99 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117712.845142:0:13685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962b813dbe00/0xaa253ed19be1fa99 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117712.845150:0:13685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813dbe00/0xaa253ed19be1fa99 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117713.381361:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117714.277397:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593154816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117714.277480:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117714.277787:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593154944:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789117714.277808:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593154816 00000100:00100000:3.0:1789117714.277817:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593154816 00000100:00100000:1.0:1789117714.277834:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117714.277878:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593154944 00000100:00100000:3.0:1789117714.277883:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593154944 00000100:00080000:1.0:1789117714.277885:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789117714.277908:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789117714.277920:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593154816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789117714.277969:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117714.278032:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593154816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (550us total) trans 0 rc 0/0 00010000:00080000:2.0:1789117714.278102:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b98a6ed00 x1876025593154816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117730 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117714.278123:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593154816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117714.280959:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789117714.280996:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593154944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789117714.281034:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117714.281203:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593154944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 229us (3382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117714.281212:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:2.0:1789117714.281336:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a884e52c0 x1876025593154944/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117730 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117714.281363:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593154944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789117714.287990:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789117714.336204:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117714.336406:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572088448 00000100:00100000:1.0:1789117714.336419:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572088448 00000100:00100000:1.0:1789117714.336496:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 346 00000100:00100000:1.0:1789117714.336509:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+11:6181:x1876025572088448:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117714.336531:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117714.336635:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbf70da00/0xaa253ed19be1faa0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0edbd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117714.336668:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbf70da00/0xaa253ed19be1faa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edbd expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117714.336680:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbf70da00/0xaa253ed19be1faa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edbd expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117714.336689:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70da00, rc 0) 00000100:00100000:2.0:1789117714.338705:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+12:6181:x1876025572088448:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 Request processed in 2176us (2493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117714.338726:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 346 00000100:00100000:3.0:1789117714.345407:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117714.345794:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572088576 00000100:00100000:1.0:1789117714.345807:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572088576 00000100:00100000:1.0:1789117714.345888:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 347 00000100:00100000:1.0:1789117714.345900:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+12:6181:x1876025572088576:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117714.346118:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+12:6181:x1876025572088576:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 Request processed in 220us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117714.346126:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 347 00000100:00100000:0.0:1789117714.351772:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117714.352303:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572088704 00000100:00100000:3.0:1789117714.352317:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572088704 00000100:00100000:3.0:1789117714.352413:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 348 00000100:00100000:3.0:1789117714.352426:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+12:6181:x1876025572088704:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117714.352610:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+12:6181:x1876025572088704:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 Request processed in 188us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117714.352620:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 348 00000100:00100000:0.0:1789117714.363872:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117714.364132:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572088832 00000100:00100000:3.0:1789117714.364144:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572088832 00000100:00100000:3.0:1789117714.364205:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 349 00000100:00100000:3.0:1789117714.364217:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+12:10329:x1876025572088832:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789117714.364415:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+12:10329:x1876025572088832:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 200us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117714.364434:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 349 00000100:00100000:1.0:1789117714.380043:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117714.388666:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572088960 00000100:00100000:2.0:1789117714.388695:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572088960 00000100:00100000:2.0:1789117714.388792:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 350 00000100:00100000:2.0:1789117714.388803:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+12:10329:x1876025572088960:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789117714.388960:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+12:10329:x1876025572088960:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 157us (8928us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117714.388968:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 350 00000100:00100000:0.0:1789117714.394973:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117714.395146:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572089088 00000100:00100000:3.0:1789117714.395158:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572089088 00000100:00100000:3.0:1789117714.395221:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 351 00000100:00100000:3.0:1789117714.395241:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+12:6181:x1876025572089088:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117714.395259:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117714.395277:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d92a00/0xaa253ed19be1faa7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0edc4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117714.395306:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d92a00/0xaa253ed19be1faa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edc4 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117714.395317:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d92a00/0xaa253ed19be1faa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edc4 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117714.395326:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92a00, rc 0) 00000100:00100000:3.0:1789117714.395402:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:6181:x1876025572089088:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 Request processed in 170us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117714.395410:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 351 00000100:00100000:0.0:1789117714.403636:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117714.404186:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572089216 00000100:00100000:2.0:1789117714.404198:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572089216 00000100:00100000:2.0:1789117714.404283:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 352 00000100:00100000:2.0:1789117714.404293:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:6181:x1876025572089216:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117714.404472:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:6181:x1876025572089216:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 Request processed in 180us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117714.404481:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 352 00010000:00010000:3.0:1789117714.405199:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117714.412482:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117714.414506:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572089344 00000100:00100000:3.0:1789117714.414525:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572089344 00000100:00100000:3.0:1789117714.414607:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 353 00000100:00100000:3.0:1789117714.414618:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:6181:x1876025572089344:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117714.414809:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:6181:x1876025572089344:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 Request processed in 193us (2340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117714.414827:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 353 00000100:00100000:0.0:1789117714.425328:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117714.426389:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572089472 00000100:00100000:2.0:1789117714.426401:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572089472 00000100:00100000:2.0:1789117714.426470:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 354 00000100:00100000:2.0:1789117714.426483:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:10332:x1876025572089472:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789117714.426679:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:10332:x1876025572089472:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 188us (1350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117714.426699:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 354 00000100:00100000:0.0:1789117714.431418:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117714.431596:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572089600 00000100:00100000:3.0:1789117714.431608:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572089600 00000100:00100000:3.0:1789117714.431682:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 355 00000100:00100000:3.0:1789117714.431695:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:10332:x1876025572089600:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789117714.431877:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:10332:x1876025572089600:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 184us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117714.431886:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 355 10000000:01000000:1.0:1789117714.661430:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789117714.661444:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962b872f5000 from 7 10000000:01000000:1.0:1789117714.661451:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789117714.661523:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70ca00/0xaa253ed19be1faae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117714.662370:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962bbf70ca00/0xaa253ed19be1faae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117714.662385:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962bbf70ca00/0xaa253ed19be1faae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117714.662416:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884e70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593155072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789117714.662966:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117714.663265:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb900 going to sleep for 11 seconds 00000100:00100000:3.0:1789117714.663383:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593155072 00000100:00100000:3.0:1789117714.663391:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593155072 00000100:00100000:3.0:1789117714.663486:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1789117714.663497:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+20:6517:x1876025593155072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117714.663513:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117714.663540:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d92000/0xaa253ed19be1fab5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1faae expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117714.663568:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d92000/0xaa253ed19be1fab5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1faae expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117714.663579:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d92000/0xaa253ed19be1fab5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1faae expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117714.663589:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92000, rc 0) 00000100:00100000:3.0:1789117714.663646:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593155072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117714.663653:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789117714.663769:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884e70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593155072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117714.663796:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962bbf70ca00/0xaa253ed19be1faae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fab5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117714.663805:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962bbf70ca00/0xaa253ed19be1faae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1fab5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117714.663898:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884e70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593155200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117714.663928:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117714.666279:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb900 going to sleep for 11 seconds 00000100:00100000:2.0:1789117714.668566:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593155200 00000100:00100000:2.0:1789117714.668581:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593155200 00000100:00100000:2.0:1789117714.668678:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1789117714.668690:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593155200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117714.669523:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593155200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 831us (5589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117714.669544:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789117714.670299:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884e70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593155200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117714.670359:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884e70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593155328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117714.670424:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117714.670483:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb900 going to sleep for 11 seconds 00000100:00100000:2.0:1789117714.671981:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593155328 00000100:00100000:2.0:1789117714.671993:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593155328 00000100:00100000:2.0:1789117714.672096:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1789117714.672106:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593155328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117714.672281:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593155328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117714.672289:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789117714.673908:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884e70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593155328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117714.676627:0:13746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:13746:1876025593155456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117714.676869:0:13746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117714.676961:0:13746:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86dce600 going to sleep for 11 seconds 00000100:00100000:2.0:1789117714.677164:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593155456 00000100:00100000:2.0:1789117714.677173:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593155456 00000100:00100000:2.0:1789117714.677282:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1789117714.677294:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba1a92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:13746:x1876025593155456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117714.677450:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba1a92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:13746:x1876025593155456:12345-0@lo:502:llog_process_th.0 Request processed in 157us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117714.677465:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1789117714.677567:0:13746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:13746:1876025593155456:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789117714.677597:0:13746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117714.677607:0:13746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117714.677610:0:13746:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789117714.677620:0:13746:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962b872f5000 00000020:00000080:0.0:1789117714.677623:0:13746:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789117714.677737:0:13746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:13746:1876025593155584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117714.677771:0:13746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117714.685433:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593155584 00000100:00100000:1.0:1789117714.685457:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593155584 00000100:00100000:1.0:1789117714.685578:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1789117714.685591:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba1a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+21:13746:x1876025593155584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117714.686264:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba1a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+21:13746:x1876025593155584:12345-0@lo:502:llog_process_th.0 Request processed in 673us (8489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117714.686277:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1789117714.686359:0:13746:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86dce600 going to sleep for 11 seconds 00000100:00100000:1.0:1789117714.686392:0:13746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:13746:1876025593155584:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789117714.686427:0:13746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117714.686436:0:13746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117714.686438:0:13746:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:1.0:1789117714.686444:0:13746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789117714.686542:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789117714.686572:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789117714.686583:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70ca00/0xaa253ed19be1faae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fab5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117714.686594:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962bbf70ca00/0xaa253ed19be1faae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fab5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117714.686606:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789117714.686609:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962bbf4b3000 from 7 10000000:01000000:1.0:1789117714.686612:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789117714.686648:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70d000/0xaa253ed19be1fabc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117714.686796:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962bbf70d000/0xaa253ed19be1fabc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117714.686807:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962bbf70d000/0xaa253ed19be1fabc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117714.686963:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884e70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593155712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789117714.687008:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117714.687044:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789117714.688030:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593155712 00000100:00100000:2.0:1789117714.688039:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593155712 00000100:00100000:2.0:1789117714.688131:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1789117714.688141:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba1a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593155712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117714.688157:0:9525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117714.688172:0:9525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b89b69e00/0xaa253ed19be1fac3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1fabc expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117714.688197:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b89b69e00/0xaa253ed19be1fac3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1fabc expref: 22 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117714.688208:0:9525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b89b69e00/0xaa253ed19be1fac3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fabc expref: 22 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117714.688217:0:9525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69e00, rc 0) 00000100:00100000:2.0:1789117714.688281:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba1a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593155712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117714.688288:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1789117714.688337:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884e70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593155712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117714.688353:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962bbf70d000/0xaa253ed19be1fabc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fac3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117714.688362:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962bbf70d000/0xaa253ed19be1fabc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1fac3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117714.688427:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88418f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593155840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117714.688467:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117714.688490:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85fa0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789117714.688505:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593155840 00000100:00100000:2.0:1789117714.688508:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593155840 00000100:00100000:3.0:1789117714.689454:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789117714.689468:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90434450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593155840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117714.691332:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90434450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593155840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1857us (2854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117714.691346:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1789117714.691482:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88418f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593155840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117714.691801:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88418f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593155968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117714.692783:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117714.692963:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593155968 00000100:00100000:0.0:1789117714.692972:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593155968 00000100:00100000:0.0:1789117714.693034:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1789117714.693045:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593155968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117714.693198:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593155968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117714.693207:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1789117714.693334:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85fa0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789117714.693360:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88418f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593155968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117714.699420:0:13749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:13749:1876025593156096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117714.699592:0:13749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117714.699645:0:13749:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bc20c99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117714.699801:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593156096 00000100:00100000:0.0:1789117714.699809:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593156096 00000100:00100000:0.0:1789117714.699871:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1789117714.699881:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+22:13749:x1876025593156096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117714.700015:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+22:13749:x1876025593156096:12345-0@lo:502:llog_process_th.0 Request processed in 134us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117714.700024:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1789117714.700328:0:13749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:13749:1876025593156096:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789117714.700372:0:13749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117714.700385:0:13749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117714.700388:0:13749:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789117714.700395:0:13749:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962bbf4b3000 00000020:00000080:3.0:1789117714.700397:0:13749:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789117714.700476:0:13749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:13749:1876025593156224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117714.700519:0:13749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117714.702975:0:13749:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b817a1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117714.703094:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593156224 00000100:00100000:2.0:1789117714.703103:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593156224 00000100:00100000:2.0:1789117714.703163:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1789117714.703173:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90434050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+22:13749:x1876025593156224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117714.703360:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90434050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+22:13749:x1876025593156224:12345-0@lo:502:llog_process_th.0 Request processed in 188us (2840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117714.703369:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1789117714.703450:0:13749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:13749:1876025593156224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789117714.703498:0:13749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117714.703508:0:13749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117714.703511:0:13749:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:2.0:1789117714.703515:0:13749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789117714.707487:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789117714.707602:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789117714.707614:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70d000/0xaa253ed19be1fabc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fac3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117714.707627:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962bbf70d000/0xaa253ed19be1fabc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fac3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117714.707639:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789117714.707642:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962bbcf27000 from 7 10000000:01000000:3.0:1789117714.707661:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789117714.708377:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1faca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117714.708391:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1faca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117714.708407:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1faca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117714.710016:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593156352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789117714.710130:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117714.712791:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85fa00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117714.721159:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593156352 00000100:00100000:0.0:1789117714.721175:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593156352 00000100:00100000:2.0:1789117714.725434:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789117714.725460:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90436450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593156352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117714.725479:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117714.725498:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b89b69800/0xaa253ed19be1fad1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1faca expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117714.725539:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b89b69800/0xaa253ed19be1fad1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1faca expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117714.725550:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b89b69800/0xaa253ed19be1fad1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1faca expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117714.725559:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69800, rc 0) 00000100:00100000:2.0:1789117714.725648:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90436450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593156352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (15517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117714.725664:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1789117714.726970:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593156352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117714.726999:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1faca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fad1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117714.727013:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1faca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1fad1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117714.727149:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884e4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593156480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117714.727207:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117714.727254:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb780 going to sleep for 11 seconds 00000100:00100000:2.0:1789117714.727406:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593156480 00000100:00100000:2.0:1789117714.727413:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593156480 00000100:00100000:2.0:1789117714.727460:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1789117714.727469:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90436050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593156480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117714.727630:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90436050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593156480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117714.727638:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1789117714.727979:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884e4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593156480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117714.728019:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884e4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593156608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117714.728121:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117714.728148:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb780 going to sleep for 11 seconds 00000100:00100000:2.0:1789117714.730244:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593156608 00000100:00100000:2.0:1789117714.730257:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593156608 00000100:00100000:2.0:1789117714.730313:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1789117714.730323:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90434c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593156608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117714.730485:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90434c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593156608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (2363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117714.730500:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1789117714.731739:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884e4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593156608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117714.732373:0:13750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884e4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:13750:1876025593156736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117714.732466:0:13750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117714.732518:0:13750:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb600 going to sleep for 11 seconds 00000100:00100000:2.0:1789117714.732631:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593156736 00000100:00100000:2.0:1789117714.732638:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593156736 00000100:00100000:2.0:1789117714.732699:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1789117714.733723:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+23:13750:x1876025593156736:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117714.733914:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+23:13750:x1876025593156736:12345-0@lo:502:llog_process_th.0 Request processed in 211us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117714.734131:0:13750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884e4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:13750:1876025593156736:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789117714.734169:0:13750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789117714.734181:0:13750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117714.734184:0:13750:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789117714.734194:0:13750:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962bbcf27000 00000020:00000080:1.0:1789117714.734196:0:13750:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789117714.734526:0:13750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884e4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:13750:1876025593156864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117714.734577:0:13750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117714.734611:0:13750:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb600 going to sleep for 11 seconds 00000100:00100000:3.0:1789117714.735153:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593156864 00000100:00100000:3.0:1789117714.735162:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593156864 00000100:00100000:2.0:1789117714.736120:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1789117714.738533:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1789117714.738557:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+23:13750:x1876025593156864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117714.738969:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+23:13750:x1876025593156864:12345-0@lo:502:llog_process_th.0 Request processed in 421us (4389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117714.738980:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1789117714.739121:0:13750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884e4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:13750:1876025593156864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789117714.739164:0:13750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117714.739172:0:13750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117714.739175:0:13750:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:3.0:1789117714.739179:0:13750:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789117714.739382:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789117714.739403:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789117714.739414:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1faca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fad1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117714.739425:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1faca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fad1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117714.739434:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789117714.739437:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962b9832f800 from 7 10000000:01000000:2.0:1789117714.739439:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789117714.739471:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b89b68c00/0xaa253ed19be1fad8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117714.739479:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b89b68c00/0xaa253ed19be1fad8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117714.739489:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b89b68c00/0xaa253ed19be1fad8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117714.739511:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88418f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593156992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789117714.740820:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117714.740866:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bae4709c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117714.742864:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593156992 00000100:00100000:3.0:1789117714.742883:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593156992 00000100:00100000:3.0:1789117714.742964:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1789117714.742975:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90437c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593156992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117714.742996:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117714.743022:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d93a00/0xaa253ed19be1fadf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1fad8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117714.743098:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d93a00/0xaa253ed19be1fadf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1fad8 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117714.743110:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d93a00/0xaa253ed19be1fadf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fad8 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117714.743123:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93a00, rc 0) 00000100:00100000:3.0:1789117714.743264:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90437c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593156992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 290us (2448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117714.743271:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1789117714.743341:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88418f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593156992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117714.743358:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b89b68c00/0xaa253ed19be1fad8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fadf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117714.743367:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b89b68c00/0xaa253ed19be1fad8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1fadf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117714.743453:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593157120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117714.743490:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117714.743510:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b98932180 going to sleep for 11 seconds 00000100:00100000:2.0:1789117714.743645:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593157120 00000100:00100000:2.0:1789117714.743650:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593157120 00000100:00100000:2.0:1789117714.744263:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1789117714.744272:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90437050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593157120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117714.744404:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90437050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593157120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117714.744412:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1789117714.744474:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593157120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117714.744518:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88418f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593157248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117714.747642:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117714.747697:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bae4706c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117714.747855:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593157248 00000100:00100000:3.0:1789117714.747864:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593157248 00000100:00100000:3.0:1789117714.747934:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1789117714.747946:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593157248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117714.748096:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593157248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117714.748116:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1789117714.748215:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88418f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593157248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117714.751363:0:13752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:13752:1876025593157376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117714.751474:0:13752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117714.752644:0:13752:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5cd4600 going to sleep for 11 seconds 00000100:00100000:2.0:1789117714.761920:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593157376 00000100:00100000:2.0:1789117714.761940:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593157376 00000100:00100000:2.0:1789117714.762025:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1789117714.762035:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90434850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:13752:x1876025593157376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117714.762260:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90434850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:13752:x1876025593157376:12345-0@lo:502:llog_process_th.0 Request processed in 225us (10786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117714.762269:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1789117714.762406:0:13752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:13752:1876025593157376:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789117714.762443:0:13752:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117714.762452:0:13752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117714.762455:0:13752:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789117714.762461:0:13752:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962b9832f800 00000020:00000080:3.0:1789117714.762464:0:13752:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789117714.762571:0:13752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:13752:1876025593157504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117714.762614:0:13752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117714.762642:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593157504 00000100:00100000:3.0:1789117714.762646:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593157504 00000100:00100000:3.0:1789117714.762678:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1789117714.762685:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:13752:x1876025593157504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117714.762760:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:13752:x1876025593157504:12345-0@lo:502:llog_process_th.0 Request processed in 75us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117714.762768:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1789117714.762810:0:13752:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5cd4600 going to sleep for 11 seconds 00000100:00100000:3.0:1789117714.762823:0:13752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:13752:1876025593157504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789117714.762841:0:13752:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117714.762845:0:13752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117714.762847:0:13752:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:3.0:1789117714.762850:0:13752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789117714.765841:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789117714.765883:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789117714.765895:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b89b68c00/0xaa253ed19be1fad8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fadf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117714.765910:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b89b68c00/0xaa253ed19be1fad8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fadf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117714.789209:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789117714.789243:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593157632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117714.789333:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117714.789389:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593157632 00000100:00100000:0.0:1789117714.789398:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593157632 00000100:00100000:0.0:1789117714.789451:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789117714.789463:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593157632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789117714.789499:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789117714.789558:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593157632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117714.789566:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789117714.789611:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593157632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117714.803579:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593157760:0@lo:400:kworker.0 00000100:00100000:0.0:1789117714.803656:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117714.804108:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593157760 00000100:00100000:1.0:1789117714.804117:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593157760 00000100:00100000:1.0:1789117714.804164:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789117714.804173:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593157760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117714.804249:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593157760:12345-0@lo:400:kworker.0 Request processed in 76us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117714.804257:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789117714.804297:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593157760:0@lo:400:kworker.0 00000100:00100000:1.0:1789117714.804525:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789117714.804605:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593158016:0@lo:400:kworker.0 00000100:00100000:0.0:1789117714.804641:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117714.804673:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593158016 00000100:00100000:0.0:1789117714.804674:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789117714.804682:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593158144:0@lo:400:kworker.0 00000100:00100000:0.0:1789117714.804716:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117714.804749:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593158016 00000100:00100000:2.0:1789117714.804789:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789117714.804797:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593158016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117714.804877:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593158272:0@lo:400:kworker.0 00000100:00100000:1.0:1789117714.804906:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117714.804950:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593158016:12345-0@lo:400:kworker.0 Request processed in 153us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117714.804959:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789117714.804975:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593157888:0@lo:400:kworker.0 00000100:00100000:2.0:1789117714.804996:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593158016:0@lo:400:kworker.0 00000100:00100000:1.0:1789117714.805005:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117714.805112:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593158400:0@lo:400:kworker.0 00000100:00100000:2.0:1789117714.805132:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593158528:0@lo:400:kworker.0 00000100:00100000:3.0:1789117714.805146:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117714.805172:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a868183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593158912:0@lo:400:kworker.0 00000100:00100000:2.0:1789117714.805173:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117714.805205:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86819e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593159040:0@lo:400:kworker.0 00000100:00100000:3.0:1789117714.805208:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117714.805251:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117714.805274:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789117714.805282:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593158656:0@lo:400:kworker.0 00000100:00100000:3.0:1789117714.805293:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789117714.805302:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593158784:0@lo:400:kworker.0 00000100:00100000:0.0:1789117714.812242:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593158144 00000100:00100000:0.0:1789117714.812265:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593158144 00000100:00100000:0.0:1789117714.812350:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593158272 00000100:00100000:0.0:1789117714.812355:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593158272 00000100:00100000:0.0:1789117714.812372:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593157888 00000100:00100000:0.0:1789117714.812375:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593157888 00000100:00100000:0.0:1789117714.812395:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789117714.812404:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593158144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117714.812492:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593158144:12345-0@lo:400:kworker.0 Request processed in 89us (7775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117714.812500:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789117714.812517:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789117714.812685:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593158272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117714.812796:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593158272:12345-0@lo:400:kworker.0 Request processed in 272us (7889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117714.812802:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789117714.812888:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789117714.812898:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593157888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117714.812933:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593157888:12345-0@lo:400:kworker.0 Request processed in 38us (7930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117714.812939:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00080000:0.0:1789117714.812964:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789117714.812968:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789117714.813006:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b98a6ed00 x1876025593158272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117714.813021:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593158272:0@lo:400:kworker.0 00000100:00100000:0.0:1789117714.813035:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593157888:0@lo:400:kworker.0 00000100:00100000:1.0:1789117714.813262:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593158400 00000100:00100000:1.0:1789117714.813267:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593158400 00000100:00100000:1.0:1789117714.813291:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593158528 00000100:00100000:1.0:1789117714.813294:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593158528 00000100:00100000:1.0:1789117714.813305:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593158912 00000100:00100000:1.0:1789117714.813308:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593158912 00000100:00100000:1.0:1789117714.813323:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593159040 00000100:00100000:1.0:1789117714.813326:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593159040 00000100:00100000:1.0:1789117714.813408:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789117714.813415:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86818f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593158400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117714.813457:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86818f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593158400:12345-0@lo:400:kworker.0 Request processed in 43us (8312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117714.813464:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789117714.813475:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789117714.813481:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88418f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593158528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117714.813509:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88418f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593158528:12345-0@lo:400:kworker.0 Request processed in 29us (8340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117714.813516:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789117714.813601:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789117714.813608:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a868192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593158912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117714.813640:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a868192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593158912:12345-0@lo:400:kworker.0 Request processed in 33us (8433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117714.813656:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789117714.813668:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789117714.813674:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8841a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593159040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117714.813782:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8841a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593159040:12345-0@lo:400:kworker.0 Request processed in 107us (8529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117714.813788:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789117714.813901:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789117714.813977:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789117714.814043:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b98a6e940 x1876025593158400/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117714.814086:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593158400:0@lo:400:kworker.0 00010000:00080000:1.0:1789117714.814101:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a868183c0 x1876025593158912/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117714.814111:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a868183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593158912:0@lo:400:kworker.0 00000100:00100000:1.0:1789117714.814140:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789117714.819187:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e48f00 x1876025593158528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117714.819209:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593158528:0@lo:400:kworker.0 00010000:00080000:1.0:1789117714.819238:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a86819e00 x1876025593159040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117714.819247:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86819e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593159040:0@lo:400:kworker.0 00000100:00100000:1.0:1789117714.819269:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593158144:0@lo:400:kworker.0 00000100:00100000:2.0:1789117714.819382:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593158784 00000100:00100000:2.0:1789117714.819391:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593158784 00000100:00100000:2.0:1789117714.819471:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593158656 00000100:00100000:2.0:1789117714.819476:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593158656 00000100:00100000:2.0:1789117714.819500:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789117714.819512:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593158784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117714.821147:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789117714.821170:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593158656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117714.821431:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593158656:12345-0@lo:400:kworker.0 Request processed in 268us (7288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117714.821440:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789117714.821627:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593158656:0@lo:400:kworker.0 00000100:00100000:2.0:1789117714.821886:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593158784:12345-0@lo:400:kworker.0 Request processed in 2375us (7983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117714.821895:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00080000:2.0:1789117714.821922:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789117714.821926:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87fa2580 x1876025593158784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789117714.821928:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789117714.822020:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593158784:0@lo:400:kworker.0 00000100:00100000:1.0:1789117715.301940:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117715.301968:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593159168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117715.303253:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117715.303369:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593159168 00000100:00100000:1.0:1789117715.303379:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593159168 00000100:00100000:1.0:1789117715.303436:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789117715.303446:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593159168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789117715.303480:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117715.303541:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593159168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (1462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117715.303549:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:1.0:1789117715.303607:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a884e6940 x1876025593159168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117715.303628:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593159168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117715.305156:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593159296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789117715.305247:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117715.305766:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593159296 00000100:00100000:1.0:1789117715.305775:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593159296 00000100:00100000:1.0:1789117715.305825:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789117715.305834:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593159296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789117715.305856:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117715.305898:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593159296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117715.305906:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:0.0:1789117715.307207:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a4da40 x1876025593159296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117715.307245:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593159296:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789117715.442326:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117716.323514:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117716.323566:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117716.323596:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117716.323621:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117716.323651:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117716.323690:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572089984 00000100:00100000:0.0:1789117716.323707:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572089984 00000100:00100000:0.0:1789117716.323787:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572090240 00000100:00100000:0.0:1789117716.323790:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572090240 00000100:00100000:0.0:1789117716.323805:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572089856 00000100:00100000:0.0:1789117716.323807:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572089856 00000100:00100000:0.0:1789117716.323818:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572090112 00000100:00100000:0.0:1789117716.323820:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572090112 00000100:00100000:0.0:1789117716.323834:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 255 00000100:00100000:0.0:1789117716.323844:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2404:x1876025572089984:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117716.323960:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2404:x1876025572089984:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 114us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117716.323971:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 255 00000100:00100000:0.0:1789117716.324000:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 256 00000100:00100000:0.0:1789117716.324013:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100c793d-0063-4934-90f0-b04fc41ff903+5:2404:x1876025572090240:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117716.324138:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100c793d-0063-4934-90f0-b04fc41ff903+5:2404:x1876025572090240:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 127us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117716.324149:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 256 00000100:00100000:0.0:1789117716.324174:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 257 00000100:00100000:0.0:1789117716.324188:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2404:x1876025572089856:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117716.324227:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2404:x1876025572089856:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 45us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117716.324233:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 257 00000100:00100000:0.0:1789117716.324244:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 258 00000100:00100000:0.0:1789117716.324251:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100c793d-0063-4934-90f0-b04fc41ff903+5:2404:x1876025572090112:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117716.324273:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100c793d-0063-4934-90f0-b04fc41ff903+5:2404:x1876025572090112:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 23us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117716.324279:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 258 00000100:00080000:0.0:1789117716.324302:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789117716.324306:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789117716.324730:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572089728 00000100:00100000:2.0:1789117716.324741:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572089728 00000100:00100000:2.0:1789117716.324796:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 376 00000100:00100000:2.0:1789117716.324804:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2404:x1876025572089728:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117716.324848:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2404:x1876025572089728:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 45us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117716.324878:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 376 00010000:00010000:3.0:1789117716.453167:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117717.353270:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117717.355881:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593159424:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789117717.356008:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117717.358820:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593159424 00000100:00100000:3.0:1789117717.358839:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593159424 00000100:00100000:3.0:1789117717.358940:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789117717.358952:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593159424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789117717.358998:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789117717.359162:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593159424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 211us (3154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117717.359170:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789117717.359334:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593159424:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789117717.478670:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117718.502819:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117719.398794:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789117719.398826:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593159552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117719.399976:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117719.401691:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117719.401714:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593159680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789117719.401777:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117719.401829:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593159552 00000100:00100000:1.0:1789117719.401838:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593159552 00000100:00100000:1.0:1789117719.401893:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593159680 00000100:00100000:1.0:1789117719.401898:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593159680 00000100:00100000:1.0:1789117719.401933:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789117719.401942:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593159552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789117719.401971:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117719.402019:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593159552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (2051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117719.402027:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789117719.402043:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789117719.402050:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593159680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789117719.402079:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117719.402109:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593159680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117719.402115:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1789117719.402147:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789117719.402182:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a884e6940 x1876025593159680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117719.402204:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593159680:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1789117719.403567:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f47c00 x1876025593159552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117719.403590:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593159552:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789117719.526657:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117719.909390:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593159808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117719.909503:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117719.910031:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593159808 00000100:00100000:3.0:1789117719.910040:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593159808 00000100:00100000:3.0:1789117719.910116:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789117719.910139:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593159808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789117719.910197:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789117719.910384:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593159936:0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.910432:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117719.910505:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593159936 00000100:00100000:2.0:1789117719.910509:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593159936 00000100:00100000:2.0:1789117719.910537:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1789117719.910543:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593159936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.910578:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593159936:12345-0@lo:400:kworker.0 Request processed in 35us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117719.910585:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1789117719.910650:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593159936:0@lo:400:kworker.0 00000100:00100000:3.0:1789117719.911915:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593159808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1778us (2399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117719.911931:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789117719.912435:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593160064:0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.912498:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117719.912533:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593160576:0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.912568:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117719.912588:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593161088:0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.912623:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117719.912647:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789117719.912653:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593160192:0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.912678:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117719.912695:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593160704:0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.912726:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117719.912746:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593161216:0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.912770:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117719.912801:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593160064 00000100:00100000:2.0:1789117719.912808:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593160064 00000100:00100000:2.0:1789117719.912848:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593160576 00000100:00100000:2.0:1789117719.912850:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593160576 00000100:00100000:2.0:1789117719.912875:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593161088 00000100:00100000:2.0:1789117719.912878:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593161088 00000100:00100000:2.0:1789117719.912890:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593160192 00000100:00100000:2.0:1789117719.912892:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593160192 00000100:00100000:2.0:1789117719.912904:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789117719.912913:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593160064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.912964:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593160064:12345-0@lo:400:kworker.0 Request processed in 52us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117719.912972:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789117719.912987:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789117719.912993:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593160576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.913021:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593160576:12345-0@lo:400:kworker.0 Request processed in 29us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117719.913036:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789117719.913048:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789117719.913084:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593161088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.913117:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593161088:12345-0@lo:400:kworker.0 Request processed in 64us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117719.913123:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789117719.913147:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789117719.913153:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593160192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.913181:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593160192:12345-0@lo:400:kworker.0 Request processed in 29us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117719.913187:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789117719.913213:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593160704 00000100:00100000:2.0:1789117719.913217:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593160704 00000100:00100000:2.0:1789117719.913238:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593161216 00000100:00100000:2.0:1789117719.913240:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593161216 00000100:00100000:2.0:1789117719.913256:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789117719.913262:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfc05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593160704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.913289:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfc05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593160704:12345-0@lo:400:kworker.0 Request processed in 28us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117719.913295:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789117719.913449:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789117719.913454:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593161216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.913480:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593161216:12345-0@lo:400:kworker.0 Request processed in 26us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117719.913485:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1789117719.913513:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789117719.913518:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789117719.913534:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88626940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593160448:0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.913559:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117719.913574:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a886243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593160960:0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.913591:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117719.913607:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789117719.913613:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88625e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593160320:0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.913637:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117719.913654:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88624f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593160832:0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.913675:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117719.913690:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88626580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593161344:0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.913711:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117719.913732:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593160832 00000100:00100000:2.0:1789117719.913735:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593160832 00000100:00100000:2.0:1789117719.913756:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593161344 00000100:00100000:2.0:1789117719.913758:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593161344 00000100:00100000:2.0:1789117719.913776:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789117719.913781:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593160832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.913811:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593160832:12345-0@lo:400:kworker.0 Request processed in 30us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117719.913815:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789117719.913825:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789117719.913829:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593161344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.913851:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593161344:12345-0@lo:400:kworker.0 Request processed in 21us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117719.913864:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789117719.913881:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593160448 00000100:00100000:2.0:1789117719.913884:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593160448 00000100:00100000:2.0:1789117719.913902:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593160960 00000100:00100000:2.0:1789117719.913905:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593160960 00000100:00100000:2.0:1789117719.913916:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789117719.913920:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593160448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.913949:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593160448:12345-0@lo:400:kworker.0 Request processed in 29us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117719.913955:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789117719.913966:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789117719.913972:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593160960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.913998:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593160960:12345-0@lo:400:kworker.0 Request processed in 27us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117719.914003:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1789117719.914018:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789117719.914021:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117719.914029:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593160320 00000100:00100000:2.0:1789117719.914033:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593160320 00000100:00100000:2.0:1789117719.914080:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789117719.914086:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593160320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.914119:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593160320:12345-0@lo:400:kworker.0 Request processed in 33us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117719.914137:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789117719.914177:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88625e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593160320:0@lo:400:kworker.0 00010000:00080000:2.0:1789117719.914192:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88624f00 x1876025593160832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117719.914208:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88624f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593160832:0@lo:400:kworker.0 00010000:00080000:2.0:1789117719.914220:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88626580 x1876025593161344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117719.914227:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88626580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593161344:0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.914237:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88626940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593160448:0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.914245:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a886243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593160960:0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.914279:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593160192:0@lo:400:kworker.0 00010000:00080000:2.0:1789117719.914289:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88627480 x1876025593160704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117719.914296:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593160704:0@lo:400:kworker.0 00010000:00080000:2.0:1789117719.914305:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88627840 x1876025593161216/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117719.914311:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593161216:0@lo:400:kworker.0 00000100:00100000:2.0:1789117719.914322:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593160064:0@lo:400:kworker.0 00010000:00080000:2.0:1789117719.914331:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88624b40 x1876025593160576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117719.914338:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593160576:0@lo:400:kworker.0 00010000:00080000:2.0:1789117719.914348:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88624000 x1876025593161088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117719.914356:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593161088:0@lo:400:kworker.0 00000100:00100000:1.0:1789117719.914735:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593159808:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1789117720.193904:0:13984:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff4ef01870 20000000:00000080:3.0:1789117720.193926:0:13984:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff962a86de3800 uarg=0000000000000000 20000000:01000000:3.0:1789117720.193968:0:13984:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='lod.lustre-MDT0001-mdtlov.enable_compr_rotational=1' 20000000:01000000:3.0:1789117720.193975:0:13984:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.lustre-MDT0001-mdtlov.enable_compr_rotational=1' 20000000:01000000:3.0:1789117720.193981:0:13984:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/lod.lustre-MDT0001-mdtlov.enable_compr_rotational=1 del=0 00000040:00080000:0.0:1789117720.199817:0:13985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1789117720.200003:0:13984:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.lod.lustre-MDT0001-mdtlov.enable_compr_rotational=1 in log params 00000040:00080000:2.0:1789117720.205677:0:13984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10128 00000040:00080000:2.0:1789117720.205715:0:13984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 144 off10272 00000040:00080000:2.0:1789117720.205737:0:13984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10496 10000000:01000000:2.0:1789117720.205752:0:13984:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789117720.205775:0:13984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962b89b69000/0xaa253ed19be1fae6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117720.205800:0:13984:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962bbf70da00/0xaa253ed19be1faa0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edbd expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117720.205808:0:13984:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962a87d92a00/0xaa253ed19be1faa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edc4 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117720.205817:0:13984:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962a87d92000/0xaa253ed19be1fab5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1faae expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117720.205824:0:13984:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b89b69e00/0xaa253ed19be1fac3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fabc expref: 23 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117720.205831:0:13984:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b89b69800/0xaa253ed19be1fad1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1faca expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117720.205837:0:13984:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962a87d93a00/0xaa253ed19be1fadf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fad8 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117720.205844:0:13984:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962b89b69000/0xaa253ed19be1fae6 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117720.205895:0:13984:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962a87d93a00/0xaa253ed19be1fadf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1fad8 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117720.205931:0:13984:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962a87d93a00/0xaa253ed19be1fadf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1fad8 expref: 23 pid: 6513 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117720.205960:0:13984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e1da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13984:1876025593161472:0@lo:104: 00000100:00100000:2.0:1789117720.206081:0:13984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117720.206157:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593161472 00010000:00010000:2.0:1789117720.206161:0:13984:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b89b69800/0xaa253ed19be1fad1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1faca expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117720.206165:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593161472 00010000:00010000:2.0:1789117720.206170:0:13984:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962b89b69800/0xaa253ed19be1fad1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1faca expref: 23 pid: 6512 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117720.206178:0:13984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13984:1876025593161600:0@lo:104: 00000100:00100000:2.0:1789117720.206202:0:13984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789117720.210473:0:13984:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b89b69e00/0xaa253ed19be1fac3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1fabc expref: 23 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117720.210497:0:13984:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962b89b69e00/0xaa253ed19be1fac3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1fabc expref: 23 pid: 9525 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117720.210515:0:13984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86808f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13984:1876025593161728:0@lo:104: 00000100:00100000:2.0:1789117720.210580:0:13984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117720.212236:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593161600 00000100:00100000:1.0:1789117720.212253:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593161600 00000100:00100000:1.0:1789117720.212327:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789117720.212338:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+4:13984:x1876025593161472:12345-0@lo:104: 00010000:00010000:1.0:1789117720.212356:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b89b68c00/0xaa253ed19be1fad8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fadf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117720.212728:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789117720.212736:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+4:13984:x1876025593161472:12345-0@lo:104: Request processed in 401us (6656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117720.212744:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789117720.212766:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789117720.212772:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+3:13984:x1876025593161600:12345-0@lo:104: 00010000:00010000:1.0:1789117720.212781:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1faca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fad1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117720.212823:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789117720.212829:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+3:13984:x1876025593161600:12345-0@lo:104: Request processed in 57us (6625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117720.212835:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:1.0:1789117720.212861:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789117720.212867:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b89b68c00/0xaa253ed19be1fad8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fadf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117720.212875:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b68c00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789117720.212894:0:9523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b89b68c00/0xaa253ed19be1fad8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1fadf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117720.212902:0:9523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b89b68c00/0xaa253ed19be1fad8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1fadf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117720.212909:0:9523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b89b68c00/0xaa253ed19be1fad8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1fadf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117720.212914:0:9523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789117720.213349:0:9523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b89b68c00/0xaa253ed19be1fad8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fadf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117720.213357:0:9523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117720.213381:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b89b68c00/0xaa253ed19be1fad8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fadf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117720.213390:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b89b68c00/0xaa253ed19be1fad8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fadf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117720.213405:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117720.213409:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1faca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fad1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117720.213416:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93400 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789117720.213418:0:9523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1faca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1fad1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117720.213425:0:9523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1faca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1fad1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117720.213443:0:9523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1faca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1fad1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117720.213448:0:9523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789117720.213464:0:9523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1faca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fad1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117720.213471:0:9523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117720.213504:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1faca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fad1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117720.213511:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962a87d93400/0xaa253ed19be1faca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fad1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117720.213520:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117720.213522:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117720.213524:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117720.213551:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593161856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117720.213602:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117720.213644:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593161984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117720.213667:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117720.213699:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593161856 00000100:00100000:1.0:1789117720.213704:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593161856 00010000:00010000:1.0:1789117720.213726:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962a87d93a00/0xaa253ed19be1fadf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1fad8 expref: 24 pid: 6513 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117720.213745:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593161984 00000100:00100000:1.0:1789117720.213748:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593161984 00010000:00010000:1.0:1789117720.213758:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b89b69800/0xaa253ed19be1fad1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1faca expref: 25 pid: 6512 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117720.213786:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789117720.213794:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb093b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+25:3645:x1876025593161856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789117720.213805:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117720.213810:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962a87d93a00/0xaa253ed19be1fadf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1fad8 expref: 25 pid: 6513 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117720.213820:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962a87d93a00/0xaa253ed19be1fadf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1fad8 expref: 25 pid: 6513 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117720.213838:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117720.213867:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb093b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+25:3645:x1876025593161856:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117720.213874:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789117720.213915:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789117720.213923:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3646:x1876025593161984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789117720.213929:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117720.213933:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b89b69800/0xaa253ed19be1fad1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1faca expref: 24 pid: 6512 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117720.213942:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b89b69800/0xaa253ed19be1fad1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1faca expref: 24 pid: 6512 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117720.213966:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117720.213983:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117720.213996:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3646:x1876025593161984:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117720.214003:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789117720.214048:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593161984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117720.214103:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593161856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117720.224262:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593161728 00000100:00100000:1.0:1789117720.224284:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593161728 00010000:00010000:2.0:1789117720.224320:0:13984:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962a87d92000/0xaa253ed19be1fab5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1faae expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117720.224344:0:13984:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962a87d92000/0xaa253ed19be1fab5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1faae expref: 23 pid: 6512 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117720.224365:0:13984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbcb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13984:1876025593162112:0@lo:104: 00000100:00100000:1.0:1789117720.224415:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789117720.224432:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86808b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+3:13984:x1876025593161728:12345-0@lo:104: 00010000:00010000:1.0:1789117720.224453:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962bbf70d000/0xaa253ed19be1fabc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fac3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117720.224482:0:13984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789117720.224545:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789117720.224567:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86808b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+3:13984:x1876025593161728:12345-0@lo:104: Request processed in 134us (13981us total) trans 0 rc 0/0 00010000:00010000:0.0:1789117720.224569:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789117720.224577:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:0.0:1789117720.224579:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bbf70d000/0xaa253ed19be1fabc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fac3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117720.224588:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d000 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117720.224592:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70d000/0xaa253ed19be1fabc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1fac3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117720.224630:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bbf70d000/0xaa253ed19be1fabc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1fac3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117720.224638:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70d000/0xaa253ed19be1fabc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1fac3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117720.224644:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789117720.224683:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962bbf70d000/0xaa253ed19be1fabc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fac3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117720.224690:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117720.224716:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bbf70d000/0xaa253ed19be1fabc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fac3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117720.224724:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bbf70d000/0xaa253ed19be1fabc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fac3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117720.224741:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117720.224743:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117720.224744:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117720.227289:0:13984:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962a87d92a00/0xaa253ed19be1faa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edc4 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117720.227327:0:13984:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962a87d92a00/0xaa253ed19be1faa7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edc4 expref: 12 pid: 6514 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117720.227345:0:13984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13984:1876025593162368:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789117720.228405:0:13984:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962bbf70da00/0xaa253ed19be1faa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edbd expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117720.228423:0:13984:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962bbf70da00/0xaa253ed19be1faa0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edbd expref: 12 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117720.228436:0:13984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13984:1876025593162496:192.168.204.30@tcp:104: 00000100:00100000:1.0:1789117720.228543:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789117720.229334:0:13984:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b829ea300 going to sleep for 11 seconds 00010000:00010000:2.0:1789117720.229374:0:13984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d93a00/0xaa253ed19be1fadf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1fad8 expref: 23 pid: 6513 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117720.229390:0:13984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e1da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13984:1876025593161472:0@lo:104: 00010000:00010000:2.0:1789117720.229404:0:13984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b89b69800/0xaa253ed19be1fad1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1faca expref: 22 pid: 6512 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117720.229412:0:13984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13984:1876025593161600:0@lo:104: 00000100:00100000:2.0:1789117720.229435:0:13984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86808f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13984:1876025593161728:0@lo:104: 00000100:00100000:1.0:1789117720.229600:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593162112 00000100:00100000:1.0:1789117720.229608:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593162112 00000100:00100000:1.0:1789117720.229654:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789117720.229662:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8cac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+3:13984:x1876025593162112:12345-0@lo:104: 00010000:00010000:1.0:1789117720.229677:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962bbf70ca00/0xaa253ed19be1faae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fab5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117720.230214:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789117720.230222:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8cac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+3:13984:x1876025593162112:12345-0@lo:104: Request processed in 560us (5741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117720.230232:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:1.0:1789117720.230311:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117720.230317:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bbf70ca00/0xaa253ed19be1faae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fab5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117720.230344:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70ca00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789117720.230348:0:9523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70ca00/0xaa253ed19be1faae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1fab5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117720.230356:0:9523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bbf70ca00/0xaa253ed19be1faae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1fab5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117720.230362:0:9523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70ca00/0xaa253ed19be1faae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1fab5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117720.230367:0:9523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789117720.230447:0:13984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbcb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13984:1876025593162112:0@lo:104: 00000100:00100000:2.0:1789117720.230668:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593162240:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789117720.231801:0:9523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962bbf70ca00/0xaa253ed19be1faae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fab5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117720.231814:0:9523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789117720.231919:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593162624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789117720.231989:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789117720.232129:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bbf70ca00/0xaa253ed19be1faae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fab5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117720.232139:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bbf70ca00/0xaa253ed19be1faae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fab5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117720.232160:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117720.232163:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117720.232166:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117720.232182:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593162624 00000100:00100000:1.0:1789117720.232189:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593162624 00010000:00010000:1.0:1789117720.232217:0:9524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962a87d92000/0xaa253ed19be1fab5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1faae expref: 22 pid: 6512 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117720.232248:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789117720.232271:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a886252c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7945443b-b7e4-4157-aee9-c9b2172613e6+22:3644:x1876025593162624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789117720.232285:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117720.232291:0:9524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962a87d92000/0xaa253ed19be1fab5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1faae expref: 22 pid: 6512 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117720.232302:0:9524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962a87d92000/0xaa253ed19be1fab5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1faae expref: 22 pid: 6512 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117720.232319:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d92000/0xaa253ed19be1fab5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1faae expref: 22 pid: 6512 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117720.232331:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117720.233198:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117720.233275:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593162240 00000100:00100000:2.0:1789117720.233282:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593162240 00010000:00010000:2.0:1789117720.233306:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b89b69e00/0xaa253ed19be1fac3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1fabc expref: 22 pid: 9525 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117720.233334:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789117720.233342:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd15a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+22:3647:x1876025593162240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789117720.233355:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117720.233358:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b89b69e00/0xaa253ed19be1fac3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1fabc expref: 22 pid: 9525 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117720.233369:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b89b69e00/0xaa253ed19be1fac3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1fabc expref: 22 pid: 9525 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117720.233383:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b89b69e00/0xaa253ed19be1fac3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1fabc expref: 22 pid: 9525 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117720.233396:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117720.234269:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:3.0:1789117720.235268:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117720.235300:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572090368 00000100:00100000:3.0:1789117720.235310:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572090368 00010000:00010000:3.0:1789117720.235353:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962a87d92a00/0xaa253ed19be1faa7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edc4 expref: 13 pid: 6514 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117720.235382:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 56 00000100:00100000:3.0:1789117720.235393:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572090368:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117720.235408:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117720.235414:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962a87d92a00/0xaa253ed19be1faa7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edc4 expref: 13 pid: 6514 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117720.235433:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962a87d92a00/0xaa253ed19be1faa7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edc4 expref: 13 pid: 6514 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117720.235470:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117720.235537:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572090368:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 144us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117720.235545:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 56 00000100:00100000:2.0:1789117720.238092:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd15a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+21:3647:x1876025593162240:12345-0@lo:103:ldlm_bl.0 Request processed in 4741us (4888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117720.238106:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789117720.238280:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593162240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117720.239107:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a886252c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7945443b-b7e4-4157-aee9-c9b2172613e6+20:3644:x1876025593162624:12345-0@lo:103:ldlm_bl.0 Request processed in 6828us (7108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117720.239131:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:2.0:1789117720.239289:0:13984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d92a00/0xaa253ed19be1faa7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edc4 expref: 12 pid: 6514 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117720.239308:0:13984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13984:1876025593162368:192.168.204.30@tcp:104: 00000100:00100000:0.0:1789117720.242687:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593162624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789117720.247133:0:13984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13984:1876025593162496:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789117720.247199:0:13984:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962b89b69000/0xaa253ed19be1fae6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117720.254377:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117720.254477:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572090496 00000100:00100000:0.0:1789117720.254494:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572090496 00010000:00010000:0.0:1789117720.254531:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962bbf70da00/0xaa253ed19be1faa0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edbd expref: 12 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117720.254587:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 57 00000100:00100000:0.0:1789117720.254597:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b51ebb8-b89b-4376-982e-072902ca33a8+12:2406:x1876025572090496:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117720.254613:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117720.254619:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962bbf70da00/0xaa253ed19be1faa0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edbd expref: 12 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117720.254632:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962bbf70da00/0xaa253ed19be1faa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edbd expref: 12 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117720.254649:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bbf70da00/0xaa253ed19be1faa0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edbd expref: 12 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117720.254666:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962b89b69000/0xaa253ed19be1fae6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117720.254674:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b89b69000/0xaa253ed19be1fae6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117720.254690:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962b89b69000/0xaa253ed19be1fae6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117720.254696:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962b89b69000/0xaa253ed19be1fae6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117720.254702:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962b89b69000/0xaa253ed19be1fae6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117720.254708:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962b89b69000/0xaa253ed19be1fae6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117720.254724:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69000 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789117720.254729:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962b89b69000/0xaa253ed19be1fae6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117720.254736:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962b89b69000/0xaa253ed19be1fae6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117720.254758:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962b89b69000/0xaa253ed19be1fae6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117720.254768:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117720.254845:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b51ebb8-b89b-4376-982e-072902ca33a8+11:2406:x1876025572090496:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 244us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117720.254854:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 57 00010000:00010000:2.0:1789117720.255021:0:13984:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962b89b69000/0xaa253ed19be1fae6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117720.255031:0:13984:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962b89b69000/0xaa253ed19be1fae6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117720.255038:0:13984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b89b69000/0xaa253ed19be1fae6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117720.422769:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a886261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593162752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789117720.422875:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117720.422973:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593162752 00000100:00100000:0.0:1789117720.422982:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593162752 00000100:00100000:0.0:1789117720.423042:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789117720.423051:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a886270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593162752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789117720.423104:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117720.423163:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a886270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593162752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117720.423171:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:0.0:1789117720.423275:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a886261c0 x1876025593162752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117720.423295:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a886261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593162752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789117720.424763:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593162880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117720.425028:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117720.425143:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593162880 00000100:00100000:2.0:1789117720.425152:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593162880 00000100:00100000:2.0:1789117720.425198:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789117720.425207:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593162880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789117720.425235:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117720.425281:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593162880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117720.425288:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:2.0:1789117720.425323:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbfd17c00 x1876025593162880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117720.425342:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593162880:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789117720.549967:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117721.316661:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117721.316739:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572090624 00000100:00100000:1.0:1789117721.316749:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572090624 00000100:00100000:1.0:1789117721.316807:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 378 00000100:00100000:1.0:1789117721.316817:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+11:6181:x1876025572090624:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117721.316833:0:9525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117721.316852:0:9525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbf70da00/0xaa253ed19be1faed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0edcb expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117721.316879:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbf70da00/0xaa253ed19be1faed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edcb expref: 12 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117721.316891:0:9525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbf70da00/0xaa253ed19be1faed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edcb expref: 12 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117721.316913:0:9525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70da00, rc 0) 00000100:00100000:1.0:1789117721.316978:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+12:6181:x1876025572090624:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 Request processed in 164us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117721.316986:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 378 00000100:00100000:1.0:1789117721.330111:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117721.330296:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572090752 00000100:00100000:2.0:1789117721.330307:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572090752 00000100:00100000:2.0:1789117721.330363:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 379 00000100:00100000:2.0:1789117721.330379:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83ada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+12:6181:x1876025572090752:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117721.330566:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83ada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+12:6181:x1876025572090752:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 Request processed in 186us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117721.330575:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 379 00000100:00100000:2.0:1789117721.338846:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117721.340221:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572090880 00000100:00100000:3.0:1789117721.340234:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572090880 00000100:00100000:3.0:1789117721.340294:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 380 00000100:00100000:3.0:1789117721.340304:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b904e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+12:6181:x1876025572090880:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117721.340466:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b904e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+12:6181:x1876025572090880:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 Request processed in 162us (1630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117721.340475:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 380 00000100:00100000:1.0:1789117721.355734:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117721.355846:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572091008 00000100:00100000:0.0:1789117721.355860:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572091008 00000100:00100000:0.0:1789117721.355930:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 381 00000100:00100000:0.0:1789117721.355941:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b904eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+12:10388:x1876025572091008:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789117721.359863:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b904eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+12:10388:x1876025572091008:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 3912us (4129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117721.359878:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 381 00000100:00100000:3.0:1789117721.369941:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117721.370517:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572091136 00000100:00100000:1.0:1789117721.370530:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572091136 00000100:00100000:1.0:1789117721.370599:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 382 00000100:00100000:1.0:1789117721.370610:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b904eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+12:10388:x1876025572091136:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789117721.370895:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b904eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+12:10388:x1876025572091136:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 286us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117721.370906:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 382 00000100:00100000:3.0:1789117721.378800:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117721.379260:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572091264 00000100:00100000:0.0:1789117721.379271:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572091264 00000100:00100000:0.0:1789117721.379325:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 383 00000100:00100000:0.0:1789117721.379336:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b904e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+12:6181:x1876025572091264:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117721.379353:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117721.379376:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813db600/0xaa253ed19be1faf4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0edd2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117721.379406:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813db600/0xaa253ed19be1faf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edd2 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117721.379418:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813db600/0xaa253ed19be1faf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edd2 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117721.379429:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813db600, rc 0) 00000100:00100000:0.0:1789117721.379505:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b904e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:6181:x1876025572091264:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 Request processed in 171us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117721.379512:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 383 00000100:00100000:0.0:1789117721.385650:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117721.385750:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572091392 00000100:00100000:3.0:1789117721.385759:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572091392 00000100:00100000:3.0:1789117721.385812:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 384 00000100:00100000:3.0:1789117721.385822:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+13:6181:x1876025572091392:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117721.385972:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+13:6181:x1876025572091392:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 Request processed in 150us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117721.385980:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 384 00000100:00100000:3.0:1789117721.397409:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117721.397654:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572091520 00000100:00100000:1.0:1789117721.397668:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572091520 00000100:00100000:1.0:1789117721.397744:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 385 00000100:00100000:1.0:1789117721.397757:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:6181:x1876025572091520:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117721.397939:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:6181:x1876025572091520:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 Request processed in 183us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117721.397947:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 385 00000100:00100000:0.0:1789117721.407834:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117721.409761:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572091648 00000100:00100000:3.0:1789117721.409777:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572091648 00000100:00100000:3.0:1789117721.409846:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 386 00000100:00100000:3.0:1789117721.409857:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+13:10391:x1876025572091648:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789117721.410030:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+13:10391:x1876025572091648:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 174us (2206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117721.410045:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 386 00000100:00100000:0.0:1789117721.424858:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117721.424988:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572091776 00000100:00100000:2.0:1789117721.424998:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572091776 00000100:00100000:2.0:1789117721.425129:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 387 00000100:00100000:2.0:1789117721.425247:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:10391:x1876025572091776:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789117721.427190:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:10391:x1876025572091776:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 2042us (2331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117721.427202:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 387 00000100:00100000:1.0:1789117721.445971:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117721.446022:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117721.446048:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117721.446115:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117721.446161:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572091904 00000100:00100000:1.0:1789117721.446171:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572091904 00000100:00100000:1.0:1789117721.446235:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572092160 00000100:00100000:1.0:1789117721.446239:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572092160 00000100:00100000:1.0:1789117721.446266:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572092032 00000100:00100000:1.0:1789117721.446268:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572092032 00000100:00100000:1.0:1789117721.446281:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572092288 00000100:00100000:1.0:1789117721.446283:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572092288 00000100:00100000:1.0:1789117721.446299:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 265 00000100:00100000:1.0:1789117721.446308:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2405:x1876025572091904:12345-192.168.204.30@tcp:400:kworker.0 00000100:00080000:2.0:1789117721.446361:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789117721.446561:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117721.447029:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 266 00000100:00100000:3.0:1789117721.447042:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572092160:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117721.447185:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572092160:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 145us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117721.447195:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 266 00000100:00100000:2.0:1789117721.447296:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 267 00000100:00100000:2.0:1789117721.447304:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2405:x1876025572092032:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117721.447889:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2405:x1876025572092032:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 583us (1837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117721.447897:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 267 00000100:00100000:2.0:1789117721.447917:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 268 00000100:00100000:2.0:1789117721.447926:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572092288:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117721.447974:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572092288:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 51us (1861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117721.447987:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 268 00000100:00100000:1.0:1789117721.448148:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2405:x1876025572091904:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 1840us (2187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117721.448157:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 265 00010000:00010000:0.0:1789117721.573265:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789117721.573645:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789117721.573650:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962b872f5000 from 10 10000000:01000000:1.0:1789117721.573655:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789117721.573699:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70c200/0xaa253ed19be1fafb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117721.573711:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962bbf70c200/0xaa253ed19be1fafb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117721.573734:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962bbf70c200/0xaa253ed19be1fafb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117721.573763:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884e4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593163008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789117721.573834:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117721.573892:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5cd4000 going to sleep for 11 seconds 00000100:00100000:3.0:1789117721.574348:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593163008 00000100:00100000:3.0:1789117721.574357:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593163008 00000100:00100000:3.0:1789117721.574418:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1789117721.574429:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+20:6517:x1876025593163008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117721.574444:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117721.574462:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d93000/0xaa253ed19be1fb02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1fafb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117721.574491:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d93000/0xaa253ed19be1fb02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1fafb expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117721.574503:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d93000/0xaa253ed19be1fb02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fafb expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117721.574513:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93000, rc 0) 00000100:00100000:3.0:1789117721.574578:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593163008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117721.574584:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1789117721.574672:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884e4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593163008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117721.574688:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962bbf70c200/0xaa253ed19be1fafb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fb02 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117721.574697:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962bbf70c200/0xaa253ed19be1fafb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1fb02 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117721.574765:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593163136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117721.574795:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117721.574828:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b829eae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789117721.574929:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593163136 00000100:00100000:3.0:1789117721.574933:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593163136 00000100:00100000:3.0:1789117721.574965:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1789117721.574972:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593163136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117721.580011:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593163136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5028us (5203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117721.580039:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1789117721.580361:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593163136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117721.580426:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593163264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117721.580481:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117721.580524:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b829eae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789117721.580841:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593163264 00000100:00100000:3.0:1789117721.580849:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593163264 00000100:00100000:3.0:1789117721.580920:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1789117721.580931:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593163264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117721.581320:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593163264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 390us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117721.581327:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1789117721.581438:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593163264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117721.583228:0:14045:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbcb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14045:1876025593163392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117721.583321:0:14045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117721.583363:0:14045:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c22e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789117721.583441:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593163392 00000100:00100000:3.0:1789117721.583448:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593163392 00000100:00100000:3.0:1789117721.583492:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1789117721.583500:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:14045:x1876025593163392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117721.583621:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:14045:x1876025593163392:12345-0@lo:502:llog_process_th.0 Request processed in 121us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117721.583629:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1789117721.583686:0:14045:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbcb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14045:1876025593163392:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789117721.583738:0:14045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789117721.583747:0:14045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117721.583750:0:14045:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789117721.583756:0:14045:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962b872f5000 00000020:00000080:1.0:1789117721.583759:0:14045:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789117721.583842:0:14045:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884e4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14045:1876025593163520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117721.583878:0:14045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117721.583904:0:14045:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5cd4000 going to sleep for 11 seconds 00000100:00100000:3.0:1789117721.585747:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593163520 00000100:00100000:3.0:1789117721.585762:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593163520 00000100:00100000:3.0:1789117721.585821:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1789117721.585833:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+21:14045:x1876025593163520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117721.586009:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+21:14045:x1876025593163520:12345-0@lo:502:llog_process_th.0 Request processed in 178us (2130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117721.586018:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1789117721.586279:0:14045:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884e4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14045:1876025593163520:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789117721.586313:0:14045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117721.586321:0:14045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117721.586324:0:14045:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000040:00080000:0.0:1789117721.586329:0:14045:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789117721.586403:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:1.0:1789117721.586429:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789117721.586442:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70c200/0xaa253ed19be1fafb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fb02 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117721.586456:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962bbf70c200/0xaa253ed19be1fafb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fb02 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117721.586468:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789117721.586472:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962bbf4b3000 from 10 10000000:01000000:1.0:1789117721.586475:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789117721.586509:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be1fb09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117721.586518:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be1fb09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117721.586528:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be1fb09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117721.586552:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884e52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593163648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789117721.586603:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117721.586643:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d2e480 going to sleep for 11 seconds 00000100:00100000:3.0:1789117721.586690:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593163648 00000100:00100000:3.0:1789117721.586695:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593163648 00000100:00100000:3.0:1789117721.586734:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1789117721.586742:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593163648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117721.586760:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117721.586774:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d92600/0xaa253ed19be1fb10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1fb09 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117721.586797:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d92600/0xaa253ed19be1fb10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1fb09 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117721.586809:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d92600/0xaa253ed19be1fb10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fb09 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117721.586819:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92600, rc 0) 00000100:00100000:3.0:1789117721.586853:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593163648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117721.586860:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1789117721.586904:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884e52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593163648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117721.586917:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be1fb09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fb10 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117721.586927:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be1fb09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1fb10 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117721.586982:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86818f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593163776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117721.587005:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117721.587019:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86fe9840 going to sleep for 11 seconds 00000100:00100000:3.0:1789117721.587031:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593163776 00000100:00100000:3.0:1789117721.587035:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593163776 00000100:00100000:3.0:1789117721.587079:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1789117721.587086:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593163776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117721.587206:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593163776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117721.587213:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1789117721.587242:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86818f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593163776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117721.587271:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86818f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593163904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117721.587308:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117721.587325:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86fe9840 going to sleep for 11 seconds 00000100:00100000:3.0:1789117721.587336:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593163904 00000100:00100000:3.0:1789117721.587340:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593163904 00000100:00100000:3.0:1789117721.587358:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1789117721.587364:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593163904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117721.587432:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593163904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117721.587438:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1789117721.587473:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86818f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593163904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117721.587633:0:14047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86818f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14047:1876025593164032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117721.587664:0:14047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117721.587681:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593164032 00000100:00100000:3.0:1789117721.587685:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593164032 00000100:00100000:3.0:1789117721.587704:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1789117721.587710:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+22:14047:x1876025593164032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117721.587773:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+22:14047:x1876025593164032:12345-0@lo:502:llog_process_th.0 Request processed in 62us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117721.587780:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1789117721.587811:0:14047:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86fe9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117721.587822:0:14047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86818f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14047:1876025593164032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789117721.587843:0:14047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117721.587853:0:14047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117721.587855:0:14047:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789117721.587863:0:14047:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962bbf4b3000 00000020:00000080:3.0:1789117721.587865:0:14047:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789117721.587948:0:14047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86818f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14047:1876025593164160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117721.587977:0:14047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117721.587994:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593164160 00000100:00100000:3.0:1789117721.587997:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593164160 00000100:00100000:3.0:1789117721.588015:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1789117721.588021:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+22:14047:x1876025593164160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117721.588129:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+22:14047:x1876025593164160:12345-0@lo:502:llog_process_th.0 Request processed in 107us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117721.588136:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1789117721.588175:0:14047:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86fe9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117721.588187:0:14047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86818f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14047:1876025593164160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789117721.588203:0:14047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117721.588207:0:14047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117721.588209:0:14047:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000040:00080000:3.0:1789117721.588213:0:14047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789117721.588270:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:3.0:1789117721.588286:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789117721.588295:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be1fb09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fb10 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117721.588305:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be1fb09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fb10 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117721.588321:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789117721.588324:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962bbcf27000 from 10 10000000:01000000:3.0:1789117721.588326:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789117721.588348:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d93600/0xaa253ed19be1fb17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117721.588357:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a87d93600/0xaa253ed19be1fb17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117721.588366:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a87d93600/0xaa253ed19be1fb17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117721.588378:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86818f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593164288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789117721.588404:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117721.588422:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86fe9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117721.588433:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593164288 00000100:00100000:3.0:1789117721.588435:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593164288 00000100:00100000:3.0:1789117721.588454:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1789117721.588461:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593164288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117721.588470:0:9525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117721.588483:0:9525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d92200/0xaa253ed19be1fb1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1fb17 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117721.588504:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d92200/0xaa253ed19be1fb1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1fb17 expref: 23 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117721.588513:0:9525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d92200/0xaa253ed19be1fb1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fb17 expref: 23 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117721.588532:0:9525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92200, rc 0) 00000100:00100000:3.0:1789117721.588561:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593164288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117721.588569:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1789117721.588600:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86818f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593164288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117721.588611:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a87d93600/0xaa253ed19be1fb17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fb1e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117721.588619:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a87d93600/0xaa253ed19be1fb17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1fb1e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117721.588662:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86818f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593164416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117721.588685:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117721.588697:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86fe9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117721.588707:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593164416 00000100:00100000:3.0:1789117721.588710:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593164416 00000100:00100000:3.0:1789117721.588730:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1789117721.588736:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593164416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117721.588832:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593164416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117721.588839:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1789117721.588865:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86818f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593164416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117721.588888:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86818f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593164544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117721.588923:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117721.588943:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86fe9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117721.588954:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593164544 00000100:00100000:3.0:1789117721.588957:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593164544 00000100:00100000:3.0:1789117721.588978:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1789117721.588983:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593164544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117721.589088:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593164544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117721.589105:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1789117721.589141:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86818f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593164544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117721.601946:0:14048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884e52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14048:1876025593164672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117721.602073:0:14048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117721.602136:0:14048:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d2e480 going to sleep for 11 seconds 00000100:00100000:3.0:1789117721.604121:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593164672 00000100:00100000:3.0:1789117721.604144:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593164672 00000100:00100000:3.0:1789117721.604238:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1789117721.604250:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+23:14048:x1876025593164672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117721.604448:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+23:14048:x1876025593164672:12345-0@lo:502:llog_process_th.0 Request processed in 201us (2376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117721.604456:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1789117721.604471:0:14048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884e52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14048:1876025593164672:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789117721.604504:0:14048:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789117721.604514:0:14048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117721.604516:0:14048:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789117721.604523:0:14048:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962bbcf27000 00000020:00000080:1.0:1789117721.604526:0:14048:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789117721.604706:0:14048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884e52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14048:1876025593164800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117721.604754:0:14048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117721.604790:0:14048:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d2e480 going to sleep for 11 seconds 00000100:00100000:1.0:1789117721.605891:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593164800 00000100:00100000:1.0:1789117721.605905:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593164800 00000100:00100000:1.0:1789117721.605968:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1789117721.605978:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+23:14048:x1876025593164800:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117721.606179:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+23:14048:x1876025593164800:12345-0@lo:502:llog_process_th.0 Request processed in 202us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117721.606187:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1789117721.606253:0:14048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884e52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14048:1876025593164800:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789117721.606288:0:14048:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117721.606296:0:14048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117721.606298:0:14048:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000040:00080000:1.0:1789117721.606303:0:14048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789117721.611372:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:3.0:1789117721.611436:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789117721.611454:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d93600/0xaa253ed19be1fb17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fb1e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117721.611468:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a87d93600/0xaa253ed19be1fb17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fb1e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117721.611480:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789117721.611483:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962b9832f800 from 10 10000000:01000000:3.0:1789117721.611486:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789117721.611530:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d92c00/0xaa253ed19be1fb25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117721.611548:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a87d92c00/0xaa253ed19be1fb25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117721.611562:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a87d92c00/0xaa253ed19be1fb25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117721.611592:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86818f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593164928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789117721.611672:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117721.611718:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86fe9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117721.612739:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593164928 00000100:00100000:1.0:1789117721.612750:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593164928 00000100:00100000:1.0:1789117721.612816:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1789117721.612826:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593164928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117721.612843:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117721.612861:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbf70de00/0xaa253ed19be1fb2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1fb25 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117721.612890:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbf70de00/0xaa253ed19be1fb2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1fb25 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117721.612903:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbf70de00/0xaa253ed19be1fb2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fb25 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117721.612913:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70de00, rc 0) 00000100:00100000:1.0:1789117721.612985:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593164928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117721.612992:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1789117721.613033:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86818f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593164928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117721.613077:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a87d92c00/0xaa253ed19be1fb25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fb2c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117721.613088:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a87d92c00/0xaa253ed19be1fb25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1fb2c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117721.613172:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86818f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593165056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117721.613203:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117721.613236:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86fe9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117721.613257:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593165056 00000100:00100000:1.0:1789117721.613261:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593165056 00000100:00100000:1.0:1789117721.613293:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1789117721.613301:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593165056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117721.613426:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593165056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117721.613433:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1789117721.613448:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86818f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593165056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117721.613480:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86818f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593165184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117721.613529:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117721.613550:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86fe9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789117721.613586:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593165184 00000100:00100000:0.0:1789117721.613590:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593165184 00000100:00100000:0.0:1789117721.613623:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1789117721.613631:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593165184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117721.613714:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593165184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117721.613721:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1789117721.613789:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86818f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593165184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117721.614670:0:14050:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884e52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14050:1876025593165312:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117721.614738:0:14050:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117721.614776:0:14050:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b829990c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117721.615412:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593165312 00000100:00100000:0.0:1789117721.615422:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593165312 00000100:00100000:0.0:1789117721.615477:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1789117721.615487:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:14050:x1876025593165312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117721.615619:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:14050:x1876025593165312:12345-0@lo:502:llog_process_th.0 Request processed in 133us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117721.615627:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:1.0:1789117721.615690:0:14050:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884e52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14050:1876025593165312:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789117721.615740:0:14050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789117721.615752:0:14050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117721.615754:0:14050:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789117721.615763:0:14050:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962b9832f800 00000020:00000080:1.0:1789117721.615765:0:14050:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789117721.615876:0:14050:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884e52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14050:1876025593165440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117721.615916:0:14050:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117721.615947:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593165440 00000100:00100000:1.0:1789117721.615951:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593165440 00000100:00100000:1.0:1789117721.615974:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:1.0:1789117721.615980:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:14050:x1876025593165440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117721.616042:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+24:14050:x1876025593165440:12345-0@lo:502:llog_process_th.0 Request processed in 60us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117721.616049:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:1.0:1789117721.616109:0:14050:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf751300 going to sleep for 11 seconds 00000100:00100000:1.0:1789117721.616120:0:14050:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884e52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14050:1876025593165440:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789117721.616135:0:14050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117721.616139:0:14050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117721.616141:0:14050:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000040:00080000:1.0:1789117721.616145:0:14050:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789117721.619330:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:3.0:1789117721.619403:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789117721.619416:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d92c00/0xaa253ed19be1fb25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fb2c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117721.619430:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a87d92c00/0xaa253ed19be1fb25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fb2c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117722.473750:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117722.473783:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a886261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593165568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789117722.473872:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117722.474038:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593165568 00000100:00100000:3.0:1789117722.474047:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593165568 00000100:00100000:3.0:1789117722.474147:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789117722.474158:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593165568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789117722.474200:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789117722.474249:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593165568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117722.474256:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789117722.474399:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a886261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593165568:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789117722.598537:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117723.621470:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117724.517979:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789117724.518011:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593165696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117724.518140:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117724.518225:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593165824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789117724.518253:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117724.518304:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593165696 00000100:00100000:1.0:1789117724.518315:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593165696 00000100:00100000:1.0:1789117724.518373:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593165824 00000100:00100000:1.0:1789117724.518377:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593165824 00000100:00100000:1.0:1789117724.518398:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789117724.518407:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593165696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789117724.518444:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117724.518445:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789117724.518456:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86808f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593165824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789117724.518468:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117724.518504:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86808f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593165824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117724.518526:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789117724.518971:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593165696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 562us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117724.518978:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:1.0:1789117724.518998:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789117724.519035:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbfd17c00 x1876025593165824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117740 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117724.519089:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593165824:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789117724.519102:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87dbcb40 x1876025593165696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117740 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117724.519114:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593165696:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789117724.645668:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117725.030114:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88625a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593166208:0@lo:400:kworker.0 00000100:00100000:0.0:1789117725.030203:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117725.030290:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593166720:0@lo:400:kworker.0 00000100:00100000:0.0:1789117725.030321:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117725.030343:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a886243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593167232:0@lo:400:kworker.0 00000100:00100000:0.0:1789117725.030368:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117725.030396:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789117725.030403:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88626d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593166336:0@lo:400:kworker.0 00000100:00100000:0.0:1789117725.030427:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117725.030441:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593166848:0@lo:400:kworker.0 00000100:00100000:0.0:1789117725.030466:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117725.030482:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88626940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593167360:0@lo:400:kworker.0 00000100:00100000:0.0:1789117725.030502:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117725.030799:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88625680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593166080:0@lo:400:kworker.0 00000100:00100000:2.0:1789117725.030836:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117725.030856:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593166592:0@lo:400:kworker.0 00000100:00100000:2.0:1789117725.030880:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117725.030897:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876025593167104:0@lo:400:kworker.0 00000100:00100000:2.0:1789117725.030919:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117725.030930:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593167616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117725.030951:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117725.030973:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1789117725.030979:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88624780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593165952:0@lo:400:kworker.0 00000100:00100000:2.0:1789117725.031006:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117725.031025:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a886261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593166464:0@lo:400:kworker.0 00000100:00100000:2.0:1789117725.031080:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117725.031093:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593166976:0@lo:400:kworker.0 00000100:00100000:2.0:1789117725.031125:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593166720 00000100:00100000:2.0:1789117725.031134:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593166720 00000100:00100000:2.0:1789117725.031180:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593167232 00000100:00100000:2.0:1789117725.031183:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593167232 00000100:00100000:2.0:1789117725.031198:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593166336 00000100:00100000:2.0:1789117725.031200:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593166336 00000100:00100000:2.0:1789117725.031211:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593166080 00000100:00100000:2.0:1789117725.031214:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593166080 00000100:00100000:2.0:1789117725.031223:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593166592 00000100:00100000:2.0:1789117725.031225:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593166592 00000100:00100000:2.0:1789117725.031234:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593167104 00000100:00100000:2.0:1789117725.031244:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593167104 00000100:00100000:2.0:1789117725.031264:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789117725.031272:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88625e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593166720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117725.031328:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88625e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593166720:12345-0@lo:400:kworker.0 Request processed in 56us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117725.031335:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789117725.031355:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789117725.031360:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593167232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117725.031388:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593167232:12345-0@lo:400:kworker.0 Request processed in 28us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117725.031394:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789117725.031404:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789117725.031410:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593166336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117725.031439:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593166336:12345-0@lo:400:kworker.0 Request processed in 28us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117725.031444:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789117725.031454:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789117725.031459:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593166080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117725.031488:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593166080:12345-0@lo:400:kworker.0 Request processed in 29us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117725.031494:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789117725.031505:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789117725.031518:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593166592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117725.031544:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593166592:12345-0@lo:400:kworker.0 Request processed in 28us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117725.031557:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789117725.031570:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789117725.031575:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876025593167104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117725.031602:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876025593167104:12345-0@lo:400:kworker.0 Request processed in 28us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117725.031607:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789117725.031626:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593166848 00000100:00100000:2.0:1789117725.031629:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593166848 00000100:00100000:2.0:1789117725.031656:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593167360 00000100:00100000:2.0:1789117725.031659:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593167360 00000100:00100000:2.0:1789117725.031675:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789117725.031680:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593166848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117725.031711:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593166848:12345-0@lo:400:kworker.0 Request processed in 31us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117725.031717:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789117725.031728:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789117725.031734:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593167360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117725.031762:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593167360:12345-0@lo:400:kworker.0 Request processed in 29us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117725.031768:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789117725.031790:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593166208 00000100:00100000:2.0:1789117725.031793:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593166208 00000100:00100000:2.0:1789117725.031809:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593167616 00000100:00100000:2.0:1789117725.031811:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593167616 00000100:00100000:2.0:1789117725.031819:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593166464 00000100:00100000:2.0:1789117725.031821:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593166464 00000100:00100000:2.0:1789117725.031832:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789117725.031844:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88624f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1876025593166208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117725.031876:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88624f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1876025593166208:12345-0@lo:400:kworker.0 Request processed in 32us (1673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117725.031882:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789117725.031894:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789117725.031900:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593167616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789117725.031923:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789117725.031953:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593167616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117725.031958:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789117725.031969:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789117725.031975:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593166464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117725.031999:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593166464:12345-0@lo:400:kworker.0 Request processed in 25us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117725.032005:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789117725.034269:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593165952 00000100:00100000:1.0:1789117725.034283:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593165952 00000100:00100000:1.0:1789117725.034336:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:1.0:1789117725.034346:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3647:x1876025593165952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117725.034446:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3647:x1876025593165952:12345-0@lo:400:kworker.0 Request processed in 102us (3438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117725.034453:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00080000:1.0:1789117725.034494:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789117725.034499:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789117725.034502:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789117725.034891:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88626940 x1876025593167360/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117725.034905:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88626940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593167360:0@lo:400:kworker.0 00000100:00100000:0.0:1789117725.034919:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88625a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593166208:0@lo:400:kworker.0 00010000:00080000:0.0:1789117725.034932:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88624000 x1876025593166720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117725.034941:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593166720:0@lo:400:kworker.0 00010000:00080000:0.0:1789117725.034953:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a886243c0 x1876025593167232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117725.034960:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a886243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593167232:0@lo:400:kworker.0 00000100:00100000:0.0:1789117725.034988:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88626d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593166336:0@lo:400:kworker.0 00010000:00080000:0.0:1789117725.034998:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88624b40 x1876025593166848/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117725.035014:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593166848:0@lo:400:kworker.0 00000100:00100000:1.0:1789117725.035544:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117725.035588:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88626580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593167488:0@lo:400:kworker.0 00000100:00100000:1.0:1789117725.035631:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117725.035660:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88625680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593166080:0@lo:400:kworker.0 00000100:00100000:1.0:1789117725.035673:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593166592:0@lo:400:kworker.0 00000100:00100000:1.0:1789117725.035684:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876025593167104:0@lo:400:kworker.0 00000100:00100000:1.0:1789117725.035703:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593167616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117725.036111:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88624780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593165952:0@lo:400:kworker.0 00000100:00100000:1.0:1789117725.036124:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a886261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593166464:0@lo:400:kworker.0 00000100:00100000:1.0:1789117725.036147:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593166976 00000100:00100000:1.0:1789117725.036151:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593166976 00000100:00100000:1.0:1789117725.036187:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593167488 00000100:00100000:1.0:1789117725.036190:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593167488 00000100:00100000:1.0:1789117725.036219:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789117725.036227:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593166976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117725.036282:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593166976:12345-0@lo:400:kworker.0 Request processed in 56us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117725.036289:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789117725.036312:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789117725.036318:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593167488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117725.036347:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593167488:12345-0@lo:400:kworker.0 Request processed in 29us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117725.036353:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1789117725.036368:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789117725.036393:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88627840 x1876025593166976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117725.036404:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593166976:0@lo:400:kworker.0 00010000:00080000:1.0:1789117725.036414:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88626580 x1876025593167488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117725.036422:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88626580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593167488:0@lo:400:kworker.0 00000100:00100000:1.0:1789117725.541389:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88626580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593167744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789117725.541580:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117725.542203:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789117725.542216:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593167872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117725.542273:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117725.546704:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593167744 00000100:00100000:0.0:1789117725.546720:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593167744 00000100:00100000:0.0:1789117725.547135:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593167872 00000100:00100000:0.0:1789117725.547142:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593167872 00000100:00100000:3.0:1789117725.547234:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789117725.547257:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593167744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789117725.547303:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117725.547403:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593167744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 156us (5823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117725.547411:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789117725.547429:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789117725.547446:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593167872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789117725.547457:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117725.547482:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593167872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (5210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117725.547487:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:2.0:1789117725.547709:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b98a6e940 x1876025593167872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117725.547746:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593167872:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789117725.547763:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88626580 x1876025593167744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117725.547777:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88626580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593167744:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789117725.669725:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117726.565806:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117726.565835:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117726.565865:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117726.565905:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117726.565931:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117726.565954:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572092544 00000100:00100000:2.0:1789117726.565963:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572092544 00000100:00100000:2.0:1789117726.566028:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572092800 00000100:00100000:2.0:1789117726.566032:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572092800 00000100:00100000:2.0:1789117726.566046:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572092672 00000100:00100000:2.0:1789117726.566048:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572092672 00000100:00100000:2.0:1789117726.566086:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572092928 00000100:00100000:2.0:1789117726.566089:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572092928 00000100:00100000:2.0:1789117726.566106:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 275 00000100:00100000:2.0:1789117726.566116:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572092544:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117726.566211:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572092544:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 95us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117726.566220:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 275 00000100:00100000:2.0:1789117726.566239:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 276 00000100:00100000:2.0:1789117726.566245:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+5:2406:x1876025572092800:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117726.566272:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+5:2406:x1876025572092800:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 28us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117726.566278:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 276 00000100:00100000:2.0:1789117726.566290:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 277 00000100:00100000:2.0:1789117726.566295:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572092672:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117726.566317:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572092672:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 22us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117726.566322:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 277 00000100:00100000:2.0:1789117726.566332:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 278 00000100:00100000:2.0:1789117726.566345:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf81e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+5:2406:x1876025572092928:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117726.566373:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf81e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+5:2406:x1876025572092928:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 29us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117726.566378:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 278 00000100:00080000:2.0:1789117726.566406:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789117726.566410:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117726.566437:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572092416 00000100:00100000:2.0:1789117726.566441:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572092416 00000100:00100000:2.0:1789117726.566465:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 409 00000100:00100000:2.0:1789117726.566472:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2406:x1876025572092416:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117726.566496:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2406:x1876025572092416:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 25us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117726.566502:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 409 00010000:00010000:0.0:1789117726.693322:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117727.589434:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789117727.589466:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593168000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789117727.589587:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117727.589879:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593168000 00000100:00100000:0.0:1789117727.589890:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593168000 00000100:00100000:0.0:1789117727.589956:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789117727.589987:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593168000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789117727.590034:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789117727.590143:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593168000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 178us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117727.590151:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789117727.590250:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593168000:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789117727.722253:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789117727.840551:0:14187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 05:08:46 (1789117726) === 00010000:00010000:1.0:1789117728.741630:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117729.642917:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593168128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117729.643011:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117729.643578:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593168128 00000100:00100000:0.0:1789117729.643585:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593168128 00000100:00100000:0.0:1789117729.643642:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789117729.643653:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593168128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789117729.643686:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117729.643741:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593168128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117729.643749:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789117729.643773:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88624780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593168256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789117729.643803:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789117729.643843:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789117729.643873:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf6ec3c0 x1876025593168128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117745 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117729.643900:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593168128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117729.643924:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593168256 00000100:00100000:0.0:1789117729.643928:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593168256 00000100:00100000:0.0:1789117729.644112:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789117729.644119:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593168256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789117729.644131:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117729.644165:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593168256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117729.644172:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1789117729.644186:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789117729.644206:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88624780 x1876025593168256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117745 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117729.644218:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88624780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593168256:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789117729.766364:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117730.008809:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117730.008870:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117730.008962:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572093056 00000100:00100000:2.0:1789117730.008973:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572093056 00000100:00100000:1.0:1789117730.009138:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572093184 00000100:00100000:1.0:1789117730.009143:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572093184 00000100:00100000:1.0:1789117730.009245:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:1.0:1789117730.009256:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86819e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:10764:x1876025572093184:12345-192.168.204.30@tcp:700:mkdir.0 00000100:00100000:1.0:1789117730.009354:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86819e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:10764:x1876025572093184:12345-192.168.204.30@tcp:700:mkdir.0 Request processed in 99us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117730.009568:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:2.0:1789117730.009578:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a868183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2405:x1876025572093056:12345-192.168.204.30@tcp:41:mkdir.0 00000004:00000024:2.0:1789117730.009615:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789117730.009683:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a868183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2405:x1876025572093056:12345-192.168.204.30@tcp:41:mkdir.0 Request processed in 108us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117730.009700:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:1.0:1789117730.011539:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:1.0:1789117730.016488:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117730.016573:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572093440 00000100:00100000:2.0:1789117730.016585:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572093440 00000100:00100000:2.0:1789117730.016679:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:2.0:1789117730.016693:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:10764:x1876025572093440:12345-192.168.204.30@tcp:36:mkdir.0 00010000:00010000:2.0:1789117730.016775:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117730.016836:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1f93b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed2a expref: 6 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.016861:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b95c57f00) 00010000:00010000:2.0:1789117730.016876:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117730.016999:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68a00/0xaa253ed19be1fb33 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.017014:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68a00/0xaa253ed19be1fb33 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.017025:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68a00/0xaa253ed19be1fb33 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.017086:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fb3a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.017095:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fb3a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.017102:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fb3a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.017710:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fb41 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.017730:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fb41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.017741:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fb41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789117730.017761:0:6521:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ed751f9e reply state 0000000076adf86a transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fb41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.017774:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fb41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.017780:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff962b900db300) 00010000:00010000:2.0:1789117730.017784:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789117730.017787:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789117730.017794:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789117730.017804:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68a00/0xaa253ed19be1fb33 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.017810:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68a00/0xaa253ed19be1fb33 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.017818:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68a00/0xaa253ed19be1fb33 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.017825:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b68a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117730.017830:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68a00/0xaa253ed19be1fb33 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.017839:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68a00/0xaa253ed19be1fb33 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.017859:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b900db800) 00010000:00010000:2.0:1789117730.017862:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117730.017866:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68a00/0xaa253ed19be1fb33 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.017872:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68a00/0xaa253ed19be1fb33 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789117730.017886:0:6521:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ed751f9e reply state 0000000076adf86a transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fb3a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.017894:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fb3a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.017899:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff962b900dbf00) 00010000:00010000:2.0:1789117730.017901:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789117730.017903:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789117730.018024:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:10764:x1876025572093440:12345-192.168.204.30@tcp:36:mkdir.0 Request processed in 1332us (1545us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789117730.018033:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00080000:0.0:1789117730.018509:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117730.054978:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117730.055135:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572093568 00000100:00100000:1.0:1789117730.055149:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572093568 00000100:00100000:1.0:1789117730.055210:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:1.0:1789117730.055220:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:10765:x1876025572093568:12345-192.168.204.30@tcp:101:chmod.0 00010000:00010000:1.0:1789117730.055242:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117730.055268:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be1fb48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0edd9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.055337:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be1fb4f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.055353:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be1fb4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.055367:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be1fb4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117730.055446:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789117730.055451:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789117730.055488:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be1fb4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.055518:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be1fb48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edd9 expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.055550:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be1fb4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edd9 expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.055579:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b95e52500) 00010000:00010000:1.0:1789117730.055582:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789117730.055586:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70d000, rc 0) 00000100:00100000:1.0:1789117730.055667:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:10765:x1876025572093568:12345-192.168.204.30@tcp:101:chmod.0 Request processed in 447us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117730.055675:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:2.0:1789117730.072575:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117730.072674:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572093824 00000100:00100000:1.0:1789117730.072684:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572093824 00000100:00100000:1.0:1789117730.072809:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:1.0:1789117730.072820:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:10765:x1876025572093824:12345-192.168.204.30@tcp:36:chmod.0 00010000:00010000:1.0:1789117730.072878:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117730.072908:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be1fb4f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edd9 expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.072928:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b95e52500) 00010000:00010000:1.0:1789117730.072951:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789117730.072973:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be1fb56 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.072987:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be1fb56 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.072997:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be1fb56 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789117730.073263:0:6521:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f486c218 reply state 00000000de312f27 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be1fb56 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.073289:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be1fb56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.073296:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b95e52c00) 00010000:00010000:1.0:1789117730.073299:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789117730.073302:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789117730.073309:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789117730.073411:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:10765:x1876025572093824:12345-192.168.204.30@tcp:36:chmod.0 Request processed in 592us (849us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789117730.073419:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:3.0:1789117730.115909:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117730.116821:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572093952 00000100:00100000:1.0:1789117730.116834:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572093952 00000100:00100000:1.0:1789117730.116905:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:1.0:1789117730.116917:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:10766:x1876025572093952:12345-192.168.204.30@tcp:101:chown.0 00010000:00010000:1.0:1789117730.116959:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117730.116990:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be1fb5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ede0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.117114:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d400/0xaa253ed19be1fb64 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.117131:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d400/0xaa253ed19be1fb64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.117144:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d400/0xaa253ed19be1fb64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117730.117194:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789117730.117198:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789117730.117259:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d400/0xaa253ed19be1fb64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.117288:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be1fb5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ede0 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.117309:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d400/0xaa253ed19be1fb64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ede0 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.117317:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b95e52c00) 00010000:00010000:1.0:1789117730.117319:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789117730.117323:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70d400, rc 0) 00000100:00100000:1.0:1789117730.118762:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+10:10766:x1876025572093952:12345-192.168.204.30@tcp:101:chown.0 Request processed in 1835us (2851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117730.118775:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:3.0:1789117730.121515:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117730.121759:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572094080 00000100:00100000:0.0:1789117730.121772:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572094080 00000100:00100000:0.0:1789117730.121844:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00100000:0.0:1789117730.121855:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a868192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+10:10766:x1876025572094080:12345-192.168.204.30@tcp:101:chown.0 00010000:00010000:0.0:1789117730.121880:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117730.121908:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fb6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ede7 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122011:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fb72 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122093:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fb72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122111:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fb72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122125:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fb79 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122133:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fb79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122140:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fb79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122262:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fb80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122271:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fb80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122278:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fb80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117730.122343:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789117730.122348:0:9533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789117730.122375:0:9533:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fb80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122570:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fb72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122589:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fb72 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122596:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fb72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122602:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117730.122606:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fb72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122614:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fb72 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122628:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b95e52c00) 00010000:00010000:0.0:1789117730.122631:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117730.122636:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fb72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122643:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fb72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122659:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fb79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122665:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fb79 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122671:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fb79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122677:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dba00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117730.122685:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fb79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122693:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fb79 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122701:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff962b900dbf00) 00010000:00010000:0.0:1789117730.122703:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117730.122707:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fb79 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122713:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fb79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122746:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fb6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ede7 expref: 12 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122760:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fb80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ede7 expref: 11 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.122768:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff962b900db300) 00010000:00010000:0.0:1789117730.122771:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789117730.122773:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813dbe00, rc 0) 00000100:00100000:0.0:1789117730.122855:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a868192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+11:10766:x1876025572094080:12345-192.168.204.30@tcp:101:chown.0 Request processed in 1001us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117730.122864:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00100000:2.0:1789117730.129817:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117730.130096:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572094208 00000100:00100000:1.0:1789117730.130108:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572094208 00000100:00100000:1.0:1789117730.130263:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:1.0:1789117730.130276:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+11:10766:x1876025572094208:12345-192.168.204.30@tcp:900:chown.0 00000100:00100000:1.0:1789117730.130557:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+11:10766:x1876025572094208:12345-192.168.204.30@tcp:900:chown.0 Request processed in 282us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117730.130567:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:3.0:1789117730.147367:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117730.147600:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572094464 00000100:00100000:2.0:1789117730.147610:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572094464 00000100:00100000:2.0:1789117730.147694:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00100000:2.0:1789117730.147704:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86818780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+11:10766:x1876025572094464:12345-192.168.204.30@tcp:36:chown.0 00010000:00010000:2.0:1789117730.147778:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117730.147833:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fb80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ede7 expref: 11 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.147859:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff962b900db300) 00010000:00010000:2.0:1789117730.147865:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117730.147898:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fb87 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.147915:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fb87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.147926:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fb87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117730.150439:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593168384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117730.150525:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117730.150628:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593168384 00000100:00100000:2.0:1789117730.150637:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593168384 00000100:00100000:2.0:1789117730.150712:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789117730.150723:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593168384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789117730.150761:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789117730.150814:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593168384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117730.150822:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789117730.150877:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593168384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117730.151895:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593168768:0@lo:400:kworker.0 00000100:00100000:2.0:1789117730.151960:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117730.151998:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593169280:0@lo:400:kworker.0 00000100:00100000:2.0:1789117730.152044:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117730.152086:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593169792:0@lo:400:kworker.0 00000100:00100000:2.0:1789117730.152110:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117730.152141:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789117730.152147:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593168896:0@lo:400:kworker.0 00000100:00100000:2.0:1789117730.152169:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117730.152184:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593169408:0@lo:400:kworker.0 00000100:00100000:2.0:1789117730.152205:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117730.152218:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593169920:0@lo:400:kworker.0 00000100:00100000:1.0:1789117730.152336:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593168640:0@lo:400:kworker.0 00000100:00100000:1.0:1789117730.152365:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117730.152385:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876025593169152:0@lo:400:kworker.0 00000100:00100000:1.0:1789117730.152429:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117730.152450:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876025593169664:0@lo:400:kworker.0 00000100:00100000:1.0:1789117730.152483:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117730.152497:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789117730.152502:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593168512:0@lo:400:kworker.0 00000100:00100000:1.0:1789117730.152529:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117730.152564:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593169024:0@lo:400:kworker.0 00000100:00100000:1.0:1789117730.152586:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117730.152597:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876025593169536:0@lo:400:kworker.0 00000100:00100000:1.0:1789117730.152617:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117730.152645:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593169280 00000100:00100000:1.0:1789117730.152652:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593169280 00000100:00100000:1.0:1789117730.152696:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593169792 00000100:00100000:1.0:1789117730.152699:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593169792 00000100:00100000:1.0:1789117730.152724:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593169408 00000100:00100000:1.0:1789117730.152726:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593169408 00000100:00100000:1.0:1789117730.152743:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789117730.152752:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593169280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117730.152804:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593169280:12345-0@lo:400:kworker.0 Request processed in 52us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117730.152812:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789117730.152829:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789117730.152835:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593169792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117730.152863:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593169792:12345-0@lo:400:kworker.0 Request processed in 28us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117730.152869:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789117730.152881:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789117730.152887:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593169408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117730.152926:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593169408:12345-0@lo:400:kworker.0 Request processed in 39us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117730.152944:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789117730.152971:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593168512 00000100:00100000:1.0:1789117730.152975:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593168512 00000100:00100000:1.0:1789117730.152999:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1789117730.153005:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3647:x1876025593168512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117730.153039:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3647:x1876025593168512:12345-0@lo:400:kworker.0 Request processed in 34us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117730.153045:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1789117730.153125:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593168512:0@lo:400:kworker.0 00000100:00100000:1.0:1789117730.153156:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593168768 00000100:00100000:1.0:1789117730.153159:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593168768 00000100:00100000:1.0:1789117730.153181:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593168640 00000100:00100000:1.0:1789117730.153183:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593168640 00000100:00100000:1.0:1789117730.153195:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593169152 00000100:00100000:1.0:1789117730.153197:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593169152 00000100:00100000:1.0:1789117730.153210:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593169664 00000100:00100000:1.0:1789117730.153211:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593169664 00000100:00100000:1.0:1789117730.153223:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593169024 00000100:00100000:1.0:1789117730.153225:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593169024 00000100:00100000:1.0:1789117730.153236:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593169536 00000100:00100000:1.0:1789117730.153860:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593169536 00000100:00100000:1.0:1789117730.153900:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789117730.153908:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593168768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117730.153977:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593168768:12345-0@lo:400:kworker.0 Request processed in 70us (2017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117730.153984:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789117730.154010:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1789117730.154016:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593168640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117730.154086:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593168640:12345-0@lo:400:kworker.0 Request processed in 70us (1720us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117730.154092:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1789117730.154105:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789117730.154207:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117730.154338:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593168768:0@lo:400:kworker.0 00010000:00080000:2.0:1789117730.154354:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbfa86580 x1876025593169280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117730.154366:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593169280:0@lo:400:kworker.0 00010000:00080000:2.0:1789117730.154377:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f71680 x1876025593169792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117730.154385:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593169792:0@lo:400:kworker.0 00010000:00080000:2.0:1789117730.154612:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87d80780 x1876025593169408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117730.154621:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593169408:0@lo:400:kworker.0 00000100:00100000:2.0:1789117730.154654:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593168896 00000100:00100000:2.0:1789117730.154659:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593168896 00000100:00100000:2.0:1789117730.154690:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789117730.154697:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593168896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117730.154753:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593168896:12345-0@lo:400:kworker.0 Request processed in 56us (2582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117730.154760:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789117730.154788:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593169920 00000100:00100000:2.0:1789117730.154791:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593169920 00000100:00100000:2.0:1789117730.154819:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789117730.154826:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593169920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117730.154857:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593169920:12345-0@lo:400:kworker.0 Request processed in 32us (2618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117730.154863:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789117730.154892:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593168896:0@lo:400:kworker.0 00010000:00080000:2.0:1789117730.154903:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f72d00 x1876025593169920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117730.154911:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593169920:0@lo:400:kworker.0 00000100:00080000:2.0:1789117730.154942:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789117730.154947:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789117730.154950:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789117730.155256:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789117730.155267:0:6521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1789117730.155312:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593168640:0@lo:400:kworker.0 00000100:00100000:1.0:1789117730.155917:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876025593169152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117730.156008:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876025593169152:12345-0@lo:400:kworker.0 Request processed in 1897us (3578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117730.156017:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789117730.156044:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1789117730.156065:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876025593169664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117730.156096:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876025593169664:12345-0@lo:400:kworker.0 Request processed in 46us (3612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117730.156101:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1789117730.156271:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789117730.156283:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593169024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117730.156321:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593169024:12345-0@lo:400:kworker.0 Request processed in 42us (3733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117730.156342:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789117730.156358:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789117730.156365:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876025593169536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117730.156765:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876025593169536:12345-0@lo:400:kworker.0 Request processed in 400us (4146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117730.156772:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1789117730.156993:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593169024:0@lo:400:kworker.0 00000100:00100000:3.0:1789117730.157007:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876025593169536:0@lo:400:kworker.0 00010000:00080000:3.0:1789117730.157023:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbfa87840 x1876025593169152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117730.157034:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876025593169152:0@lo:400:kworker.0 00010000:00080000:3.0:1789117730.157047:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f70780 x1876025593169664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117730.157087:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876025593169664:0@lo:400:kworker.0 00000001:00080000:3.0:1789117730.164771:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:2.0:1789117730.164876:0:6519:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003a35c8b2 reply state 00000000767ab41f transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fb87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.164897:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fb87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.164905:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff962b900db300) 00010000:00010000:2.0:1789117730.164908:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789117730.164912:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789117730.164924:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1789117730.165078:0:6519:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789117730.165098:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86818780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:10766:x1876025572094464:12345-192.168.204.30@tcp:36:chown.0 Request processed in 17391us (17741us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789117730.165107:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 28 00010000:00010000:0.0:1789117730.165462:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fb87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.165472:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fb87 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.165479:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fb87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.165486:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117730.165491:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fb87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.165498:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fb87 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.165509:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff962b900db300) 00010000:00010000:0.0:1789117730.165512:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789117730.165516:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fb87 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.165522:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fb87 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.166471:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fb3a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.166483:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fb3a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.166489:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fb3a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.166494:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b68c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117730.166496:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fb3a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.166514:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fb3a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.166525:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff962b900dbf00) 00010000:00010000:1.0:1789117730.166527:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117730.166530:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fb3a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.166536:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fb3a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.166555:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fb41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.166561:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fb41 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.166567:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fb41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.166573:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117730.166576:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fb41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.166582:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fb41 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.166589:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff962b900db300) 00010000:00010000:1.0:1789117730.166591:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117730.166594:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fb41 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.166608:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fb41 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.166624:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be1fb56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.166630:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be1fb56 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.166636:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be1fb56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.166640:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117730.166643:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be1fb56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.166650:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be1fb56 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.166659:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b95e52c00) 00010000:00010000:1.0:1789117730.166661:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789117730.166665:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be1fb56 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.166670:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be1fb56 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117730.195742:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117730.195876:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572094592 00000100:00100000:0.0:1789117730.195887:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572094592 00000100:00100000:0.0:1789117730.195970:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00100000:0.0:1789117730.195982:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86818f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:10767:x1876025572094592:12345-192.168.204.30@tcp:101:touch.500 00010000:00010000:0.0:1789117730.196011:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117730.196034:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fb8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0edee expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789117730.207319:0:9533:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 11183us 00010000:00010000:0.0:1789117730.225303:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fb95 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.225338:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fb95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.225355:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fb95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.225376:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fb9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.225383:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fb9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.225400:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fb9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.225587:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be1fba3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.225596:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be1fba3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.225626:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be1fba3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117730.225674:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789117730.225679:0:9533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789117730.225736:0:9533:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be1fba3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.225752:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fb95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.225759:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fb95 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.225766:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fb95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.225773:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dba00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117730.225778:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fb95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.226735:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fb95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.226751:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b95e52c00) 00010000:00010000:0.0:1789117730.226754:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117730.226760:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fb95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.226767:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fb95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.226803:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fb9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.226809:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fb9c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.226815:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fb9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.226820:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117730.226823:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fb9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.226829:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fb9c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.226836:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff962b832ca000) 00010000:00010000:0.0:1789117730.226839:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117730.226842:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fb9c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.226847:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fb9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.226898:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fb8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edee expref: 8 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.226912:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be1fba3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edee expref: 7 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.227290:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff962b832ca200) 00010000:00010000:0.0:1789117730.227293:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789117730.227295:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813daa00, rc 0) 00000100:00100000:0.0:1789117730.227569:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86818f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:10767:x1876025572094592:12345-192.168.204.30@tcp:101:touch.500 Request processed in 31586us (31837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117730.227581:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00100000:2.0:1789117730.238348:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117730.238683:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572094848 00000100:00100000:3.0:1789117730.238698:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572094848 00000100:00100000:3.0:1789117730.238863:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:3.0:1789117730.238876:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:10767:x1876025572094848:12345-192.168.204.30@tcp:101:touch.500 00010000:00010000:3.0:1789117730.238920:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117730.238961:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92400/0xaa253ed19be1fbaa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0edf5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117730.239133:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be1fbb1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117730.239151:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be1fbb1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117730.239166:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be1fbb1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117730.239184:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be1fbb8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117730.239191:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be1fbb8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117730.239196:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be1fbb8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789117730.239958:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1789117730.240201:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be1fbbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117730.240212:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be1fbbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117730.240220:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be1fbbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117730.240271:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be1fbb1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117730.240280:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be1fbb1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117730.240287:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be1fbb1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117730.240293:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117730.240297:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be1fbb1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117730.240304:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be1fbb1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117730.240316:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff962b832ca200) 00010000:00010000:3.0:1789117730.240319:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117730.240323:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be1fbb1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117730.240330:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be1fbb1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789117730.240344:0:6521:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000068d3edc2 reply state 0000000057c24e5a transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be1fbb8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117730.240356:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be1fbb8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117730.240362:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff962bae4aed00) 00010000:00010000:3.0:1789117730.240370:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789117730.240373:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789117730.240419:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92400/0xaa253ed19be1fbaa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edf5 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117730.240435:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be1fbbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edf5 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117730.240443:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff962bae4ae300) 00010000:00010000:3.0:1789117730.240445:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789117730.240448:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92000, rc 0) 00000100:00100000:3.0:1789117730.240532:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+10:10767:x1876025572094848:12345-192.168.204.30@tcp:101:touch.500 Request processed in 1657us (2196us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789117730.240541:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:3.0:1789117730.249914:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117730.257600:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572095104 00000100:00100000:2.0:1789117730.257617:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572095104 00000100:00100000:2.0:1789117730.257700:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:2.0:1789117730.257710:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+10:10767:x1876025572095104:12345-192.168.204.30@tcp:36:touch.500 00010000:00010000:2.0:1789117730.257786:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117730.257822:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be1fbbf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edf5 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.257850:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff962bae4ae300) 00010000:00010000:2.0:1789117730.257862:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117730.257943:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fbcd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.257957:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fbcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.257969:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fbcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789117730.258129:0:6519:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b40ddcf5 reply state 0000000083a7fec0 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fbcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.258145:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fbcd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.258175:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff962a86dfc200) 00010000:00010000:2.0:1789117730.258177:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789117730.258180:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789117730.258343:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+11:10767:x1876025572095104:12345-192.168.204.30@tcp:36:touch.500 Request processed in 633us (8440us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789117730.258351:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:2.0:1789117730.265213:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117730.265299:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572095232 00000100:00100000:0.0:1789117730.265314:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572095232 00000100:00100000:0.0:1789117730.265406:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 32 00000100:00100000:0.0:1789117730.265432:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+11:10767:x1876025572095232:12345-192.168.204.30@tcp:101:touch.500 00010000:00010000:0.0:1789117730.265471:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117730.265504:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fbd4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0edfc expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.265585:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fbd4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edfc expref: 12 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.265604:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fbd4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edfc expref: 12 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.265626:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff962a86dfc200) 00010000:00010000:0.0:1789117730.265630:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789117730.265634:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813db200, rc 0) 00000100:00100000:0.0:1789117730.265709:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+12:10767:x1876025572095232:12345-192.168.204.30@tcp:101:touch.500 Request processed in 280us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117730.265734:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 32 00000100:00100000:0.0:1789117730.277319:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117730.277668:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572095360 00000100:00100000:1.0:1789117730.277684:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572095360 00000100:00100000:0.0:1789117730.277859:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:0.0:1789117730.277872:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a886261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2403:x1876025572095360:12345-192.168.204.30@tcp:8:touch.500 00010000:00080000:0.0:1789117730.277940:0:8434:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp t0 exp 0000000000000000 cur 382 last 0 00000020:00000080:0.0:1789117730.277976:0:8434:0:(genops.c:1385:class_connect()) connect: client 35e670b1-2cce-4394-8cb4-d5255c6a6a93, cookie 0xaa253ed19be1fbdb 00002000:00100000:0.0:1789117730.277989:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 35e670b1-2cce-4394-8cb4-d5255c6a6a93/ffff962a87fdb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789117730.278008:0:8434:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789117730.278305:0:8434:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789117730.278343:0:8434:0:(import.c:65:import_set_state_nolock()) ffff962a87fd9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789117730.278500:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a886261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2403:x1876025572095360:12345-192.168.204.30@tcp:8:touch.500 Request processed in 627us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117730.278509:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:3.0:1789117730.283356:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117730.283758:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572095488 00000100:00100000:2.0:1789117730.283771:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572095488 00000100:00100000:2.0:1789117730.283866:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:2.0:1789117730.283878:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:0:x1876025572095488:12345-192.168.204.30@tcp:2:touch.500 00000100:00080000:3.0:1789117730.284309:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1789117730.303981:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:1.0:1789117730.303999:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35e670b1-2cce-4394-8cb4-d5255c6a6a93 00000100:00100000:2.0:1789117730.304309:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:0:x1876025572095488:12345-192.168.204.30@tcp:2:touch.500 Request processed in 20428us (20960us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789117730.304322:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:1.0:1789117730.312021:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117730.312167:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572095744 00000100:00100000:3.0:1789117730.312177:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572095744 00000100:00100000:1.0:1789117730.312358:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:1.0:1789117730.312370:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+12:10767:x1876025572095744:12345-192.168.204.30@tcp:35:touch.500 00000100:00100000:1.0:1789117730.312828:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+13:10767:x1876025572095744:12345-192.168.204.30@tcp:35:touch.500 Request processed in 460us (822us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789117730.312837:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:0.0:1789117730.340530:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117730.340660:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572095872 00000100:00100000:3.0:1789117730.340675:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572095872 00000100:00100000:3.0:1789117730.340792:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:3.0:1789117730.340803:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88624780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+13:10768:x1876025572095872:12345-192.168.204.30@tcp:101:rm.0 00010000:00010000:3.0:1789117730.340827:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117730.340848:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92400/0xaa253ed19be1fbe2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ee03 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117730.340937:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be1fbe9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117730.340970:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be1fbe9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117730.340983:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be1fbe9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117730.341885:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789117730.341889:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789117730.341950:0:6521:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be1fbe9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117730.341992:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92400/0xaa253ed19be1fbe2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee03 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117730.342015:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be1fbe9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee03 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117730.342025:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff962b832ca200) 00010000:00010000:3.0:1789117730.342028:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789117730.342032:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93c00, rc 0) 00000100:00100000:3.0:1789117730.342147:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88624780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+14:10768:x1876025572095872:12345-192.168.204.30@tcp:101:rm.0 Request processed in 1344us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117730.342157:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:3.0:1789117730.346900:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117730.347105:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572096128 00000100:00100000:1.0:1789117730.347126:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572096128 00000100:00100000:1.0:1789117730.347208:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 34 00000100:00100000:1.0:1789117730.347220:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+14:10768:x1876025572096128:12345-192.168.204.30@tcp:101:rm.0 00010000:00010000:1.0:1789117730.347246:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117730.347283:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d600/0xaa253ed19be1fbf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ee0a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117730.347448:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789117730.347594:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d600/0xaa253ed19be1fbf0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee0a expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.347625:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b95e52c00) 00010000:00010000:1.0:1789117730.347628:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789117730.347633:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d600/0xaa253ed19be1fbf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee0a expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.347649:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70d600, rc 0) 00000100:00100000:1.0:1789117730.347722:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+15:10768:x1876025572096128:12345-192.168.204.30@tcp:101:rm.0 Request processed in 505us (837us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1789117730.347739:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 34 00000100:00100000:0.0:1789117730.355022:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117730.355297:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572096256 00000100:00100000:3.0:1789117730.355312:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572096256 00000100:00100000:3.0:1789117730.355384:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:3.0:1789117730.355395:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88627c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+15:10768:x1876025572096256:12345-192.168.204.30@tcp:37:rm.0 00000100:00100000:3.0:1789117730.360048:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88627c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+15:10768:x1876025572096256:12345-192.168.204.30@tcp:37:rm.0 Request processed in 4638us (5019us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117730.360103:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:0.0:1789117730.367691:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117730.367975:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572096512 00000100:00100000:2.0:1789117730.367988:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572096512 00000100:00100000:2.0:1789117730.368051:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:2.0:1789117730.368103:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb0809050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+15:10768:x1876025572096512:12345-192.168.204.30@tcp:35:rm.0 00000100:00100000:2.0:1789117730.368427:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb0809050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+16:10768:x1876025572096512:12345-192.168.204.30@tcp:35:rm.0 Request processed in 324us (747us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789117730.368435:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:0.0:1789117730.377654:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117730.378237:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572096768 00000100:00100000:2.0:1789117730.378249:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572096768 00000100:00100000:2.0:1789117730.378321:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 35 00000100:00100000:2.0:1789117730.378330:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88625680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+16:10768:x1876025572096768:12345-192.168.204.30@tcp:101:rm.0 00010000:00010000:2.0:1789117730.378655:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117730.378678:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fbfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ee11 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.378779:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69200/0xaa253ed19be1fc05 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.378795:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69200/0xaa253ed19be1fc05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.378807:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69200/0xaa253ed19be1fc05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117730.378819:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789117730.378979:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fbfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee11 expref: 19 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.379000:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69200/0xaa253ed19be1fc05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee11 expref: 18 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.379010:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff962b832ca200) 00010000:00010000:2.0:1789117730.379014:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789117730.379018:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69200, rc 0) 00000100:00100000:2.0:1789117730.380379:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88625680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+18:10768:x1876025572096768:12345-192.168.204.30@tcp:101:rm.0 Request processed in 2032us (2720us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789117730.380391:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 35 00000100:00100000:0.0:1789117730.391381:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117730.391603:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572096896 00000100:00100000:3.0:1789117730.391617:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572096896 00000100:00100000:3.0:1789117730.391691:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:3.0:1789117730.391702:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88624b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+18:10768:x1876025572096896:12345-192.168.204.30@tcp:41:rm.0 00000004:00000024:3.0:1789117730.391780:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1789117730.391871:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88624b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+18:10768:x1876025572096896:12345-192.168.204.30@tcp:41:rm.0 Request processed in 171us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117730.391878:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:0.0:1789117730.396634:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117730.397913:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572097024 00000100:00100000:1.0:1789117730.397937:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572097024 00000100:00100000:1.0:1789117730.398023:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00100000:1.0:1789117730.398035:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88626d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+18:10768:x1876025572097024:12345-192.168.204.30@tcp:101:rm.0 00010000:00010000:1.0:1789117730.398083:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117730.398105:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d600/0xaa253ed19be1fc13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ee18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398186:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be1fc1a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398202:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be1fc1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398213:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be1fc1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398226:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be1fc21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398233:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be1fc21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398240:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be1fc21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398338:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be1fc28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398365:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be1fc28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398373:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be1fc28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117730.398406:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789117730.398410:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789117730.398426:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be1fc28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398437:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be1fc28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398445:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be1fc1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398451:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be1fc1a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398457:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be1fc1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398463:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117730.398466:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be1fc1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398475:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be1fc1a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398488:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff962b832ca200) 00010000:00010000:1.0:1789117730.398491:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117730.398503:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be1fc1a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398510:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be1fc1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398525:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be1fc21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398532:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be1fc21 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398538:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be1fc21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398543:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117730.398545:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be1fc21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398551:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be1fc21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398558:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff962bae4aed00) 00010000:00010000:1.0:1789117730.398561:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117730.398564:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be1fc21 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398569:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be1fc21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398595:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d600/0xaa253ed19be1fc13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee18 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398634:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be1fc28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee18 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.398642:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff962a86dfc200) 00010000:00010000:1.0:1789117730.398644:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117730.398646:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70c600, rc 0) 00000100:00100000:1.0:1789117730.398730:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88626d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+19:10768:x1876025572097024:12345-192.168.204.30@tcp:101:rm.0 Request processed in 696us (2111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117730.398739:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00100000:0.0:1789117730.403615:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117730.403719:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572097280 00000100:00100000:2.0:1789117730.403731:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572097280 00000100:00100000:2.0:1789117730.403794:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 38 00000100:00100000:2.0:1789117730.403820:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a886243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+19:10768:x1876025572097280:12345-192.168.204.30@tcp:36:rm.0 00010000:00010000:2.0:1789117730.403895:0:14247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789117730.403938:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be1fc28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee18 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.403980:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fbd4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edfc expref: 18 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.403992:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff962a86dfc200) 00010000:00010000:2.0:1789117730.404003:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be1fbe9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee03 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.404012:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff962b832ca200) 00010000:00010000:2.0:1789117730.404015:0:14247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117730.404044:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fc2f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.404097:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fc2f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.404107:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fc2f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.404119:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be1fc36 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.404126:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be1fc36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.404132:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be1fc36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.404279:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fc3d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.404288:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fc3d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.404295:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fc3d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789117730.404589:0:14247:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789117730.404599:0:14247:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382687544514ns, next at 383687541889ns, rc = 0 00010000:00010000:2.0:1789117730.404647:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fc44 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.404656:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fc44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.404663:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fc44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.404670:0:14247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fc44 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.404676:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fc44 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.404682:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fc44 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.404714:0:14247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789117730.404734:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fc3d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.404742:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117730.404749:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fc3d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.404758:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fc3d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.404759:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fc44 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.404775:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117730.404776:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69000 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117730.404784:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fc44 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.404786:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fc3d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.404802:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fc44 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.404803:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fc3d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.405459:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff962a86dfc200) 00010000:00010000:1.0:1789117730.405465:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789117730.405470:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fc44 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117730.405478:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fc44 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117730.405562:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117730.405566:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117730.405568:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117730.405712:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff962a86dfc200) 00010000:00010000:2.0:1789117730.405716:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789117730.405721:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fc3d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.405727:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fc3d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.405745:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fc2f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.405751:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fc2f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.405757:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fc2f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.405761:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117730.405774:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fc2f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.405780:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fc2f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.405789:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff962b832ca200) 00010000:00010000:2.0:1789117730.405792:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117730.405795:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fc2f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.405801:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fc2f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789117730.405811:0:14247:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e35e5b2e reply state 0000000099fbbf15 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be1fc36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.405822:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be1fc36 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.405829:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff962bae4aed00) 00010000:00010000:2.0:1789117730.405832:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789117730.405835:0:14247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789117730.405954:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a886243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+18:10768:x1876025572097280:12345-192.168.204.30@tcp:36:rm.0 Request processed in 2131us (2347us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789117730.405962:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 38 00000100:00100000:0.0:1789117730.410523:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117730.410606:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572097536 00000100:00100000:2.0:1789117730.410619:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572097536 00000100:00100000:2.0:1789117730.410685:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:2.0:1789117730.410699:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+18:10768:x1876025572097536:12345-192.168.204.30@tcp:35:rm.0 00000100:00100000:2.0:1789117730.411006:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+19:10768:x1876025572097536:12345-192.168.204.30@tcp:35:rm.0 Request processed in 310us (494us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789117730.411029:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:0.0:1789117730.418900:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117730.419047:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572097792 00000100:00100000:2.0:1789117730.419096:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572097792 00000100:00100000:2.0:1789117730.419164:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:2.0:1789117730.419179:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88625a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+19:10768:x1876025572097792:12345-192.168.204.30@tcp:36:rm.0 00010000:00010000:2.0:1789117730.419256:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789117730.419287:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69200/0xaa253ed19be1fc05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee11 expref: 19 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.419310:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be1fba3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edee expref: 18 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.419324:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff962b832ca200) 00010000:00010000:2.0:1789117730.419340:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d400/0xaa253ed19be1fb64 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ede0 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.419350:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b95e52c00) 00010000:00010000:2.0:1789117730.419358:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117730.419395:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fc4b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.419418:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fc4b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.419430:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fc4b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.419444:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fc52 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.419458:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fc52 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.419465:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fc52 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.419562:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fc59 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.419570:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fc59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.419577:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fc59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117730.419827:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789117730.419847:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fc59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.419855:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fc59 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.419862:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fc59 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.419868:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b68c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117730.419872:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fc59 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.419880:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fc59 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.419899:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff962a86dfcd00) 00010000:00010000:2.0:1789117730.419903:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789117730.419907:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fc59 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.419913:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fc59 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.419951:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fc4b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.419957:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fc4b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.419963:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fc4b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.419969:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117730.419971:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fc4b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.419977:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fc4b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.419985:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962a86dfc600) 00010000:00010000:2.0:1789117730.419987:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117730.419990:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fc4b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.419995:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fc4b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789117730.420017:0:9533:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000671c6a42 reply state 00000000e6604d39 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fc52 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.420027:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fc52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117730.420033:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff962a86dfcf00) 00010000:00010000:2.0:1789117730.420035:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789117730.420037:0:9533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789117730.420193:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88625a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+18:10768:x1876025572097792:12345-192.168.204.30@tcp:36:rm.0 Request processed in 1016us (1307us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789117730.420202:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:3.0:1789117730.661470:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789117730.661507:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593170048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117730.661603:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117730.662159:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593170048 00000100:00100000:1.0:1789117730.662181:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593170048 00000100:00100000:1.0:1789117730.662246:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789117730.662259:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593170048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789117730.662298:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117730.662359:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593170048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117730.662372:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789117730.662905:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88626940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593170176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117730.663026:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789117730.663107:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e48f00 x1876025593170048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117730.663127:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593170048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117730.663279:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593170176 00000100:00100000:0.0:1789117730.663285:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593170176 00000100:00100000:0.0:1789117730.663336:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789117730.663349:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593170176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789117730.663373:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117730.663442:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593170176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117730.663449:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:3.0:1789117730.663799:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88626940 x1876025593170176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117730.663816:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88626940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593170176:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789117730.791325:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117731.681286:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117731.681329:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117731.681432:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572097920 00000100:00100000:2.0:1789117731.681451:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572097920 00000100:00100000:2.0:1789117731.681522:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 411 00000100:00100000:2.0:1789117731.681531:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2404:x1876025572097920:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117731.681599:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2404:x1876025572097920:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 69us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117731.681606:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 411 00000100:00100000:3.0:1789117731.682106:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117731.689341:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117731.694680:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572098176 00000100:00100000:1.0:1789117731.694702:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572098176 00000100:00100000:3.0:1789117731.694793:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117731.694807:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572098432 00000100:00100000:1.0:1789117731.694813:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572098432 00000100:00100000:3.0:1789117731.694835:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117731.694847:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572098048 00000100:00100000:1.0:1789117731.694852:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572098048 00000100:00100000:3.0:1789117731.694872:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572098560 00000100:00100000:3.0:1789117731.694877:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572098560 00000100:00100000:1.0:1789117731.694880:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 285 00000100:00100000:1.0:1789117731.694894:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2404:x1876025572098176:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117731.694927:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 286 00000100:00100000:3.0:1789117731.694937:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100c793d-0063-4934-90f0-b04fc41ff903+5:2404:x1876025572098432:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117731.695020:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100c793d-0063-4934-90f0-b04fc41ff903+5:2404:x1876025572098432:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 75us (12904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117731.695031:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 286 00000100:00100000:3.0:1789117731.695051:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 287 00000100:00100000:3.0:1789117731.695081:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+18:2405:x1876025572098048:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117731.695112:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+18:2405:x1876025572098048:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 33us (5778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117731.695118:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 287 00000100:00100000:3.0:1789117731.695132:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 288 00000100:00100000:3.0:1789117731.695140:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572098560:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117731.695180:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572098560:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 41us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117731.695187:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 288 00000100:00100000:3.0:1789117731.695210:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572098304 00000100:00100000:3.0:1789117731.695215:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572098304 00000100:00100000:3.0:1789117731.695250:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 106 00000100:00100000:3.0:1789117731.695259:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2405:x1876025572098304:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117731.695305:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2405:x1876025572098304:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 49us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117731.695314:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 106 00000100:00100000:1.0:1789117731.696100:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2404:x1876025572098176:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 1204us (14764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117731.696110:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 285 00000100:00080000:1.0:1789117731.696148:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789117731.696153:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789117731.814635:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117732.713128:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593170304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789117732.713216:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117732.713304:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593170304 00000100:00100000:2.0:1789117732.713312:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593170304 00000100:00100000:2.0:1789117732.713950:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789117732.713964:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593170304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789117732.714356:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789117732.714438:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593170304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 478us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117732.714446:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789117732.714506:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593170304:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789117732.837337:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117733.862886:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117734.763174:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88626580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593170432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117734.763260:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117734.763340:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593170432 00000100:00100000:0.0:1789117734.763348:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593170432 00000100:00100000:0.0:1789117734.763450:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789117734.763460:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88627840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593170432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789117734.763491:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117734.763535:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88627840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593170432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117734.763790:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593170560:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789117734.763824:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117734.763886:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593170560 00000100:00100000:1.0:1789117734.763890:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593170560 00000100:00100000:1.0:1789117734.763912:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789117734.763920:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593170560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789117734.763945:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117734.763977:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593170560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117734.763985:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:1.0:1789117734.764023:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e48f00 x1876025593170560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117734.764043:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593170560:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789117734.764108:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789117734.764132:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88626580 x1876025593170432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117734.764146:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88626580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593170432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117734.764487:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00010000:2.0:1789117734.885449:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117735.271486:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593170688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117735.271603:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117735.271726:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593170688 00000100:00100000:1.0:1789117735.271736:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593170688 00000100:00100000:1.0:1789117735.271789:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789117735.271800:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593170688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789117735.271868:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789117735.272580:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593170688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 778us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117735.272589:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789117735.272728:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593170688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117735.273149:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593170816:0@lo:400:kworker.0 00000100:00100000:0.0:1789117735.273232:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117735.273260:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593171328:0@lo:400:kworker.0 00000100:00100000:0.0:1789117735.273310:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117735.273464:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593171840:0@lo:400:kworker.0 00000100:00100000:0.0:1789117735.273492:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117735.273515:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789117735.273532:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88626940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593170944:0@lo:400:kworker.0 00000100:00100000:0.0:1789117735.273560:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117735.273574:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593171456:0@lo:400:kworker.0 00000100:00100000:0.0:1789117735.273595:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117735.273610:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593171968:0@lo:400:kworker.0 00000100:00100000:0.0:1789117735.273629:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117735.273659:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593171328 00000100:00100000:0.0:1789117735.273665:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593171328 00000100:00100000:0.0:1789117735.273714:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593170944 00000100:00100000:0.0:1789117735.273718:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593170944 00000100:00100000:0.0:1789117735.273739:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593171456 00000100:00100000:0.0:1789117735.273742:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593171456 00000100:00100000:0.0:1789117735.273762:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1789117735.273772:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593171328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117735.273822:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593171328:12345-0@lo:400:kworker.0 Request processed in 52us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117735.273830:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1789117735.273859:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789117735.273867:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593170944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117735.273897:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593170944:12345-0@lo:400:kworker.0 Request processed in 31us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117735.273903:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789117735.273915:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1789117735.273922:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593171456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117735.273952:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593171456:12345-0@lo:400:kworker.0 Request processed in 31us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117735.273969:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1789117735.273989:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593171840 00000100:00100000:0.0:1789117735.273994:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593171840 00000100:00100000:0.0:1789117735.274044:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593171968 00000100:00100000:0.0:1789117735.274048:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593171968 00000100:00100000:0.0:1789117735.274092:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789117735.274098:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593171840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117735.274133:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593171840:12345-0@lo:400:kworker.0 Request processed in 36us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117735.274140:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789117735.274152:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789117735.274159:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf775a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593171968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117735.274185:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf775a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593171968:12345-0@lo:400:kworker.0 Request processed in 28us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117735.274190:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789117735.274260:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88626940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593170944:0@lo:400:kworker.0 00000100:00100000:1.0:1789117735.275858:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593170816 00000100:00100000:1.0:1789117735.275870:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593170816 00000100:00100000:1.0:1789117735.275975:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:1.0:1789117735.275985:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593170816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117735.276075:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593170816:12345-0@lo:400:kworker.0 Request processed in 93us (2843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117735.276082:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00080000:1.0:1789117735.276126:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789117735.276131:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789117735.276134:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117735.276158:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88626580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593171072:0@lo:400:kworker.0 00000100:00100000:1.0:1789117735.276210:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117735.276250:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593171584:0@lo:400:kworker.0 00000100:00100000:1.0:1789117735.276273:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117735.276297:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789117735.276304:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593171200:0@lo:400:kworker.0 00000100:00100000:1.0:1789117735.276330:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117735.276351:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593171712:0@lo:400:kworker.0 00000100:00100000:1.0:1789117735.276375:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117735.276401:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593171072 00000100:00100000:1.0:1789117735.276405:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593171072 00000100:00100000:1.0:1789117735.276428:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593171584 00000100:00100000:1.0:1789117735.276431:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593171584 00000100:00100000:1.0:1789117735.276456:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593171712 00000100:00100000:1.0:1789117735.276459:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593171712 00000100:00100000:1.0:1789117735.276488:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1789117735.276495:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593171072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117735.276536:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593171072:12345-0@lo:400:kworker.0 Request processed in 40us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117735.276552:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1789117735.276567:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1789117735.276573:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593171584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117735.276604:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593171584:12345-0@lo:400:kworker.0 Request processed in 32us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117735.276609:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1789117735.276622:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1789117735.276629:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593171712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117735.276660:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593171712:12345-0@lo:400:kworker.0 Request processed in 31us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117735.276666:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:1.0:1789117735.276695:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789117735.276698:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789117735.276847:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87fa9680 x1876025593171712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117735.276862:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593171712:0@lo:400:kworker.0 00000100:00100000:1.0:1789117735.276875:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88626580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593171072:0@lo:400:kworker.0 00000100:00100000:1.0:1789117735.276884:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593171584:0@lo:400:kworker.0 00000100:00100000:1.0:1789117735.276917:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593171200 00000100:00100000:1.0:1789117735.276920:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593171200 00000100:00100000:1.0:1789117735.276949:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789117735.276957:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593171200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117735.276997:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593171200:12345-0@lo:400:kworker.0 Request processed in 41us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117735.277013:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789117735.277072:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593171200:0@lo:400:kworker.0 00010000:00080000:0.0:1789117735.279497:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87fa83c0 x1876025593171456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117735.279533:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593171456:0@lo:400:kworker.0 00010000:00080000:0.0:1789117735.279585:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e14f00 x1876025593171968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117735.279595:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593171968:0@lo:400:kworker.0 00000100:00100000:0.0:1789117735.279609:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593170816:0@lo:400:kworker.0 00000100:00100000:0.0:1789117735.279623:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593171328:0@lo:400:kworker.0 00010000:00080000:0.0:1789117735.279658:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87faa940 x1876025593171840/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117735.279668:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593171840:0@lo:400:kworker.0 00000001:02000400:2.0:1789117735.441339:0:14384:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1789117735.782457:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf776d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593172096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789117735.782596:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117735.782683:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593172096 00000100:00100000:0.0:1789117735.782690:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593172096 00000100:00100000:0.0:1789117735.782742:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789117735.782751:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf776940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593172096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789117735.782781:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117735.782839:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf776940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593172096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117735.782846:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:0.0:1789117735.782889:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf776d00 x1876025593172096/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117735.782909:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf776d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593172096:0@lo:13:osp-pre-1-1.0 00000004:00080000:1.0:1789117735.783473:0:9922:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 388066416507ns, next at 389066412870ns, rc = 0 00000100:00100000:0.0:1789117735.783890:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593172224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117735.783947:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117735.784372:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593172224 00000100:00100000:1.0:1789117735.784380:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593172224 00000100:00100000:1.0:1789117735.784427:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789117735.784436:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf776d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593172224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789117735.784461:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117735.784527:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf776d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593172224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117735.784534:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:2.0:1789117735.784796:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88627c00 x1876025593172224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117735.784816:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593172224:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1789117735.789559:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1789117735.789579:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:0.0:1789117735.789762:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be1fbb8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.789774:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be1fbb8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.789782:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be1fbb8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.789819:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117735.789834:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be1fbb8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.789843:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be1fbb8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.789915:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff962bae4aed00) 00010000:00010000:0.0:1789117735.789919:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117735.789925:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be1fbb8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.789931:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be1fbb8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.789966:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fbcd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.789973:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fbcd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.789978:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fbcd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.789983:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117735.789985:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fbcd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.789990:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fbcd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.790009:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff962a86dfc200) 00010000:00010000:0.0:1789117735.790012:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117735.790015:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fbcd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.790022:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fbcd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.790039:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be1fc36 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.790046:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be1fc36 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.790051:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be1fc36 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.790110:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117735.790114:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be1fc36 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.790120:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be1fc36 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.790367:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff962bae4aed00) 00010000:00010000:0.0:1789117735.790371:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117735.790374:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be1fc36 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.790381:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be1fc36 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.790423:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fc52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.790430:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fc52 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.790436:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fc52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.790442:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117735.790445:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fc52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.790450:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fc52 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.790459:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff962a86dfcf00) 00010000:00010000:0.0:1789117735.790461:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117735.790464:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fc52 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117735.790469:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fc52 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117735.792620:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88626940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593172352:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789117735.792720:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117735.792858:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593172352 00000100:00100000:2.0:1789117735.792867:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593172352 00000100:00100000:2.0:1789117735.792937:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789117735.792947:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf775680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593172352:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789117735.792973:0:8833:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1789117735.793006:0:8833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aa3c522, atime: 0x6aa3c522, ctime: 0x6aa3c522, blocks: 0x0 00010000:00010000:2.0:1789117735.793015:0:8833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007dbdf79/0xaa253ed19be1fc60 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117735.793030:0:8833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=388s v=(0 0) 00010000:00010000:2.0:1789117735.793035:0:8833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117735.793041:0:8833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007dbdf79/0xaa253ed19be1fc60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117735.793086:0:8833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007dbdf79/0xaa253ed19be1fc60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117735.793116:0:8833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007dbdf79/0xaa253ed19be1fc60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117735.793123:0:8833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007dbdf79/0xaa253ed19be1fc60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117735.793148:0:8833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789117735.793236:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117735.793244:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007dbdf79/0xaa253ed19be1fc60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117735.793252:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117735.793257:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007dbdf79/0xaa253ed19be1fc60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117735.793267:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007dbdf79/0xaa253ed19be1fc60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117735.793287:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007dbdf79/0xaa253ed19be1fc60 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117735.793295:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007dbdf79/0xaa253ed19be1fc60 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117735.793334:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117735.793337:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117735.793339:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117735.793346:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf775680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1876025593172352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 400us (625us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789117735.793355:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:3.0:1789117735.793494:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff962a88626940/2, rc 0, transno 4294967301 00000100:00100000:3.0:1789117735.793502:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88626940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593172352:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789117735.909360:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117736.801513:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117736.801561:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117736.801606:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117736.801622:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117736.801640:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117736.801661:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117736.801953:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572098944 00000100:00100000:0.0:1789117736.801966:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572098944 00000100:00100000:0.0:1789117736.802037:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 295 00000100:00100000:0.0:1789117736.802048:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572098944:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117736.802192:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572098944:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 146us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117736.802201:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 295 00000100:00100000:0.0:1789117736.802221:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572099200 00000100:00100000:0.0:1789117736.802224:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572099200 00000100:00100000:0.0:1789117736.802242:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572098816 00000100:00100000:0.0:1789117736.802245:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572098816 00000100:00100000:0.0:1789117736.802261:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572099328 00000100:00100000:0.0:1789117736.802264:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572099328 00000100:00100000:0.0:1789117736.802278:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 296 00000100:00100000:0.0:1789117736.802296:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572099200:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117736.802323:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572099200:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 38us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117736.802329:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 296 00000100:00100000:0.0:1789117736.802342:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 297 00000100:00100000:0.0:1789117736.802348:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572098816:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117736.802369:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572098816:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 22us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117736.802375:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 297 00000100:00100000:0.0:1789117736.802386:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 298 00000100:00100000:0.0:1789117736.802392:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572099328:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117736.802413:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572099328:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 21us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117736.802419:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 298 00000100:00100000:0.0:1789117736.802438:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572099072 00000100:00100000:0.0:1789117736.802648:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572099072 00000100:00100000:0.0:1789117736.802683:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 109 00000100:00100000:0.0:1789117736.802690:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572099072:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117736.802717:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572099072:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 28us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117736.802724:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 109 00000100:00080000:3.0:1789117736.803149:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789117736.803155:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789117736.803157:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789117736.803269:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572098688 00000100:00100000:1.0:1789117736.803275:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572098688 00000100:00100000:1.0:1789117736.803317:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 413 00000100:00100000:1.0:1789117736.803324:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572098688:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117736.803363:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572098688:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 39us (1863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117736.803369:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 413 00010000:00010000:0.0:1789117736.935389:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789117736.982788:0:14433:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd09503710 20000000:00000080:2.0:1789117736.983541:0:14433:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff962a88575c00 uarg=0000000000000000 20000000:01000000:2.0:1789117736.983614:0:14433:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789117736.983625:0:14433:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789117736.983631:0:14433:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1789117736.984535:0:14434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 20000000:02000000:2.0:1789117736.984766:0:14433:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1789117736.993000:0:14433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 224 off10720 00000040:00080000:2.0:1789117736.993094:0:14433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 128 off10848 00000040:00080000:2.0:1789117736.993117:0:14433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off11072 10000000:01000000:2.0:1789117736.993144:0:14433:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789117736.993181:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962b89b69600/0xaa253ed19be1fc67 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117736.993211:0:14433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962bbf70da00/0xaa253ed19be1faed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edcb expref: 12 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117736.993220:0:14433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b813db600/0xaa253ed19be1faf4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edd2 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117736.993255:0:14433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962a87d93000/0xaa253ed19be1fb02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fafb expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117736.993262:0:14433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962a87d92600/0xaa253ed19be1fb10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fb09 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117736.993271:0:14433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962a87d92200/0xaa253ed19be1fb1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fb17 expref: 23 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117736.995936:0:14433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962bbf70de00/0xaa253ed19be1fb2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fb25 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117736.995976:0:14433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962b89b69600/0xaa253ed19be1fc67 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117736.996034:0:14433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962bbf70de00/0xaa253ed19be1fb2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1fb25 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117736.996051:0:14433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962bbf70de00/0xaa253ed19be1fb2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1fb25 expref: 23 pid: 6513 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117736.996084:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa86580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14433:1876025593172480:0@lo:104: 00000100:00100000:2.0:1789117736.996159:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789117736.996240:0:14433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962a87d92200/0xaa253ed19be1fb1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1fb17 expref: 23 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117736.996249:0:14433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962a87d92200/0xaa253ed19be1fb1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1fb17 expref: 23 pid: 9525 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117736.996257:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14433:1876025593172608:0@lo:104: 00000100:00100000:2.0:1789117736.996291:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789117736.996318:0:14433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962a87d92600/0xaa253ed19be1fb10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1fb09 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117736.996327:0:14433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962a87d92600/0xaa253ed19be1fb10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1fb09 expref: 23 pid: 6513 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117736.996336:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14433:1876025593172736:0@lo:104: 00000100:00100000:2.0:1789117736.996358:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789117736.996378:0:14433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962a87d93000/0xaa253ed19be1fb02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be1fafb expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117736.996385:0:14433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962a87d93000/0xaa253ed19be1fb02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be1fafb expref: 23 pid: 6512 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117736.996393:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b989ccb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14433:1876025593172864:0@lo:104: 00000100:00100000:2.0:1789117736.996412:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789117736.996432:0:14433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b813db600/0xaa253ed19be1faf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edd2 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117736.996442:0:14433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962b813db600/0xaa253ed19be1faf4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edd2 expref: 12 pid: 6514 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117736.996452:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b989cf0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14433:1876025593172992:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789117736.996513:0:14433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962bbf70da00/0xaa253ed19be1faed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edcb expref: 12 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117736.996522:0:14433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962bbf70da00/0xaa253ed19be1faed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edcb expref: 12 pid: 9525 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117736.996542:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b989cfc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14433:1876025593173120:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789117736.996567:0:14433:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b89635300 going to sleep for 11 seconds 00000100:00100000:1.0:1789117736.996729:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593172480 00000100:00100000:1.0:1789117736.996739:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593172480 00000100:00100000:1.0:1789117736.996778:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593172608 00000100:00100000:1.0:1789117736.996781:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593172608 00000100:00100000:1.0:1789117736.996792:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593172736 00000100:00100000:1.0:1789117736.996794:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593172736 00000100:00100000:1.0:1789117736.996814:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593172864 00000100:00100000:1.0:1789117736.996817:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593172864 00000100:00100000:1.0:1789117736.996834:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789117736.996843:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa87840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+6:14433:x1876025593172480:12345-0@lo:104: 00010000:00010000:1.0:1789117736.996857:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962a87d92c00/0xaa253ed19be1fb25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fb2c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.996924:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789117736.996931:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa87840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+6:14433:x1876025593172480:12345-0@lo:104: Request processed in 89us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117736.996947:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789117736.996966:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789117736.996973:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+5:14433:x1876025593172608:12345-0@lo:104: 00010000:00010000:1.0:1789117736.996981:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962a87d93600/0xaa253ed19be1fb17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fb1e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.997017:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789117736.997022:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+5:14433:x1876025593172608:12345-0@lo:104: Request processed in 50us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117736.997028:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789117736.997041:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789117736.997047:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+4:14433:x1876025593172736:12345-0@lo:104: 00010000:00010000:1.0:1789117736.997084:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be1fb09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fb10 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.997119:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789117736.997125:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+4:14433:x1876025593172736:12345-0@lo:104: Request processed in 78us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117736.997131:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789117736.997143:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789117736.997149:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+3:14433:x1876025593172864:12345-0@lo:104: 00010000:00010000:1.0:1789117736.997156:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962bbf70c200/0xaa253ed19be1fafb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fb02 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.997182:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789117736.997186:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7945443b-b7e4-4157-aee9-c9b2172613e6+3:14433:x1876025593172864:12345-0@lo:104: Request processed in 39us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117736.997196:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:1.0:1789117736.997214:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789117736.997220:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962a87d92c00/0xaa253ed19be1fb25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fb2c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.997227:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92c00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789117736.997231:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962a87d92c00/0xaa253ed19be1fb25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1fb2c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.997240:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962a87d92c00/0xaa253ed19be1fb25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1fb2c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117736.997246:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962a87d92c00/0xaa253ed19be1fb25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1fb2c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117736.997252:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789117736.997346:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962a87d92c00/0xaa253ed19be1fb25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fb2c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.997353:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117736.997378:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962a87d92c00/0xaa253ed19be1fb25 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fb2c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.997385:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962a87d92c00/0xaa253ed19be1fb25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fb2c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.997399:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789117736.997402:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962a87d93600/0xaa253ed19be1fb17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fb1e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.997418:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93600 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789117736.997420:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962a87d93600/0xaa253ed19be1fb17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1fb1e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.997426:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962a87d93600/0xaa253ed19be1fb17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1fb1e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117736.997432:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962a87d93600/0xaa253ed19be1fb17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1fb1e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117736.997437:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789117736.997452:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962a87d93600/0xaa253ed19be1fb17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fb1e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.997457:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117736.997473:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962a87d93600/0xaa253ed19be1fb17 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fb1e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.997479:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962a87d93600/0xaa253ed19be1fb17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fb1e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.997488:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789117736.997491:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be1fb09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fb10 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.997497:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d200 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789117736.997501:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be1fb09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1fb10 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.997518:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be1fb09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1fb10 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117736.997524:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be1fb09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1fb10 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117736.997529:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789117736.997543:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be1fb09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fb10 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.997548:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117736.997555:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be1fb09 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fb10 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.997561:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be1fb09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fb10 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.997572:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117736.997575:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bbf70c200/0xaa253ed19be1fafb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be1fb02 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.997580:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c200 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789117736.997583:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70c200/0xaa253ed19be1fafb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be1fb02 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.997589:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bbf70c200/0xaa253ed19be1fafb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be1fb02 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117736.997595:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70c200/0xaa253ed19be1fafb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be1fb02 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117736.997607:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789117736.997621:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962bbf70c200/0xaa253ed19be1fafb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fb02 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.997626:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117736.997632:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bbf70c200/0xaa253ed19be1fafb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fb02 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.997638:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bbf70c200/0xaa253ed19be1fafb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be1fb02 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.997651:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117736.997653:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117736.997655:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117736.997662:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117736.997667:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117736.997686:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593173248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117736.997717:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117736.997796:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789117736.997813:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593173632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117736.997840:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117736.997878:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593173504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117736.997905:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117736.997923:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789117736.997928:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593173376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117736.997944:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117736.997973:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593173248 00000100:00100000:1.0:1789117736.997983:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593173248 00010000:00010000:1.0:1789117736.998008:0:9524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962bbf70de00/0xaa253ed19be1fb2c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1fb25 expref: 24 pid: 6513 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117736.998034:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593173632 00000100:00100000:1.0:1789117736.998037:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593173632 00010000:00010000:1.0:1789117736.998047:0:9524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962a87d93000/0xaa253ed19be1fb02 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1fafb expref: 25 pid: 6512 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117736.998089:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593173504 00000100:00100000:1.0:1789117736.998091:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593173504 00010000:00010000:1.0:1789117736.998101:0:9524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962a87d92600/0xaa253ed19be1fb10 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1fb09 expref: 26 pid: 6513 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117736.998111:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593173376 00000100:00100000:1.0:1789117736.998113:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593173376 00010000:00010000:1.0:1789117736.998123:0:9524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962a87d92200/0xaa253ed19be1fb1e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1fb17 expref: 27 pid: 9525 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117736.998136:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789117736.998142:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87faad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7945443b-b7e4-4157-aee9-c9b2172613e6+27:3645:x1876025593173248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789117736.998154:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117736.998159:0:9524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962bbf70de00/0xaa253ed19be1fb2c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1fb25 expref: 27 pid: 6513 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.998172:0:9524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962bbf70de00/0xaa253ed19be1fb2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1fb25 expref: 27 pid: 6513 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.998192:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117736.998224:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87faad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7945443b-b7e4-4157-aee9-c9b2172613e6+27:3645:x1876025593173248:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117736.998232:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789117736.998255:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789117736.998261:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb093a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7945443b-b7e4-4157-aee9-c9b2172613e6+26:3645:x1876025593173632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789117736.998268:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117736.998272:0:9524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962a87d93000/0xaa253ed19be1fb02 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1fafb expref: 26 pid: 6512 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.998293:0:9524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962a87d93000/0xaa253ed19be1fb02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1fafb expref: 26 pid: 6512 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.998303:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117736.998329:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb093a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7945443b-b7e4-4157-aee9-c9b2172613e6+26:3645:x1876025593173632:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117736.998335:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789117736.998379:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789117736.998386:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7945443b-b7e4-4157-aee9-c9b2172613e6+25:3647:x1876025593173504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789117736.998392:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117736.998396:0:9524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962a87d92600/0xaa253ed19be1fb10 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1fb09 expref: 25 pid: 6513 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.998404:0:9524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962a87d92600/0xaa253ed19be1fb10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1fb09 expref: 25 pid: 6513 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.998413:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117736.998439:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7945443b-b7e4-4157-aee9-c9b2172613e6+25:3647:x1876025593173504:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117736.998445:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789117736.998458:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789117736.998464:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3647:x1876025593173376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789117736.998480:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117736.998484:0:9524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962a87d92200/0xaa253ed19be1fb1e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be1fb17 expref: 24 pid: 9525 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.998494:0:9524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962a87d92200/0xaa253ed19be1fb1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be1fb17 expref: 24 pid: 9525 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117736.998504:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117736.998526:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3647:x1876025593173376:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117736.998533:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789117736.998588:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593173376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117736.998600:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593173504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117736.998630:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593173632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117736.998638:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593173248:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789117736.998780:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bbf70de00/0xaa253ed19be1fb2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1fb25 expref: 23 pid: 6513 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117736.998794:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa86580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14433:1876025593172480:0@lo:104: 00010000:00010000:2.0:1789117736.998818:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d92200/0xaa253ed19be1fb1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1fb17 expref: 22 pid: 9525 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117736.998826:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14433:1876025593172608:0@lo:104: 00010000:00010000:2.0:1789117736.998836:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d92600/0xaa253ed19be1fb10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1fb09 expref: 21 pid: 6513 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117736.998843:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14433:1876025593172736:0@lo:104: 00010000:00010000:2.0:1789117736.998852:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d93000/0xaa253ed19be1fb02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be1fafb expref: 20 pid: 6512 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117736.998859:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b989ccb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14433:1876025593172864:0@lo:104: 00000100:00100000:0.0:1789117737.003015:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117737.003164:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117737.003297:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572099584 00000100:00100000:3.0:1789117737.003316:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572099584 00010000:00010000:3.0:1789117737.003375:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962bbf70da00/0xaa253ed19be1faed lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edcb expref: 13 pid: 9525 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117737.003428:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572099456 00000100:00100000:3.0:1789117737.003432:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572099456 00010000:00010000:3.0:1789117737.003447:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b813db600/0xaa253ed19be1faf4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edd2 expref: 14 pid: 6514 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117737.003476:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 62 00000100:00100000:3.0:1789117737.003487:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f71680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b51ebb8-b89b-4376-982e-072902ca33a8+14:2406:x1876025572099584:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117737.003532:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117737.003539:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962bbf70da00/0xaa253ed19be1faed lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edcb expref: 14 pid: 9525 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117737.003553:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962bbf70da00/0xaa253ed19be1faed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edcb expref: 14 pid: 9525 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117737.003584:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117737.003658:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f71680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b51ebb8-b89b-4376-982e-072902ca33a8+14:2406:x1876025572099584:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 172us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117737.003666:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 62 00000100:00100000:0.0:1789117737.004319:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 63 00000100:00100000:0.0:1789117737.004348:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f72d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2406:x1876025572099456:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117737.004373:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117737.004396:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b813db600/0xaa253ed19be1faf4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edd2 expref: 13 pid: 6514 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117737.004417:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b813db600/0xaa253ed19be1faf4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edd2 expref: 13 pid: 6514 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117737.004456:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962b89b69600/0xaa253ed19be1fc67 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117737.004467:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b89b69600/0xaa253ed19be1fc67 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117737.004496:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962b89b69600/0xaa253ed19be1fc67 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117737.004504:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962b89b69600/0xaa253ed19be1fc67 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117737.004530:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962b89b69600/0xaa253ed19be1fc67 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117737.004539:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962b89b69600/0xaa253ed19be1fc67 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117737.004545:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789117737.004550:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962b89b69600/0xaa253ed19be1fc67 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117737.004560:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962b89b69600/0xaa253ed19be1fc67 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117737.004572:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962b89b69600/0xaa253ed19be1fc67 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117737.004587:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117737.004673:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f72d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2406:x1876025572099456:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 342us (1509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117737.004684:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 63 00010000:00010000:2.0:1789117737.006294:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813db600/0xaa253ed19be1faf4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edd2 expref: 12 pid: 6514 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117737.006317:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b989cf0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14433:1876025593172992:192.168.204.30@tcp:104: 00010000:00010000:1.0:1789117737.006599:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bbf70da00/0xaa253ed19be1faed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0edcb expref: 11 pid: 9525 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117737.006614:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b989cfc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14433:1876025593173120:192.168.204.30@tcp:104: 00010000:00010000:1.0:1789117737.006678:0:14433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962b89b69600/0xaa253ed19be1fc67 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117737.006688:0:14433:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962b89b69600/0xaa253ed19be1fc67 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117737.006695:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962b89b69600/0xaa253ed19be1fc67 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117737.006724:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b89b69600/0xaa253ed19be1fc67 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117737.829453:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117737.829479:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593173760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789117737.829566:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117737.830029:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593173760 00000100:00100000:0.0:1789117737.830037:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593173760 00000100:00100000:0.0:1789117737.830110:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789117737.830119:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593173760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789117737.830152:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789117737.830237:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593173760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117737.830245:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789117737.830371:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593173760:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789117737.960838:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789117738.131234:0:14482:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd986bd860 20000000:00000080:0.0:1789117738.131264:0:14482:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff962a88608400 uarg=0000000000000000 20000000:01000000:0.0:1789117738.131325:0:14482:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1789117738.131335:0:14482:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1789117738.131341:0:14482:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1789117738.135529:0:14483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 16 count 16 20000000:02000000:0.0:1789117738.135842:0:14482:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1789117738.135981:0:14482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11296 00000040:00080000:0.0:1789117738.136020:0:14482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 128 off11424 00000040:00080000:0.0:1789117738.136038:0:14482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11648 10000000:01000000:0.0:1789117738.136088:0:14482:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789117738.136119:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fc6e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117738.136143:0:14482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fc6e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117738.136156:0:14482:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fc6e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117738.136164:0:14482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fc6e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117738.136173:0:14482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fc6e lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117738.136181:0:14482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fc6e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117738.136188:0:14482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dba00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789117738.136193:0:14482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fc6e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117738.136222:0:14482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fc6e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117738.136239:0:14482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fc6e lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117738.136247:0:14482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fc6e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117738.136253:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813dba00/0xaa253ed19be1fc6e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117738.657288:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117738.657485:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572099712 00000100:00100000:1.0:1789117738.657494:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572099712 00000100:00100000:1.0:1789117738.657558:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 414 00000100:00100000:1.0:1789117738.657567:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+11:6181:x1876025572099712:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117738.657585:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117738.657604:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbf70de00/0xaa253ed19be1fc75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ee1f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117738.657632:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbf70de00/0xaa253ed19be1fc75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee1f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117738.657643:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbf70de00/0xaa253ed19be1fc75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee1f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117738.657652:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70de00, rc 0) 00000100:00100000:1.0:1789117738.657714:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+12:6181:x1876025572099712:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 Request processed in 148us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117738.657721:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 414 00000100:00100000:3.0:1789117738.665431:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117738.665557:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572099840 00000100:00100000:1.0:1789117738.665568:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572099840 00000100:00100000:1.0:1789117738.665675:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 415 00000100:00100000:1.0:1789117738.665685:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+12:6181:x1876025572099840:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117738.665851:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+12:6181:x1876025572099840:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 Request processed in 168us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117738.665873:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 415 00000100:00100000:3.0:1789117738.672975:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117738.673177:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572099968 00000100:00100000:1.0:1789117738.673198:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572099968 00000100:00100000:1.0:1789117738.673363:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 416 00000100:00100000:1.0:1789117738.673375:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+12:6181:x1876025572099968:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117738.673583:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+12:6181:x1876025572099968:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 Request processed in 208us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117738.673591:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 416 00000100:00100000:3.0:1789117738.684115:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117738.684799:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572100096 00000100:00100000:1.0:1789117738.684811:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572100096 00000100:00100000:1.0:1789117738.684877:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 417 00000100:00100000:1.0:1789117738.684887:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+12:11052:x1876025572100096:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789117738.685081:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+12:11052:x1876025572100096:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 195us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117738.685090:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 417 00000100:00100000:3.0:1789117738.691578:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117738.691844:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572100224 00000100:00100000:2.0:1789117738.691856:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572100224 00000100:00100000:2.0:1789117738.691935:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 418 00000100:00100000:2.0:1789117738.691948:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+12:11052:x1876025572100224:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789117738.692311:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b51ebb8-b89b-4376-982e-072902ca33a8+12:11052:x1876025572100224:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 364us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117738.692318:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 418 00000100:00100000:3.0:1789117738.715410:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117738.715514:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572100352 00000100:00100000:1.0:1789117738.715526:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572100352 00000100:00100000:1.0:1789117738.715605:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 419 00000100:00100000:1.0:1789117738.715622:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+12:6181:x1876025572100352:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117738.715649:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117738.715684:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbf70c600/0xaa253ed19be1fc7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ee26 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117738.715731:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbf70c600/0xaa253ed19be1fc7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee26 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117738.715797:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbf70c600/0xaa253ed19be1fc7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee26 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117738.715812:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70c600, rc 0) 00000100:00100000:1.0:1789117738.718403:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:6181:x1876025572100352:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 Request processed in 2776us (2993us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117738.718416:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 419 00000100:00100000:3.0:1789117738.726526:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117738.726655:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572100480 00000100:00100000:1.0:1789117738.726665:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572100480 00000100:00100000:1.0:1789117738.726727:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 420 00000100:00100000:1.0:1789117738.726736:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:6181:x1876025572100480:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117738.726905:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:6181:x1876025572100480:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 Request processed in 170us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117738.726915:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 420 00000100:00100000:3.0:1789117738.730325:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117738.731703:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572100608 00000100:00100000:0.0:1789117738.731724:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572100608 00000100:00100000:0.0:1789117738.731848:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 421 00000100:00100000:0.0:1789117738.731868:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+13:6181:x1876025572100608:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117738.732173:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+13:6181:x1876025572100608:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 Request processed in 309us (1864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117738.732186:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 421 00000100:00100000:3.0:1789117738.757706:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117738.758010:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572100736 00000100:00100000:1.0:1789117738.758021:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572100736 00000100:00100000:1.0:1789117738.758124:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 422 00000100:00100000:1.0:1789117738.758137:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:11056:x1876025572100736:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789117738.758357:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b51ebb8-b89b-4376-982e-072902ca33a8+13:11056:x1876025572100736:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 222us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117738.758378:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 422 00000100:00100000:3.0:1789117738.763751:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117738.764421:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572100864 00000100:00100000:0.0:1789117738.764437:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572100864 00000100:00100000:0.0:1789117738.764513:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 423 00000100:00100000:0.0:1789117738.764523:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba1a92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+13:11056:x1876025572100864:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789117738.764714:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba1a92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+13:11056:x1876025572100864:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 192us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117738.764723:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 423 10000000:01000000:1.0:1789117738.853243:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789117738.853253:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962b872f5000 from 13 10000000:01000000:1.0:1789117738.853260:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789117738.853319:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1fc83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117738.853358:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1fc83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117738.853370:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1fc83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117738.853397:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593173888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789117738.853480:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117738.853545:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf751c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789117738.854108:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593173888 00000100:00100000:2.0:1789117738.854117:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593173888 00000100:00100000:2.0:1789117738.854176:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1789117738.854186:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba1a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+20:6517:x1876025593173888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117738.854198:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117738.854213:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b89b69200/0xaa253ed19be1fc8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1fc83 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117738.854237:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b89b69200/0xaa253ed19be1fc8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1fc83 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117738.854248:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b89b69200/0xaa253ed19be1fc8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fc83 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117738.854257:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69200, rc 0) 00000100:00100000:2.0:1789117738.854311:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba1a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593173888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117738.854318:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1789117738.854482:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593173888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117738.854501:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1fc83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fc8a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117738.854510:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1fc83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1fc8a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117738.854577:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593174016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117738.854619:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117738.854640:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b89b6b480 going to sleep for 11 seconds 00000100:00100000:0.0:1789117738.854778:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593174016 00000100:00100000:0.0:1789117738.854783:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593174016 00000100:00100000:0.0:1789117738.854819:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1789117738.854827:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba1a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593174016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117738.854962:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba1a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593174016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117738.854971:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1789117738.855321:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593174016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117738.855367:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593174144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117738.855414:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117738.855444:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b89b6b480 going to sleep for 11 seconds 00000100:00100000:2.0:1789117738.855548:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593174144 00000100:00100000:2.0:1789117738.855562:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593174144 00000100:00100000:2.0:1789117738.855597:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:2.0:1789117738.855604:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90434450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593174144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117738.855694:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90434450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593174144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117738.855700:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:1.0:1789117738.855787:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593174144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117738.856205:0:14495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e14f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14495:1876025593174272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117738.856243:0:14495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117738.856269:0:14495:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c1e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117738.856433:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593174272 00000100:00100000:2.0:1789117738.856437:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593174272 00000100:00100000:2.0:1789117738.856476:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:2.0:1789117738.856483:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:14495:x1876025593174272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117738.856567:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:14495:x1876025593174272:12345-0@lo:502:llog_process_th.0 Request processed in 84us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117738.856574:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1789117738.856710:0:14495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e14f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14495:1876025593174272:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789117738.856730:0:14495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117738.856740:0:14495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117738.856742:0:14495:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789117738.856750:0:14495:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962b872f5000 00000020:00000080:0.0:1789117738.856753:0:14495:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789117738.856830:0:14495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117738.856833:0:14495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117738.856835:0:14495:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789117738.856839:0:14495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117738.856841:0:14495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117738.856842:0:14495:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789117738.856845:0:14495:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962b872f5000 00000020:00000080:0.0:1789117738.856847:0:14495:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789117738.856880:0:14495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e14f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14495:1876025593174400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117738.856912:0:14495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117738.856938:0:14495:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c1e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117738.856998:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593174400 00000100:00100000:3.0:1789117738.857002:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593174400 00000100:00100000:3.0:1789117738.857037:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1789117738.857044:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+21:14495:x1876025593174400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117738.857158:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+21:14495:x1876025593174400:12345-0@lo:502:llog_process_th.0 Request processed in 114us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117738.857166:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1789117738.857361:0:14495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e14f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14495:1876025593174400:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789117738.857385:0:14495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117738.857390:0:14495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117738.857391:0:14495:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789117738.857395:0:14495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:1.0:1789117738.857542:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-18 (rc=0) 10000000:01000000:1.0:1789117738.857565:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789117738.857577:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1fc83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fc8a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117738.857587:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1fc83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fc8a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117738.857597:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789117738.857599:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962bbf4b3000 from 13 10000000:01000000:1.0:1789117738.857602:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789117738.857628:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70d600/0xaa253ed19be1fc91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117738.857636:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962bbf70d600/0xaa253ed19be1fc91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117738.857645:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962bbf70d600/0xaa253ed19be1fc91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117738.857666:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593174528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789117738.857696:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117738.857727:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf751240 going to sleep for 11 seconds 00000100:00100000:3.0:1789117738.857954:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593174528 00000100:00100000:3.0:1789117738.857960:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593174528 00000100:00100000:3.0:1789117738.858004:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1789117738.858014:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90434050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+21:6517:x1876025593174528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117738.858024:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117738.858038:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d93400/0xaa253ed19be1fc98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1fc91 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117738.858091:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d93400/0xaa253ed19be1fc98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1fc91 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117738.858102:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d93400/0xaa253ed19be1fc98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fc91 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117738.858131:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93400, rc 0) 00000100:00100000:3.0:1789117738.858170:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90434050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593174528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117738.858176:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1789117738.858310:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593174528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117738.858323:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962bbf70d600/0xaa253ed19be1fc91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fc98 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117738.858332:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962bbf70d600/0xaa253ed19be1fc91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1fc98 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117738.858406:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593174656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117738.858433:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117738.858572:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf751240 going to sleep for 11 seconds 00000100:00100000:0.0:1789117738.858656:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593174656 00000100:00100000:0.0:1789117738.858660:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593174656 00000100:00100000:0.0:1789117738.858686:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1789117738.858693:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90436450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593174656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117738.858794:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90436450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593174656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117738.858801:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1789117738.859687:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593174656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117738.859730:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593174784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117738.859792:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117738.859819:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf751240 going to sleep for 11 seconds 00000100:00100000:3.0:1789117738.859942:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593174784 00000100:00100000:3.0:1789117738.859947:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593174784 00000100:00100000:3.0:1789117738.859989:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:3.0:1789117738.859997:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90436050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593174784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117738.860197:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90436050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593174784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 201us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117738.860205:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1789117738.860945:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593174784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117738.862759:0:14496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14496:1876025593174912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117738.862863:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117738.862921:0:14496:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf751000 going to sleep for 11 seconds 00000100:00100000:0.0:1789117738.862976:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593174912 00000100:00100000:0.0:1789117738.862983:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593174912 00000100:00100000:0.0:1789117738.863035:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1789117738.863046:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90434c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+22:14496:x1876025593174912:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117738.863294:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90434c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+22:14496:x1876025593174912:12345-0@lo:502:llog_process_th.0 Request processed in 249us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117738.863303:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1789117738.871224:0:14496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14496:1876025593174912:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789117738.871270:0:14496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789117738.871288:0:14496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117738.871291:0:14496:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789117738.871299:0:14496:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962bbf4b3000 00000020:00000080:1.0:1789117738.871302:0:14496:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789117738.871377:0:14496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117738.871380:0:14496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117738.871382:0:14496:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789117738.871384:0:14496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789117738.871387:0:14496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117738.871388:0:14496:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789117738.871391:0:14496:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962bbf4b3000 00000020:00000080:1.0:1789117738.871393:0:14496:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789117738.871456:0:14496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14496:1876025593175040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117738.871573:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117738.871616:0:14496:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf751000 going to sleep for 11 seconds 00000100:00100000:3.0:1789117738.871775:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593175040 00000100:00100000:3.0:1789117738.871782:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593175040 00000100:00100000:3.0:1789117738.871854:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:3.0:1789117738.871864:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+22:14496:x1876025593175040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117738.871990:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+22:14496:x1876025593175040:12345-0@lo:502:llog_process_th.0 Request processed in 127us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117738.871998:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:1.0:1789117738.872293:0:14496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14496:1876025593175040:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789117738.872318:0:14496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117738.872326:0:14496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117738.872327:0:14496:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789117738.872332:0:14496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:3.0:1789117738.872652:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-18 (rc=0) 10000000:01000000:3.0:1789117738.872673:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789117738.872684:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70d600/0xaa253ed19be1fc91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fc98 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117738.872696:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962bbf70d600/0xaa253ed19be1fc91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fc98 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117738.872722:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789117738.872725:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962bbcf27000 from 13 10000000:01000000:3.0:1789117738.872728:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789117738.872776:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d92400/0xaa253ed19be1fc9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117738.872784:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a87d92400/0xaa253ed19be1fc9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117738.872794:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a87d92400/0xaa253ed19be1fc9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117738.872818:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593175168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789117738.872863:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117738.872900:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8e9e1840 going to sleep for 11 seconds 00000100:00100000:1.0:1789117738.872981:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593175168 00000100:00100000:1.0:1789117738.872985:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593175168 00000100:00100000:1.0:1789117738.873026:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:1.0:1789117738.873034:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+22:6517:x1876025593175168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117738.873044:0:9525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117738.873092:0:9525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbf70d000/0xaa253ed19be1fca6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1fc9f expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117738.873236:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbf70d000/0xaa253ed19be1fca6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1fc9f expref: 23 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117738.873260:0:9525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbf70d000/0xaa253ed19be1fca6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fc9f expref: 23 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117738.873270:0:9525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70d000, rc 0) 00000100:00100000:1.0:1789117738.873314:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593175168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 280us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117738.873321:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:3.0:1789117738.873444:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593175168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117738.873467:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a87d92400/0xaa253ed19be1fc9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fca6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117738.873478:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a87d92400/0xaa253ed19be1fc9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1fca6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117738.873536:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593175296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117738.873561:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117738.873581:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8e9e1840 going to sleep for 11 seconds 00000100:00100000:3.0:1789117738.873595:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593175296 00000100:00100000:3.0:1789117738.873598:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593175296 00000100:00100000:3.0:1789117738.873632:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1789117738.873638:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90437c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593175296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117738.873762:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90437c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593175296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117738.873783:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1789117738.873811:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593175296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117738.873837:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593175424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117738.873873:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117738.873885:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8e9e1840 going to sleep for 11 seconds 00000100:00100000:3.0:1789117738.873896:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593175424 00000100:00100000:3.0:1789117738.873899:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593175424 00000100:00100000:3.0:1789117738.873917:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:3.0:1789117738.873923:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90437050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593175424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117738.873988:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90437050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593175424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117738.873996:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:3.0:1789117738.874027:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593175424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117738.874783:0:14498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14498:1876025593175552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117738.874844:0:14498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117738.874872:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593175552 00000100:00100000:3.0:1789117738.874876:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593175552 00000100:00100000:3.0:1789117738.874903:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:3.0:1789117738.874909:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:14498:x1876025593175552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117738.874984:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:14498:x1876025593175552:12345-0@lo:502:llog_process_th.0 Request processed in 74us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117738.874997:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:3.0:1789117738.875028:0:14498:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8e9e10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117738.875040:0:14498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14498:1876025593175552:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789117738.875087:0:14498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117738.875099:0:14498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117738.875101:0:14498:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789117738.875583:0:14498:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962bbcf27000 00000020:00000080:3.0:1789117738.875589:0:14498:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789117738.875655:0:14498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117738.875658:0:14498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117738.875660:0:14498:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789117738.875663:0:14498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117738.875665:0:14498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117738.875667:0:14498:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789117738.875671:0:14498:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962bbcf27000 00000020:00000080:3.0:1789117738.875673:0:14498:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789117738.875708:0:14498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14498:1876025593175680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117738.875745:0:14498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117738.875783:0:14498:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8e9e10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117738.877085:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593175680 00000100:00100000:1.0:1789117738.877097:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593175680 00000100:00100000:1.0:1789117738.877160:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1789117738.877169:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90434850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:14498:x1876025593175680:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117738.877320:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90434850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7945443b-b7e4-4157-aee9-c9b2172613e6+23:14498:x1876025593175680:12345-0@lo:502:llog_process_th.0 Request processed in 151us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117738.877327:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1789117738.878242:0:14498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14498:1876025593175680:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789117738.878277:0:14498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117738.878284:0:14498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117738.878287:0:14498:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789117738.878292:0:14498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:3.0:1789117738.879576:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-18 (rc=0) 10000000:01000000:3.0:1789117738.879608:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789117738.879623:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d92400/0xaa253ed19be1fc9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fca6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117738.879639:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a87d92400/0xaa253ed19be1fc9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fca6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117738.879653:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789117738.879656:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962b9832f800 from 13 10000000:01000000:3.0:1789117738.879671:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789117738.879726:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d93a00/0xaa253ed19be1fcad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117738.879737:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a87d93a00/0xaa253ed19be1fcad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117738.879749:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a87d93a00/0xaa253ed19be1fcad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117738.879791:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593175808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789117738.879869:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117738.879913:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8e9e1600 going to sleep for 11 seconds 00000100:00100000:3.0:1789117738.879983:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593175808 00000100:00100000:3.0:1789117738.879990:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593175808 00000100:00100000:3.0:1789117738.880048:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:3.0:1789117738.880083:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+23:6517:x1876025593175808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117738.880099:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117738.882257:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d92800/0xaa253ed19be1fcb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be1fcad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117738.882301:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d92800/0xaa253ed19be1fcb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be1fcad expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117738.882313:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d92800/0xaa253ed19be1fcb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be1fcad expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117738.882323:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92800, rc 0) 00000100:00100000:3.0:1789117738.883551:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593175808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3463us (3674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117738.883572:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:0.0:1789117738.884003:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593175808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117738.884027:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a87d93a00/0xaa253ed19be1fcad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fcb4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117738.884039:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a87d93a00/0xaa253ed19be1fcad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1fcb4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117738.884168:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e14f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593175936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117738.884242:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117738.884272:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c1e240 going to sleep for 11 seconds 00000100:00100000:3.0:1789117738.884743:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593175936 00000100:00100000:3.0:1789117738.884750:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593175936 00000100:00100000:3.0:1789117738.884814:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:3.0:1789117738.884824:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593175936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117738.884965:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593175936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117738.884972:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:2.0:1789117738.885074:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e14f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593175936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117738.885128:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b989cf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593176064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117738.885193:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117738.885216:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86dcef00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117738.885371:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593176064 00000100:00100000:3.0:1789117738.885378:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593176064 00000100:00100000:3.0:1789117738.885412:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:3.0:1789117738.885419:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593176064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117738.886288:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:6517:x1876025593176064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 866us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117738.886297:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:2.0:1789117738.886616:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b989cf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7945443b-b7e4-4157-aee9-c9b2172613e6:6517:1876025593176064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117738.887123:0:14500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b989cf0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14500:1876025593176192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117738.887194:0:14500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117738.887238:0:14500:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf612240 going to sleep for 11 seconds 00000100:00100000:3.0:1789117738.887600:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593176192 00000100:00100000:3.0:1789117738.887609:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593176192 00000100:00100000:3.0:1789117738.887662:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1789117738.887672:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:14500:x1876025593176192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117738.887815:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:14500:x1876025593176192:12345-0@lo:502:llog_process_th.0 Request processed in 144us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117738.887823:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:0.0:1789117738.887914:0:14500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b989cf0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14500:1876025593176192:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789117738.887940:0:14500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117738.887949:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117738.887951:0:14500:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789117738.887958:0:14500:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962b9832f800 00000020:00000080:0.0:1789117738.887961:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789117738.888024:0:14500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117738.888028:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117738.888030:0:14500:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789117738.888032:0:14500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117738.888035:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117738.888036:0:14500:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789117738.888040:0:14500:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962b9832f800 00000020:00000080:0.0:1789117738.888042:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789117738.888105:0:14500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e14f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14500:1876025593176320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117738.888594:0:14500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117738.889963:0:14500:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c1e240 going to sleep for 11 seconds 00000100:00100000:2.0:1789117738.897746:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593176320 00000100:00100000:2.0:1789117738.897774:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593176320 00000100:00100000:2.0:1789117738.897871:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:2.0:1789117738.897885:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b83ada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:14500:x1876025593176320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117738.898123:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b83ada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:14500:x1876025593176320:12345-0@lo:502:llog_process_th.0 Request processed in 241us (9528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117738.898131:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:2.0:1789117738.898228:0:14500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e14f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7945443b-b7e4-4157-aee9-c9b2172613e6:14500:1876025593176320:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789117738.898266:0:14500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117738.898277:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117738.898280:0:14500:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789117738.898290:0:14500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:3.0:1789117738.900396:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-18 (rc=0) 10000000:01000000:3.0:1789117738.900435:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789117738.900446:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d93a00/0xaa253ed19be1fcad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fcb4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117738.900482:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a87d93a00/0xaa253ed19be1fcad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fcb4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789117738.905598:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789117738.927982:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789117738.981566:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117739.880792:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593176448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789117739.880822:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593176576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117739.882341:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117739.882576:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593176448 00000100:00100000:0.0:1789117739.882586:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593176448 00000100:00080000:1.0:1789117739.882650:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117739.882671:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789117739.882683:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593176448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789117739.882717:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117739.882797:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593176448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117739.882805:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:2.0:1789117739.884231:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87faa940 x1876025593176448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117739.884257:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593176448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789117739.892780:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117739.892870:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593176576 00000100:00100000:1.0:1789117739.892883:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593176576 00000100:00100000:1.0:1789117739.892995:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789117739.893008:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593176576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789117739.893048:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117739.893166:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593176576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117739.893175:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:3.0:1789117739.893371:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e14f00 x1876025593176576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117739.893392:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593176576:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789117739.893478:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1789117739.941760:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789117739.942686:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789117740.005423:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117740.389804:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593176832:0@lo:400:kworker.0 00000100:00100000:2.0:1789117740.389827:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593176960:0@lo:400:kworker.0 00000100:00100000:2.0:1789117740.389910:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117740.389980:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593177472:0@lo:400:kworker.0 00000100:00100000:2.0:1789117740.390091:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117740.390119:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593177984:0@lo:400:kworker.0 00000100:00100000:2.0:1789117740.390153:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117740.390157:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593176704:0@lo:400:kworker.0 00000100:00100000:2.0:1789117740.390180:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789117740.390186:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593177088:0@lo:400:kworker.0 00000100:00100000:3.0:1789117740.390193:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117740.390204:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117740.390216:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593177216:0@lo:400:kworker.0 00000100:00100000:2.0:1789117740.390216:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593177600:0@lo:400:kworker.0 00000100:00100000:3.0:1789117740.390236:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117740.390236:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117740.390625:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b989cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593178112:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117740.390664:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593177984 00000100:00100000:2.0:1789117740.390673:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593177984 00000100:00100000:2.0:1789117740.390916:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789117740.390928:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1876025593177984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117740.390988:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1876025593177984:12345-0@lo:400:kworker.0 Request processed in 62us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117740.390996:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1789117740.391026:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117740.391091:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593176704 00000100:00100000:2.0:1789117740.391096:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593176704 00000100:00100000:2.0:1789117740.391122:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:2.0:1789117740.391127:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b904e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593176704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117740.391157:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b904e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593176704:12345-0@lo:400:kworker.0 Request processed in 29us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117740.391162:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:2.0:1789117740.391200:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593177472 00000100:00100000:2.0:1789117740.391204:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593177472 00000100:00100000:2.0:1789117740.397786:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593177088 00000100:00100000:2.0:1789117740.398275:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593177088 00000100:00100000:2.0:1789117740.398345:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593177600 00000100:00100000:2.0:1789117740.398365:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593177600 00000100:00100000:2.0:1789117740.398400:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1789117740.398412:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593177472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117740.398527:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593177472:12345-0@lo:400:kworker.0 Request processed in 118us (8435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117740.398535:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1789117740.398555:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789117740.398562:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593177088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117740.398592:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593177088:12345-0@lo:400:kworker.0 Request processed in 31us (8387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117740.398599:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789117740.398624:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1789117740.398631:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593177600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117740.398659:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593177600:12345-0@lo:400:kworker.0 Request processed in 29us (8422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117740.398664:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:2.0:1789117740.398690:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789117740.398694:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789117740.400632:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593177728:0@lo:400:kworker.0 00000100:00100000:3.0:1789117740.400704:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117740.400768:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593176704:0@lo:400:kworker.0 00000100:00100000:3.0:1789117740.400819:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593177728 00000100:00100000:3.0:1789117740.400826:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593177728 00000100:00100000:3.0:1789117740.400908:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1789117740.400919:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593177728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117740.400984:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593177728:12345-0@lo:400:kworker.0 Request processed in 66us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117740.401012:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00080000:3.0:1789117740.401045:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789117740.401088:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbfd15a40 x1876025593177728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117740.401102:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593177728:0@lo:400:kworker.0 00000100:00100000:2.0:1789117740.401373:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117740.405895:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593176960 00000100:00100000:0.0:1789117740.405931:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593176960 00000100:00100000:0.0:1789117740.405988:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593177216 00000100:00100000:0.0:1789117740.405991:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593177216 00000100:00100000:0.0:1789117740.406014:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789117740.406024:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593176960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117740.406138:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593176960:12345-0@lo:400:kworker.0 Request processed in 115us (16227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117740.406146:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789117740.406164:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789117740.406171:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593177216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117740.406208:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593177216:12345-0@lo:400:kworker.0 Request processed in 38us (15971us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117740.406215:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789117740.406300:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117740.406332:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593176832 00000100:00100000:0.0:1789117740.406336:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593176832 00000100:00100000:0.0:1789117740.406366:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789117740.406373:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593176832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117740.406431:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593176832:12345-0@lo:400:kworker.0 Request processed in 51us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117740.406438:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789117740.406478:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593176832:0@lo:400:kworker.0 00000100:00100000:0.0:1789117740.406491:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593177344:0@lo:400:kworker.0 00000100:00100000:0.0:1789117740.406519:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117740.406539:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88626580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593177856:0@lo:400:kworker.0 00000100:00100000:0.0:1789117740.406566:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117740.406600:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593177856 00000100:00100000:0.0:1789117740.406603:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593177856 00000100:00100000:0.0:1789117740.406638:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789117740.406645:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88418f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593177856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117740.406676:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88418f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593177856:12345-0@lo:400:kworker.0 Request processed in 32us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117740.406682:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789117740.406710:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88626580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593177856:0@lo:400:kworker.0 00000100:00100000:0.0:1789117740.406769:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593177344 00000100:00100000:0.0:1789117740.406773:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593177344 00000100:00100000:0.0:1789117740.406801:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1789117740.406807:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8841bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593177344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117740.406842:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8841bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593177344:12345-0@lo:400:kworker.0 Request processed in 34us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117740.406848:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:3.0:1789117740.406999:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789117740.407005:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789117740.407037:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593177216:0@lo:400:kworker.0 00000100:00100000:1.0:1789117740.407137:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593177344:0@lo:400:kworker.0 00000100:00100000:2.0:1789117740.412918:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593176960:0@lo:400:kworker.0 00010000:00080000:2.0:1789117740.412942:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbfa86580 x1876025593177472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117740.412953:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593177472:0@lo:400:kworker.0 00000100:00100000:2.0:1789117740.412968:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593177984:0@lo:400:kworker.0 00000100:00100000:2.0:1789117740.413000:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593177088:0@lo:400:kworker.0 00000100:00100000:2.0:1789117740.413033:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593177600:0@lo:400:kworker.0 00000100:00100000:1.0:1789117740.413246:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593178112 00000100:00100000:1.0:1789117740.413254:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593178112 00000100:00100000:1.0:1789117740.413320:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789117740.413329:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593178112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789117740.413374:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789117740.413755:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593178112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 426us (12381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117740.413764:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789117740.413924:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b989cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593178112:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117740.901800:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789117740.901824:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8841a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593178240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789117740.901905:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117740.902028:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593178240 00000100:00100000:0.0:1789117740.902037:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593178240 00000100:00100000:0.0:1789117740.902107:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789117740.902116:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a886252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593178240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789117740.902150:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117740.902202:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a886252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593178240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117740.902209:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789117740.903789:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8841a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593178240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117740.904001:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117740.904017:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593178368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117740.904120:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117740.904428:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593178368 00000100:00100000:1.0:1789117740.904435:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593178368 00000100:00100000:1.0:1789117740.904496:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789117740.904506:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876025593178368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789117740.904530:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117740.904571:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876025593178368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117740.904578:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789117740.904660:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593178368:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789117741.030694:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117741.926389:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117741.926436:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117741.926475:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117741.926497:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117741.926529:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117741.926551:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117741.926574:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572101248 00000100:00100000:0.0:1789117741.926583:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572101248 00000100:00100000:0.0:1789117741.926636:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572101504 00000100:00100000:0.0:1789117741.926638:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572101504 00000100:00100000:0.0:1789117741.926650:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572101120 00000100:00100000:0.0:1789117741.926652:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572101120 00000100:00100000:0.0:1789117741.926664:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572101632 00000100:00100000:0.0:1789117741.926667:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572101632 00000100:00100000:0.0:1789117741.926681:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 305 00000100:00100000:0.0:1789117741.926690:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8841a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572101248:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117741.926806:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8841a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572101248:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 117us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117741.926814:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 305 00000100:00100000:0.0:1789117741.926832:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 306 00000100:00100000:0.0:1789117741.926838:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572101504:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117741.926862:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572101504:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 25us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117741.926868:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 306 00000100:00100000:0.0:1789117741.926880:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 307 00000100:00100000:0.0:1789117741.926885:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572101120:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117741.926908:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572101120:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 23us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117741.926913:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 307 00000100:00100000:0.0:1789117741.926925:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 308 00000100:00100000:0.0:1789117741.926939:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572101632:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117741.926963:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572101632:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 25us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117741.926968:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 308 00000100:00100000:2.0:1789117741.927166:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572101376 00000100:00100000:2.0:1789117741.927171:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572101376 00000100:00100000:2.0:1789117741.927202:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 112 00000100:00100000:2.0:1789117741.927208:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572101376:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117741.927233:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572101376:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 26us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117741.927239:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 112 00000100:00100000:3.0:1789117741.927602:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572100992 00000100:00100000:3.0:1789117741.927606:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572100992 00000100:00100000:3.0:1789117741.927649:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 445 00000100:00100000:3.0:1789117741.927656:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b904eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572100992:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117741.927688:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b904eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572100992:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 34us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117741.927695:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 445 00000100:00080000:3.0:1789117741.927846:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789117741.927852:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789117741.927854:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:1.0:1789117741.932665:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000004:00080000:3.0:1789117741.933280:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:1.0:1789117742.055298:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117742.954627:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593178496:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789117742.954713:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117742.954960:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593178496 00000100:00100000:1.0:1789117742.954968:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593178496 00000100:00100000:1.0:1789117742.955026:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789117742.955036:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593178496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789117742.955099:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789117742.955147:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593178496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117742.955154:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789117742.955367:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593178496:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789117743.077898:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117744.101534:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117744.997832:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593178624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117744.997926:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117744.997938:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789117744.997955:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88626580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593178752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789117744.997995:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117744.998031:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593178624 00000100:00100000:2.0:1789117744.998039:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593178624 00000100:00100000:1.0:1789117744.998043:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593178752 00000100:00100000:1.0:1789117744.998049:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593178752 00000100:00100000:1.0:1789117744.998116:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789117744.998126:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88627c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593178752:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789117744.998153:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789117744.998157:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1789117744.998243:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88626580 x1876025593178752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117760 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117744.998263:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88626580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593178752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789117744.998435:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88627c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593178752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 309us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117744.998443:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789117744.998462:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789117744.998471:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593178624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789117744.998482:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117744.998526:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593178624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117744.998532:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:0.0:1789117744.998602:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf6ff0c0 x1876025593178624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117760 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117744.998617:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593178624:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789117745.125489:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117745.509425:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593179136:0@lo:400:kworker.0 00000100:00100000:0.0:1789117745.509516:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117745.509591:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876025593179648:0@lo:400:kworker.0 00000100:00100000:0.0:1789117745.509620:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117745.509650:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88626580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593178880:0@lo:400:kworker.0 00000100:00100000:0.0:1789117745.509662:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8121f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593180160:0@lo:400:kworker.0 00000100:00100000:2.0:1789117745.509699:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117745.509713:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117745.509732:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593179392:0@lo:400:kworker.0 00000100:00100000:0.0:1789117745.509753:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789117745.509762:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593179008:0@lo:400:kworker.0 00000100:00100000:2.0:1789117745.509776:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117745.509795:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117745.509799:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593179904:0@lo:400:kworker.0 00000100:00100000:0.0:1789117745.509822:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593179520:0@lo:400:kworker.0 00000100:00100000:2.0:1789117745.509830:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117745.509851:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789117745.509857:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593179264:0@lo:400:kworker.0 00000100:00100000:1.0:1789117745.509923:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593179648 00000100:00100000:1.0:1789117745.509931:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593179648 00000100:00100000:1.0:1789117745.510423:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593179008 00000100:00100000:1.0:1789117745.510435:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593179008 00000100:00100000:1.0:1789117745.510455:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593179904 00000100:00100000:1.0:1789117745.510458:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593179904 00000100:00100000:1.0:1789117745.510477:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1789117745.510486:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876025593179648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117745.510614:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593179136 00000100:00100000:3.0:1789117745.510619:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593179136 00000100:00100000:3.0:1789117745.510652:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593179392 00000100:00100000:3.0:1789117745.510655:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593179392 00000100:00100000:3.0:1789117745.510671:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789117745.510677:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593179136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117745.511546:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117745.511718:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8121c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593180032:0@lo:400:kworker.0 00000100:00100000:0.0:1789117745.511841:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117745.511922:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593179520 00000100:00100000:0.0:1789117745.511928:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593179520 00000100:00100000:0.0:1789117745.511962:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789117745.511971:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593179008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117745.512016:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593179008:12345-0@lo:400:kworker.0 Request processed in 47us (2221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117745.512023:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789117745.512039:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789117745.512046:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593179904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117745.514042:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876025593179648:12345-0@lo:400:kworker.0 Request processed in 3547us (4411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117745.514070:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1789117745.514108:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1789117745.514121:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593179520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117745.514226:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593179136:12345-0@lo:400:kworker.0 Request processed in 3547us (4708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117745.514235:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789117745.514256:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789117745.514264:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593179392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117745.514308:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593179392:12345-0@lo:400:kworker.0 Request processed in 46us (4532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117745.514315:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789117745.514398:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593180288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789117745.514436:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789117745.514473:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789117745.514480:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789117745.514514:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593180288 00000100:00100000:3.0:1789117745.514521:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593180288 00000100:00100000:3.0:1789117745.514546:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789117745.514552:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593180288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789117745.514611:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789117745.514660:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593180288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117745.514679:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789117745.514722:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593180288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789117745.514766:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593178880 00000100:00100000:3.0:1789117745.514770:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593178880 00000100:00100000:3.0:1789117745.514803:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1789117745.514810:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b904eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593178880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117745.514843:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b904eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593178880:12345-0@lo:400:kworker.0 Request processed in 34us (5145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117745.514850:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1789117745.514903:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593180160 00000100:00100000:3.0:1789117745.514907:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593180160 00000100:00100000:3.0:1789117745.514939:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593180032 00000100:00100000:3.0:1789117745.514942:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593180032 00000100:00100000:3.0:1789117745.514963:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789117745.514968:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593180160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117745.515000:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593180160:12345-0@lo:400:kworker.0 Request processed in 32us (5289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117745.515006:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789117745.515017:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789117745.515023:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593180032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117745.515050:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593180032:12345-0@lo:400:kworker.0 Request processed in 27us (3209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117745.515079:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1789117745.515101:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789117745.515286:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593179008:0@lo:400:kworker.0 00000100:00100000:3.0:1789117745.515313:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8121c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593180032:0@lo:400:kworker.0 00000100:00100000:3.0:1789117745.515325:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593179136:0@lo:400:kworker.0 00010000:00080000:3.0:1789117745.515338:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a4bc00 x1876025593179648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117745.515348:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876025593179648:0@lo:400:kworker.0 00000100:00100000:3.0:1789117745.515358:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1789117745.515363:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff962a88626940, transno 4294967301 00000100:00100000:3.0:1789117745.515375:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8121f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593180160:0@lo:400:kworker.0 00000100:00100000:1.0:1789117745.515917:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593179520:12345-0@lo:400:kworker.0 Request processed in 1799us (4372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117745.515925:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1789117745.516098:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593179520:0@lo:400:kworker.0 00000100:00100000:0.0:1789117745.516556:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593179904:12345-0@lo:400:kworker.0 Request processed in 4508us (6723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117745.516565:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1789117745.519325:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117745.519444:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593179776:0@lo:400:kworker.0 00000100:00100000:2.0:1789117745.519525:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117745.519592:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88626580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593178880:0@lo:400:kworker.0 00000100:00100000:2.0:1789117745.519629:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593179392:0@lo:400:kworker.0 00010000:00080000:2.0:1789117745.519657:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a48780 x1876025593179904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117745.519669:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593179904:0@lo:400:kworker.0 00000100:00100000:3.0:1789117745.520193:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593179264 00000100:00100000:3.0:1789117745.520201:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593179264 00000100:00100000:3.0:1789117745.520289:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593179776 00000100:00100000:3.0:1789117745.520293:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593179776 00000100:00100000:3.0:1789117745.520338:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1789117745.520346:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593179264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117745.520422:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593179264:12345-0@lo:400:kworker.0 Request processed in 75us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117745.520429:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1789117745.520444:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1789117745.520450:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88564b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593179776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117745.520477:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88564b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593179776:12345-0@lo:400:kworker.0 Request processed in 27us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117745.520482:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00080000:2.0:1789117745.521222:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117745.521269:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593179264:0@lo:400:kworker.0 00000100:00100000:2.0:1789117745.521281:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593179776:0@lo:400:kworker.0 00000100:00100000:2.0:1789117746.021618:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593180416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789117746.021770:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117746.021963:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8121e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593180544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117746.022377:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117746.025167:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593180416 00000100:00100000:0.0:1789117746.025188:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593180416 00000100:00100000:0.0:1789117746.025325:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593180544 00000100:00100000:0.0:1789117746.025329:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593180544 00000100:00100000:0.0:1789117746.025349:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789117746.025359:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88567480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593180416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789117746.025395:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117746.025483:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88567480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593180416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (3714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117746.025492:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789117746.025509:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789117746.025515:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593180544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789117746.025526:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117746.025568:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593180544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (3191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117746.025574:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789117746.026263:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593180416:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117746.026670:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8121e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593180544:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789117746.149609:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117747.039993:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117747.040337:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117747.040390:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117747.040437:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572102144 00000100:00100000:1.0:1789117747.040449:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572102144 00000100:00100000:1.0:1789117747.040537:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 115 00000100:00080000:2.0:1789117747.040544:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789117747.040549:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88626940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2405:x1876025572102144:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117747.040652:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88626940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2405:x1876025572102144:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 106us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117747.040661:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 115 00000100:00100000:0.0:1789117747.044038:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572101888 00000100:00100000:0.0:1789117747.044074:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572101888 00000100:00080000:1.0:1789117747.044205:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117747.044330:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572102400 00000100:00100000:2.0:1789117747.044335:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572102400 00000100:00100000:2.0:1789117747.044408:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 315 00000100:00100000:2.0:1789117747.044420:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88626580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2405:x1876025572101888:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117747.044523:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88626580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2405:x1876025572101888:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 106us (4866us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117747.044530:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 315 00000100:00100000:2.0:1789117747.044548:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 316 00000100:00100000:2.0:1789117747.044555:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572102400:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117747.044582:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572102400:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 28us (4192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117747.044606:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 316 00000100:00080000:1.0:1789117747.044820:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789117747.046040:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117747.046106:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117747.046130:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117747.046314:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572102016 00000100:00100000:1.0:1789117747.046323:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572102016 00000100:00100000:1.0:1789117747.046388:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572102272 00000100:00100000:1.0:1789117747.046391:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572102272 00000100:00100000:1.0:1789117747.046414:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 317 00000100:00100000:1.0:1789117747.046436:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2405:x1876025572102016:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117747.046499:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2405:x1876025572102016:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 65us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117747.046506:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 317 00000100:00100000:1.0:1789117747.046523:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 318 00000100:00100000:1.0:1789117747.046530:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572102272:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117747.046572:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572102272:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 43us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117747.046579:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 318 00000100:00080000:1.0:1789117747.046596:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789117747.046599:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789117747.046787:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572101760 00000100:00100000:2.0:1789117747.046793:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572101760 00000100:00100000:2.0:1789117747.046828:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 447 00000100:00100000:2.0:1789117747.046835:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b904e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2405:x1876025572101760:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117747.046864:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b904e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2405:x1876025572101760:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 30us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117747.046871:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 447 00010000:00010000:1.0:1789117747.173292:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117748.071847:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117748.071879:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593180672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789117748.071999:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117748.072813:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593180672 00000100:00100000:2.0:1789117748.072823:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593180672 00000100:00100000:2.0:1789117748.072882:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789117748.072894:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8121fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593180672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789117748.072935:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789117748.073091:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8121fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593180672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 199us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117748.073099:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789117748.074555:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593180672:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789117748.197464:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789117749.157950:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789117749.157953:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789117749.221348:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117750.118323:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8121d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593180928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789117750.118410:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117750.118491:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789117750.118499:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593180800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117750.118523:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117750.118622:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593180928 00000100:00100000:1.0:1789117750.118629:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593180928 00000100:00100000:1.0:1789117750.118699:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593180800 00000100:00100000:1.0:1789117750.118702:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593180800 00000100:00100000:1.0:1789117750.118723:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789117750.118731:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88564f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593180928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789117750.118761:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117750.118825:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88564f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593180928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117750.118832:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789117750.118848:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789117750.118853:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593180800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789117750.118863:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117750.118885:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593180800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 32us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117750.118891:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00080000:1.0:1789117750.118932:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf8d8000 x1876025593180800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117766 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117750.118950:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593180800:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1789117750.118960:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b8121d2c0 x1876025593180928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117766 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117750.118971:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8121d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593180928:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789117750.119121:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789117750.247421:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117750.629380:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593181184:0@lo:400:kworker.0 00000100:00100000:3.0:1789117750.629464:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117750.629524:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593181312:0@lo:400:kworker.0 00000100:00100000:3.0:1789117750.629569:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593181696:0@lo:400:kworker.0 00000100:00100000:3.0:1789117750.629598:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117750.629630:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593182208:0@lo:400:kworker.0 00000100:00100000:0.0:1789117750.629630:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117750.629666:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593181824:0@lo:400:kworker.0 00000100:00100000:3.0:1789117750.629674:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117750.629702:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117750.629704:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789117750.629714:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593181056:0@lo:400:kworker.0 00000100:00100000:0.0:1789117750.629725:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593182336:0@lo:400:kworker.0 00000100:00100000:2.0:1789117750.629837:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593181184 00000100:00100000:2.0:1789117750.629844:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593181184 00000100:00100000:2.0:1789117750.629890:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593181696 00000100:00100000:2.0:1789117750.629907:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593181696 00000100:00100000:2.0:1789117750.629936:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593181824 00000100:00100000:2.0:1789117750.629939:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593181824 00000100:00100000:2.0:1789117750.629957:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789117750.629966:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593181184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117750.630092:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1789117750.630103:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593181696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117750.639144:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117750.639226:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789117750.639241:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593181440:0@lo:400:kworker.0 00000100:00100000:0.0:1789117750.639284:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117750.639304:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593181952:0@lo:400:kworker.0 00000100:00100000:0.0:1789117750.639326:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117750.639342:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593182464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117750.639368:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117750.639410:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593181312 00000100:00100000:0.0:1789117750.639418:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593181312 00000100:00100000:0.0:1789117750.639456:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593182464 00000100:00100000:0.0:1789117750.639459:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593182464 00000100:00100000:0.0:1789117750.639473:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789117750.639481:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1876025593181312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117750.639536:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1876025593181312:12345-0@lo:400:kworker.0 Request processed in 56us (9908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117750.639565:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789117750.639583:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789117750.639588:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593182464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789117750.639613:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789117750.639646:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593182464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117750.639652:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789117750.639670:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593181440 00000100:00100000:0.0:1789117750.639673:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593181440 00000100:00100000:0.0:1789117750.639693:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593181952 00000100:00100000:0.0:1789117750.639695:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593181952 00000100:00100000:0.0:1789117750.639712:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789117750.639719:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593181824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117750.639755:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593181824:12345-0@lo:400:kworker.0 Request processed in 37us (10054us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117750.639762:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789117750.640984:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1789117750.641014:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593181440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117750.641122:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593181440:12345-0@lo:400:kworker.0 Request processed in 124us (1836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117750.641129:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1789117750.641164:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1789117750.641171:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593181952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117750.641206:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593181952:12345-0@lo:400:kworker.0 Request processed in 37us (1879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117750.641232:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1789117750.641295:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593181440:0@lo:400:kworker.0 00000100:00100000:0.0:1789117750.641307:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593181952:0@lo:400:kworker.0 00000100:00100000:0.0:1789117750.641330:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593182464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117750.641343:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593181312:0@lo:400:kworker.0 00010000:00080000:0.0:1789117750.641361:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf8d8780 x1876025593181824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117750.641375:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593181824:0@lo:400:kworker.0 00000100:00080000:0.0:1789117750.641490:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789117750.641497:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117750.641624:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593182208 00000100:00100000:0.0:1789117750.641631:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593182208 00000100:00100000:0.0:1789117750.641685:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593182336 00000100:00100000:0.0:1789117750.641688:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593182336 00000100:00100000:0.0:1789117750.641712:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789117750.641719:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593182208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117750.641760:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593182208:12345-0@lo:400:kworker.0 Request processed in 41us (12088us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117750.641766:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789117750.642767:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117750.642825:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593181568:0@lo:400:kworker.0 00000100:00100000:3.0:1789117750.642882:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117750.642907:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876025593182080:0@lo:400:kworker.0 00000100:00100000:3.0:1789117750.642936:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117750.642975:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593182208:0@lo:400:kworker.0 00000100:00100000:3.0:1789117750.643017:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789117750.643030:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593182336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117750.643127:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593182336:12345-0@lo:400:kworker.0 Request processed in 101us (3991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117750.643134:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789117750.643159:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593181056 00000100:00100000:3.0:1789117750.643163:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593181056 00000100:00100000:3.0:1789117750.643193:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1789117750.643200:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3647:x1876025593181056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117750.643233:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3647:x1876025593181056:12345-0@lo:400:kworker.0 Request processed in 34us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117750.643239:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1789117750.643270:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593181568 00000100:00100000:3.0:1789117750.643273:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593181568 00000100:00100000:3.0:1789117750.643303:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789117750.643310:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593181568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117750.643342:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593181568:12345-0@lo:400:kworker.0 Request processed in 34us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117750.643348:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789117750.643365:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593182080 00000100:00100000:3.0:1789117750.643368:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593182080 00000100:00100000:3.0:1789117750.643394:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1789117750.643399:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876025593182080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117750.643429:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876025593182080:12345-0@lo:400:kworker.0 Request processed in 29us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117750.643435:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1789117750.643467:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593182336:0@lo:400:kworker.0 00000100:00100000:3.0:1789117750.643506:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593181056:0@lo:400:kworker.0 00000100:00100000:3.0:1789117750.643525:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593181568:0@lo:400:kworker.0 00000100:00080000:0.0:1789117750.644142:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789117750.644150:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789117750.645719:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf8d9a40 x1876025593182080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117750.645737:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876025593182080:0@lo:400:kworker.0 00000100:00100000:2.0:1789117750.646510:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593181184:12345-0@lo:400:kworker.0 Request processed in 16541us (17041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117750.646523:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789117750.649727:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593181184:0@lo:400:kworker.0 00000100:00100000:1.0:1789117750.655038:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593181696:12345-0@lo:400:kworker.0 Request processed in 24927us (25428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117750.655071:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1789117750.658872:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593181696:0@lo:400:kworker.0 00000100:00100000:3.0:1789117751.141789:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789117751.141816:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8121d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593182592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117751.141889:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117751.142089:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593182592 00000100:00100000:1.0:1789117751.142097:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593182592 00000100:00100000:1.0:1789117751.142156:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789117751.142167:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593182592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789117751.142216:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117751.142267:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593182592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117751.142274:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789117751.142371:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8121d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593182592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117751.142609:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593182720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117751.142639:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117751.142796:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593182720 00000100:00100000:1.0:1789117751.142801:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593182720 00000100:00100000:1.0:1789117751.142834:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789117751.142842:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593182720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789117751.142854:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117751.142897:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593182720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117751.142904:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789117751.143007:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593182720:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789117751.270394:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117752.161125:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117752.161169:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117752.161207:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117752.161307:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572102528 00000100:00100000:3.0:1789117752.161318:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572102528 00000100:00100000:3.0:1789117752.161380:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 449 00000100:00100000:3.0:1789117752.161392:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2404:x1876025572102528:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117752.161466:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2404:x1876025572102528:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 77us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117752.161473:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 449 00000100:00100000:0.0:1789117752.161929:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572102784 00000100:00100000:0.0:1789117752.161937:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572102784 00000100:00100000:0.0:1789117752.161990:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572102656 00000100:00100000:0.0:1789117752.162002:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572102656 00000100:00100000:0.0:1789117752.162045:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 325 00000100:00100000:0.0:1789117752.162082:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88567840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2404:x1876025572102784:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117752.162133:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88567840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2404:x1876025572102784:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 81us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117752.162140:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 325 00000100:00100000:0.0:1789117752.162155:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 326 00000100:00100000:0.0:1789117752.162161:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88566580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2404:x1876025572102656:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117752.162191:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88566580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2404:x1876025572102656:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 30us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117752.162198:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 326 00000100:00080000:3.0:1789117752.162271:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789117752.162276:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789117752.185423:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117752.185473:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117752.185510:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572103168 00000100:00100000:1.0:1789117752.185531:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572103168 00000100:00100000:2.0:1789117752.185560:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117752.185592:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572103040 00000100:00100000:1.0:1789117752.185597:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572103040 00000100:00100000:3.0:1789117752.185658:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572102912 00000100:00100000:1.0:1789117752.185663:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 327 00000100:00100000:3.0:1789117752.185665:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572102912 00000100:00100000:1.0:1789117752.185676:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572103040:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117752.185722:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00100000:3.0:1789117752.185733:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2403:x1876025572102912:12345-192.168.204.30@tcp:9:kworker.0 00000020:00000080:3.0:1789117752.185763:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1fbdb 00000100:00100000:1.0:1789117752.185773:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572103040:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 99us (212us total) trans 0 rc 0/0 00000100:00080000:3.0:1789117752.185777:0:8433:0:(import.c:65:import_set_state_nolock()) ffff962a87fd9800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789117752.185783:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 327 00010000:00010000:1.0:1789117752.185810:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1789117752.185840:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:1.0:1789117752.185921:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 328 00000100:00100000:1.0:1789117752.185929:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88567c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+5:2404:x1876025572103168:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117752.185967:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88567c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+5:2404:x1876025572103168:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 39us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117752.185993:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 328 00000100:00100000:3.0:1789117752.186029:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+2:2403:x1876025572102912:12345-192.168.204.30@tcp:9:kworker.0 Request processed in 297us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117752.186038:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00080000:0.0:1789117752.186393:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789117752.186399:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789117752.186402:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789117752.296443:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117753.192634:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593182848:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789117753.192717:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117753.195933:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593182848 00000100:00100000:1.0:1789117753.196125:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593182848 00000100:00100000:1.0:1789117753.196285:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789117753.196297:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593182848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789117753.196340:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789117753.198720:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593182848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2414us (5991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117753.198822:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789117753.205506:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593182848:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789117753.321245:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117754.341342:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117755.237469:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117755.237512:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8121e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593182976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789117755.237635:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117755.238161:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593182976 00000100:00100000:1.0:1789117755.238175:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593182976 00000100:00100000:1.0:1789117755.238270:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789117755.238285:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593182976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789117755.238333:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117755.238417:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593182976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 136us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117755.238426:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1789117755.238502:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789117755.238544:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b8121e1c0 x1876025593182976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117771 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117755.238571:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8121e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593182976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789117755.239449:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593183104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117755.239533:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117755.239929:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593183104 00000100:00100000:1.0:1789117755.239940:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593183104 00000100:00080000:3.0:1789117755.240103:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789117755.240159:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789117755.240172:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593183104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789117755.240201:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117755.240271:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593183104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117755.240279:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00010000:00080000:3.0:1789117755.241148:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf8df840 x1876025593183104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117771 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117755.241173:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593183104:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789117755.368207:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117755.749480:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593183360:0@lo:400:kworker.0 00000100:00100000:0.0:1789117755.749583:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593183488:0@lo:400:kworker.0 00000100:00100000:3.0:1789117755.749610:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117755.749635:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117755.749686:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593184000:0@lo:400:kworker.0 00000100:00100000:3.0:1789117755.749697:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593183872:0@lo:400:kworker.0 00000100:00100000:0.0:1789117755.749717:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117755.749734:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117755.749740:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593184512:0@lo:400:kworker.0 00000100:00100000:3.0:1789117755.749766:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593184384:0@lo:400:kworker.0 00000100:00100000:0.0:1789117755.749773:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117755.749801:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117755.749827:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593183488 00000100:00100000:0.0:1789117755.749837:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593183488 00000100:00100000:0.0:1789117755.749900:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789117755.749911:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593183488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117755.750434:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593183488:12345-0@lo:400:kworker.0 Request processed in 522us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117755.750469:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789117755.750523:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593183488:0@lo:400:kworker.0 00000100:00100000:0.0:1789117755.750579:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593183616:0@lo:400:kworker.0 00000100:00100000:0.0:1789117755.750611:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117755.750624:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593184128:0@lo:400:kworker.0 00000100:00100000:0.0:1789117755.750648:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117755.750666:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593184640:0@lo:400:kworker.0 00000100:00100000:0.0:1789117755.750688:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117755.750708:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789117755.750714:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593183232:0@lo:400:kworker.0 00000100:00100000:0.0:1789117755.750743:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117755.750768:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593183744:0@lo:400:kworker.0 00000100:00100000:0.0:1789117755.750791:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117755.750804:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593184256:0@lo:400:kworker.0 00000100:00100000:3.0:1789117755.750974:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88567480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593184896:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789117755.751010:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117755.751010:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593183360 00000100:00100000:2.0:1789117755.751018:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593183360 00000100:00100000:3.0:1789117755.751046:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593183232 00000100:00100000:3.0:1789117755.751051:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593183232 00000100:00100000:2.0:1789117755.751081:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593184000 00000100:00100000:2.0:1789117755.751087:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593184000 00000100:00100000:3.0:1789117755.751106:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1789117755.751117:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3646:x1876025593183232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117755.751120:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593183872 00000100:00100000:2.0:1789117755.751125:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593183872 00000100:00100000:2.0:1789117755.751157:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593184512 00000100:00100000:2.0:1789117755.751161:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593184512 00000100:00100000:3.0:1789117755.751162:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3646:x1876025593183232:12345-0@lo:400:kworker.0 Request processed in 46us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117755.751172:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:2.0:1789117755.751178:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593184384 00000100:00100000:2.0:1789117755.751182:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593184384 00000100:00100000:2.0:1789117755.751199:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593183616 00000100:00100000:2.0:1789117755.751202:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593183616 00000100:00100000:2.0:1789117755.751219:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789117755.751225:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593183360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117755.751273:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593183360:12345-0@lo:400:kworker.0 Request processed in 49us (1666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117755.751280:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789117755.751294:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789117755.751299:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593184000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117755.751331:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593184000:12345-0@lo:400:kworker.0 Request processed in 33us (1615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117755.751337:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789117755.751348:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789117755.751354:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593183872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117755.751380:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593183872:12345-0@lo:400:kworker.0 Request processed in 27us (1648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117755.751385:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789117755.751396:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1789117755.751402:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593184512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117755.751427:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593184512:12345-0@lo:400:kworker.0 Request processed in 26us (1658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117755.751432:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1789117755.751442:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789117755.751468:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593184384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117755.751496:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593184384:12345-0@lo:400:kworker.0 Request processed in 30us (1695us total) trans 0 rc 0/0 00000100:00080000:3.0:1789117755.751501:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117755.751504:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00080000:3.0:1789117755.751508:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789117755.751520:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789117755.751528:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593183616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117755.751553:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593183872:0@lo:400:kworker.0 00000100:00100000:2.0:1789117755.751560:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593183616:12345-0@lo:400:kworker.0 Request processed in 31us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117755.751567:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1789117755.751573:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593184384:0@lo:400:kworker.0 00000100:00100000:3.0:1789117755.751587:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593183360:0@lo:400:kworker.0 00010000:00080000:2.0:1789117755.751607:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf8dd680 x1876025593184000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117755.751621:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593184000:0@lo:400:kworker.0 00010000:00080000:2.0:1789117755.751639:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf8df840 x1876025593184512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117755.751649:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593184512:0@lo:400:kworker.0 00000100:00100000:2.0:1789117755.751693:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593184128 00000100:00100000:2.0:1789117755.751696:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593184128 00000100:00100000:2.0:1789117755.751730:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593184640 00000100:00100000:2.0:1789117755.751734:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593184640 00000100:00100000:3.0:1789117755.751739:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789117755.751750:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8db840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593184128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117755.751766:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789117755.751775:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593184640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117755.751794:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8db840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593184128:12345-0@lo:400:kworker.0 Request processed in 46us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117755.751802:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789117755.751829:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593184640:12345-0@lo:400:kworker.0 Request processed in 43us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117755.751837:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:3.0:1789117755.751847:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789117755.751932:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593183744 00000100:00100000:3.0:1789117755.751936:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593183744 00000100:00100000:3.0:1789117755.751955:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593184896 00000100:00100000:3.0:1789117755.751957:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593184896 00000100:00100000:3.0:1789117755.751970:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789117755.751978:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593183744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117755.752604:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593183744:12345-0@lo:400:kworker.0 Request processed in 626us (1811us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117755.752612:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789117755.752633:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789117755.752642:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593184896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789117755.752675:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789117755.752726:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593184896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (1716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117755.752733:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789117755.753135:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117755.753184:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593184768:0@lo:400:kworker.0 00000100:00100000:0.0:1789117755.753215:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117755.753260:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593183616:0@lo:400:kworker.0 00010000:00080000:0.0:1789117755.753275:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf8dda40 x1876025593184128/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117755.753286:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593184128:0@lo:400:kworker.0 00000100:00100000:0.0:1789117755.753298:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593184640:0@lo:400:kworker.0 00000100:00100000:2.0:1789117755.753618:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593184256 00000100:00100000:2.0:1789117755.753633:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593184256 00000100:00100000:1.0:1789117755.753968:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88567480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593184896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117755.754142:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593184768 00000100:00100000:2.0:1789117755.754147:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593184768 00000100:00100000:3.0:1789117755.755331:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789117755.755360:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8d8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593184256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117755.755635:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8d8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593184256:12345-0@lo:400:kworker.0 Request processed in 288us (2500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117755.755644:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789117755.755669:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789117755.755677:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593184768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117755.755711:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593184768:12345-0@lo:400:kworker.0 Request processed in 35us (2495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117755.755717:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:3.0:1789117755.755766:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789117755.757190:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593183232:0@lo:400:kworker.0 00000100:00100000:0.0:1789117755.757216:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593183744:0@lo:400:kworker.0 00010000:00080000:0.0:1789117755.758527:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf8ded00 x1876025593184256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117755.758547:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593184256:0@lo:400:kworker.0 00000100:00100000:0.0:1789117755.758566:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593184768:0@lo:400:kworker.0 00000100:00100000:3.0:1789117756.263643:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117756.263674:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8121f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593185024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117756.263765:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117756.264423:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593185024 00000100:00100000:1.0:1789117756.264445:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593185024 00000100:00100000:1.0:1789117756.264511:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789117756.264538:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593185024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789117756.264812:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117756.264901:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593185024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 364us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117756.264911:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789117756.265102:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8121f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593185024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117756.266843:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593185152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117756.266935:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117756.267206:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593185152 00000100:00100000:2.0:1789117756.267216:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593185152 00000100:00100000:2.0:1789117756.267295:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789117756.267308:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593185152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789117756.267346:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117756.267403:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593185152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117756.267411:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789117756.269371:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593185152:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789117756.389457:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117757.282013:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117757.282109:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572103296 00000100:00100000:3.0:1789117757.282122:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117757.282123:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572103296 00000100:00100000:3.0:1789117757.282154:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117757.282178:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117757.282199:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 451 00000100:00100000:3.0:1789117757.282206:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117757.282214:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572103296:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117757.282318:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572103296:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 108us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117757.282328:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 451 00000100:00100000:3.0:1789117757.282591:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572103552 00000100:00100000:3.0:1789117757.282596:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572103552 00000100:00100000:1.0:1789117757.282600:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572103808 00000100:00100000:1.0:1789117757.282607:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572103808 00000100:00100000:3.0:1789117757.282659:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572103424 00000100:00100000:3.0:1789117757.282662:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572103424 00000100:00100000:2.0:1789117757.282719:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572103680 00000100:00100000:2.0:1789117757.282724:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572103680 00000100:00080000:0.0:1789117757.285200:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789117757.285212:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789117757.285283:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 335 00000100:00100000:0.0:1789117757.285302:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572103552:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117757.285430:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572103552:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 124us (3296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117757.285439:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 335 00000100:00100000:1.0:1789117757.286617:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 336 00000100:00100000:1.0:1789117757.286636:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572103808:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117757.286728:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572103808:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 99us (4573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117757.286735:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 336 00000100:00100000:3.0:1789117757.287521:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 337 00000100:00100000:3.0:1789117757.287535:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572103424:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117757.287599:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572103424:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 67us (5420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117757.287606:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 337 00000100:00100000:2.0:1789117757.294408:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 338 00000100:00100000:2.0:1789117757.294444:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87faa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572103680:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117757.294572:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87faa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572103680:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 138us (12365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117757.294580:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 338 00010000:00010000:1.0:1789117757.417395:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789117757.815051:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35e670b1-2cce-4394-8cb4-d5255c6a6a93 00000020:00000080:0.0:1789117757.815100:0:9514:0:(genops.c:885:class_export_put()) final put ffff962a87fdb000/35e670b1-2cce-4394-8cb4-d5255c6a6a93 00000020:00000080:3.0:1789117757.815602:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962a87fdb000/35e670b1-2cce-4394-8cb4-d5255c6a6a93 for lustre-OST0001 00000020:00000080:3.0:1789117757.815682:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a87fd9800 for lustre-OST0001 00000100:00100000:3.0:1789117758.310686:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593185280:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789117758.310803:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117758.311824:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593185280 00000100:00100000:2.0:1789117758.311842:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593185280 00000100:00100000:2.0:1789117758.311931:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789117758.311943:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87faad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593185280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789117758.311996:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789117758.312281:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87faad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593185280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 340us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117758.312291:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789117758.312471:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593185280:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789117758.438224:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789117759.397897:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789117759.402572:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789117759.464121:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117760.358183:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789117760.358203:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593185408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117760.358279:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117760.358347:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593185408 00000100:00100000:3.0:1789117760.358354:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593185408 00000100:00100000:3.0:1789117760.358420:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789117760.358431:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86809e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593185408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789117760.358467:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117760.358512:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86809e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593185408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117760.358520:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1789117760.358540:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789117760.358571:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f45e00 x1876025593185408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117776 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117760.358590:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593185408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117760.358988:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8121da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593185536:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789117760.359019:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117760.359394:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593185536 00000100:00100000:1.0:1789117760.359401:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593185536 00000100:00100000:1.0:1789117760.359455:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789117760.359464:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593185536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789117760.359480:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117760.359520:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593185536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117760.359526:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1789117760.360007:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789117760.360034:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b8121da40 x1876025593185536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117776 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117760.360050:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8121da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593185536:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789117760.486181:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117760.874509:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593185664:0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.874604:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117760.874668:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593186176:0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.874700:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117760.874721:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593186688:0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.874744:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117760.874760:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593187200:0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.874779:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117760.874804:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1789117760.874810:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593185792:0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.874835:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117760.874852:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593186304:0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.874873:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117760.874887:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593186816:0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.874907:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117760.874924:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88564f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593187328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117760.874946:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117760.874974:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593185920:0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.875000:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117760.875010:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593186432:0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.875033:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117760.875050:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593186944:0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.875097:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117760.875115:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789117760.875135:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593186048:0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.875160:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117760.875171:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593186560:0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.875192:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117760.875209:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593187072:0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.875231:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117760.875256:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593186688 00000100:00100000:2.0:1789117760.875263:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593186688 00000100:00100000:2.0:1789117760.875310:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593187200 00000100:00100000:2.0:1789117760.875312:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593187200 00000100:00100000:2.0:1789117760.875335:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593186560 00000100:00100000:2.0:1789117760.875337:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593186560 00000100:00100000:2.0:1789117760.875347:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593187072 00000100:00100000:2.0:1789117760.875370:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593187072 00000100:00100000:2.0:1789117760.875390:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789117760.875399:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593186688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.875454:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593186688:12345-0@lo:400:kworker.0 Request processed in 56us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117760.875462:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789117760.875479:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789117760.875485:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88564780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593187200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.875512:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88564780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593187200:12345-0@lo:400:kworker.0 Request processed in 27us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117760.875518:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789117760.875529:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789117760.875534:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593186560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.875562:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593186560:12345-0@lo:400:kworker.0 Request processed in 29us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117760.875575:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789117760.875587:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789117760.875593:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593187072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.875621:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593187072:12345-0@lo:400:kworker.0 Request processed in 28us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117760.875626:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789117760.875644:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593185792 00000100:00100000:2.0:1789117760.875647:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593185792 00000100:00100000:2.0:1789117760.875666:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593186304 00000100:00100000:2.0:1789117760.875668:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593186304 00000100:00100000:2.0:1789117760.875680:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593186816 00000100:00100000:2.0:1789117760.875683:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593186816 00000100:00100000:2.0:1789117760.875693:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593186432 00000100:00100000:2.0:1789117760.875694:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593186432 00000100:00100000:2.0:1789117760.875705:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593186944 00000100:00100000:2.0:1789117760.875707:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593186944 00000100:00100000:2.0:1789117760.875718:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593186048 00000100:00100000:2.0:1789117760.875720:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593186048 00000100:00100000:2.0:1789117760.875732:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789117760.875739:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88565680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593185792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.875771:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88565680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593185792:12345-0@lo:400:kworker.0 Request processed in 33us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117760.875777:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789117760.875789:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1789117760.875794:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88565a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593186304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.875819:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88565a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593186304:12345-0@lo:400:kworker.0 Request processed in 25us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117760.875825:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1789117760.875843:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789117760.875850:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88566d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593186816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.875879:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88566d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593186816:12345-0@lo:400:kworker.0 Request processed in 31us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117760.875884:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789117760.875894:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1789117760.875899:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593186432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.875921:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593186432:12345-0@lo:400:kworker.0 Request processed in 23us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117760.875926:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1789117760.875935:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1789117760.875940:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593186944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.875965:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593186944:12345-0@lo:400:kworker.0 Request processed in 24us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117760.875969:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1789117760.875980:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1789117760.875986:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593186048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.876012:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593186048:12345-0@lo:400:kworker.0 Request processed in 26us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117760.876017:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1789117760.876036:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593186176 00000100:00100000:2.0:1789117760.876040:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593186176 00000100:00100000:2.0:1789117760.876085:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593187328 00000100:00100000:2.0:1789117760.876088:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593187328 00000100:00100000:2.0:1789117760.876099:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593185920 00000100:00100000:2.0:1789117760.876101:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593185920 00000100:00100000:2.0:1789117760.876110:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789117760.876123:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593186176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.876157:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593186176:12345-0@lo:400:kworker.0 Request processed in 35us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117760.876163:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789117760.876175:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789117760.876181:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88565e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1876025593187328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789117760.876207:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789117760.876235:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88565e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1876025593187328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117760.876240:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789117760.876251:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789117760.876258:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88566940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593185920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.876287:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88566940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593185920:12345-0@lo:400:kworker.0 Request processed in 29us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117760.876293:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789117760.876335:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593185792:0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.876361:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593186304:0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.876373:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593186816:0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.876387:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88564f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593187328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117760.876397:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593186176:0@lo:400:kworker.0 00010000:00080000:2.0:1789117760.876411:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf8de1c0 x1876025593186688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117760.876422:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593186688:0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.876443:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593187200:0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.876489:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593186048:0@lo:400:kworker.0 00010000:00080000:2.0:1789117760.876500:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf8dda40 x1876025593186560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117760.876509:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593186560:0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.876519:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593187072:0@lo:400:kworker.0 00000100:00100000:2.0:1789117760.876528:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593185920:0@lo:400:kworker.0 00010000:00080000:2.0:1789117760.876536:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf8dc000 x1876025593186432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117760.876545:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593186432:0@lo:400:kworker.0 00010000:00080000:2.0:1789117760.876555:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf8dd680 x1876025593186944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117760.876562:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593186944:0@lo:400:kworker.0 00000100:00080000:3.0:1789117760.876923:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789117760.876928:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789117760.876931:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789117760.877175:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593185664 00000100:00100000:0.0:1789117760.877181:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593185664 00000100:00100000:0.0:1789117760.877223:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:0.0:1789117760.877232:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3646:x1876025593185664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117760.877282:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3646:x1876025593185664:12345-0@lo:400:kworker.0 Request processed in 51us (2679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117760.877289:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:2.0:1789117760.879786:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593185664:0@lo:400:kworker.0 00000100:00100000:0.0:1789117761.381658:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593187456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789117761.381755:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117761.382309:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789117761.382322:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8121de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593187584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117761.382374:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117761.382469:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593187456 00000100:00100000:1.0:1789117761.382478:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593187456 00000100:00100000:1.0:1789117761.382531:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593187584 00000100:00100000:1.0:1789117761.382535:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593187584 00000100:00100000:1.0:1789117761.382562:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789117761.382572:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593187456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789117761.382624:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117761.382684:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593187456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117761.382692:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789117761.382709:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789117761.382716:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593187584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789117761.382727:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117761.382752:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593187584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117761.382757:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789117761.382796:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8121de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593187584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117761.382812:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593187456:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789117761.512865:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117762.400622:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117762.400665:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117762.400701:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117762.400724:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117762.400752:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117762.400779:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572104064 00000100:00100000:1.0:1789117762.400792:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572104064 00000100:00100000:1.0:1789117762.400859:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572104320 00000100:00100000:1.0:1789117762.400863:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572104320 00000100:00100000:1.0:1789117762.400878:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572104192 00000100:00100000:1.0:1789117762.400880:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572104192 00000100:00100000:1.0:1789117762.400894:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572104448 00000100:00100000:1.0:1789117762.400897:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572104448 00000100:00100000:1.0:1789117762.400943:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 345 00000100:00100000:1.0:1789117762.400952:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8121e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572104064:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117762.401050:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8121e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572104064:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 98us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117762.401446:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 346 00000100:00100000:3.0:1789117762.401463:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8121cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572104320:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117762.401497:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8121cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572104320:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 38us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117762.401505:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 346 00000100:00100000:3.0:1789117762.401528:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 347 00000100:00100000:3.0:1789117762.401534:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8121f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572104192:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117762.401559:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8121f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572104192:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 25us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117762.401565:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 347 00000100:00100000:3.0:1789117762.401577:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 348 00000100:00100000:3.0:1789117762.401583:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8121cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572104448:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117762.401603:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8121cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572104448:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 20us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117762.401609:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 348 00000100:00080000:3.0:1789117762.401630:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789117762.401634:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117762.402289:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572103936 00000100:00100000:0.0:1789117762.402298:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572103936 00000100:00100000:0.0:1789117762.402351:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 453 00000100:00100000:0.0:1789117762.402359:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572103936:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117762.402412:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572103936:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 54us (1710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117762.402419:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 453 00000100:00100000:1.0:1789117762.402568:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 345 00010000:00010000:1.0:1789117762.533915:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117763.442737:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789117763.442764:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593187712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789117763.442835:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117763.443634:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593187712 00000100:00100000:0.0:1789117763.443647:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593187712 00000100:00100000:0.0:1789117763.445630:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789117763.445652:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593187712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789117763.445696:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789117763.445797:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593187712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 152us (2959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117763.445818:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789117763.445950:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593187712:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789117763.557330:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117764.584414:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789117765.102590:0:14765:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 05:09:24 (1789117764) 00000100:00100000:2.0:1789117765.477494:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8680b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593187840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117765.477572:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117765.477614:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8121c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593187968:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789117765.477644:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117765.477687:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593187840 00000100:00100000:2.0:1789117765.477696:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593187840 00000100:00100000:3.0:1789117765.477801:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593187968 00000100:00100000:3.0:1789117765.477806:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593187968 00000100:00100000:2.0:1789117765.478000:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789117765.478027:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88564f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593187840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789117765.478086:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117765.478135:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88564f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593187840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117765.478143:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00010000:00080000:2.0:1789117765.478199:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a8680b0c0 x1876025593187840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117765.478218:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8680b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593187840:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789117765.484383:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789117765.484885:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789117765.484900:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8121de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593187968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789117765.484930:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117765.485021:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8121de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593187968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (7375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117765.485041:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00010000:00080000:0.0:1789117765.485246:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b8121c3c0 x1876025593187968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117765.485279:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8121c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593187968:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789117765.605337:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117765.989520:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789117765.989544:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593188096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117765.989629:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117765.992085:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593188096 00000100:00100000:3.0:1789117765.992100:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593188096 00000100:00100000:3.0:1789117765.992181:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789117765.992193:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8121ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593188096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789117765.992231:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789117765.992324:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8121ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593188096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (2693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117765.992331:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789117765.992922:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593188096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117765.994653:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593188224:0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.994727:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117765.994778:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789117765.994785:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593188352:0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.994813:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117765.994897:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593188224 00000100:00100000:1.0:1789117765.994905:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593188224 00000100:00100000:1.0:1789117765.994955:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:1.0:1789117765.994964:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae41f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3646:x1876025593188224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117765.995013:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae41f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3646:x1876025593188224:12345-0@lo:400:kworker.0 Request processed in 51us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117765.995020:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1789117765.995111:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593188224:0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.995390:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593188608:0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.995421:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117765.995456:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593189120:0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.995482:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117765.995504:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593189632:0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.995527:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117765.995561:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789117765.995568:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593188480:0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.995593:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117765.995609:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593188992:0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.995632:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117765.995663:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593189504:0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.995687:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117765.995715:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593189120 00000100:00100000:0.0:1789117765.995719:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593189120 00000100:00100000:0.0:1789117765.995743:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593189632 00000100:00100000:0.0:1789117765.995747:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593189632 00000100:00100000:0.0:1789117765.995767:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593188992 00000100:00100000:0.0:1789117765.995770:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593188992 00000100:00100000:0.0:1789117765.995781:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593189504 00000100:00100000:0.0:1789117765.995783:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593189504 00000100:00100000:0.0:1789117765.995800:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789117765.995807:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593189120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.995848:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593189120:12345-0@lo:400:kworker.0 Request processed in 41us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117765.995855:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789117765.995869:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789117765.995875:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593189632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.995903:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593189632:12345-0@lo:400:kworker.0 Request processed in 28us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117765.995908:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789117765.995921:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789117765.995927:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593188992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.995953:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593188992:12345-0@lo:400:kworker.0 Request processed in 26us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117765.995958:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789117765.995969:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789117765.995974:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593189504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.996010:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593189504:12345-0@lo:400:kworker.0 Request processed in 36us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117765.996016:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789117765.996039:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a878883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593188736:0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.996086:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117765.996104:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593189248:0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.996129:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117765.996146:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789117765.996152:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593188864:0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.996191:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117765.996208:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593189376:0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.996230:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117765.996249:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593188352 00000100:00100000:0.0:1789117765.996265:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593188352 00000100:00100000:0.0:1789117765.996286:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593188480 00000100:00100000:0.0:1789117765.996289:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593188480 00000100:00100000:0.0:1789117765.996298:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593188736 00000100:00100000:0.0:1789117765.996300:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593188736 00000100:00100000:0.0:1789117765.996312:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593189248 00000100:00100000:0.0:1789117765.996315:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593189248 00000100:00100000:0.0:1789117765.996327:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593188864 00000100:00100000:0.0:1789117765.996330:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593188864 00000100:00100000:0.0:1789117765.996345:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593189376 00000100:00100000:0.0:1789117765.996348:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593189376 00000100:00100000:0.0:1789117765.996363:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789117765.996369:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593188352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.996407:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593188352:12345-0@lo:400:kworker.0 Request processed in 38us (1593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117765.996423:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789117765.996437:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789117765.996443:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593188480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.996475:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593188480:12345-0@lo:400:kworker.0 Request processed in 32us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117765.996481:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789117765.996494:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1789117765.996501:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593188736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.996527:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593188736:12345-0@lo:400:kworker.0 Request processed in 27us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117765.996533:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1789117765.996546:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1789117765.996552:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593189248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.996581:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593189248:12345-0@lo:400:kworker.0 Request processed in 29us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117765.996586:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1789117765.996598:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1789117765.996603:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593188864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.996628:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593188864:12345-0@lo:400:kworker.0 Request processed in 25us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117765.996634:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1789117765.996645:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1789117765.996651:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593189376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.996678:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593189376:12345-0@lo:400:kworker.0 Request processed in 27us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117765.996690:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1789117765.996727:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593188480:0@lo:400:kworker.0 00010000:00080000:0.0:1789117765.996741:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7dcf00 x1876025593188992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117765.996752:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593188992:0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.996764:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593189504:0@lo:400:kworker.0 00010000:00080000:0.0:1789117765.996774:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a74f00 x1876025593189120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117765.996783:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593189120:0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.996793:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593189632:0@lo:400:kworker.0 00010000:00080000:0.0:1789117765.996835:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7dd680 x1876025593188864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117765.996844:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593188864:0@lo:400:kworker.0 00010000:00080000:0.0:1789117765.996853:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f72940 x1876025593189376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117765.996860:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593189376:0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.996869:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a878883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593188736:0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.996878:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593189248:0@lo:400:kworker.0 00000100:00100000:0.0:1789117765.996887:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593188352:0@lo:400:kworker.0 00000100:00080000:1.0:1789117765.997264:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789117765.997269:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789117765.997272:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117765.997340:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593188608 00000100:00100000:2.0:1789117765.997347:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593188608 00000100:00100000:2.0:1789117765.997392:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789117765.997400:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593188608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117765.997465:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593188608:12345-0@lo:400:kworker.0 Request processed in 67us (2043us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117765.997472:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789117765.998364:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593188608:0@lo:400:kworker.0 00000100:00100000:3.0:1789117766.505810:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a878883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593189888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117766.505896:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117766.506003:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789117766.506010:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8121c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593189760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117766.506050:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117766.506345:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593189888 00000100:00100000:1.0:1789117766.506354:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593189888 00000100:00100000:1.0:1789117766.506418:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593189760 00000100:00100000:1.0:1789117766.506422:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593189760 00000100:00100000:1.0:1789117766.506440:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789117766.506448:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86808780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593189888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789117766.506479:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117766.506527:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86808780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593189888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117766.506534:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789117766.506550:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789117766.506556:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593189760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789117766.506567:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117766.506593:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593189760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117766.506599:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789117766.511173:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8121c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593189760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117766.511195:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a878883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593189888:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789117766.629405:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117767.523272:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117767.523460:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117767.523499:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117767.523557:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572104576 00000100:00100000:2.0:1789117767.523567:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572104576 00000100:00100000:2.0:1789117767.523629:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 455 00000100:00100000:2.0:1789117767.523640:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572104576:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117767.523710:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572104576:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 72us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117767.523718:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 455 00000100:00100000:1.0:1789117767.532159:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117767.535113:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572104704 00000100:00100000:0.0:1789117767.535127:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572104704 00000100:00100000:0.0:1789117767.535210:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572104960 00000100:00100000:0.0:1789117767.535213:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572104960 00000100:00100000:0.0:1789117767.535258:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 355 00000100:00100000:0.0:1789117767.535267:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8121da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572104704:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117767.535651:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8121da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572104704:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 384us (12389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117767.535660:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 355 00000100:00100000:0.0:1789117767.535681:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 356 00000100:00100000:0.0:1789117767.535689:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8121d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2406:x1876025572104960:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117767.535714:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8121d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2406:x1876025572104960:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 26us (12214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117767.535720:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 356 00000100:00080000:0.0:1789117767.535794:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117767.537788:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117767.537875:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572104832 00000100:00100000:2.0:1789117767.537883:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572104832 00000100:00100000:2.0:1789117767.537947:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572105088 00000100:00100000:2.0:1789117767.538033:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572105088 00000100:00100000:2.0:1789117767.538078:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 357 00000100:00100000:2.0:1789117767.538087:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8121f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572104832:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117767.538236:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8121f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572104832:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 138us (6076us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117767.538583:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 358 00000100:00100000:0.0:1789117767.538595:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8121e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572105088:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117767.538628:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8121e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572105088:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 38us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117767.538635:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 358 00000100:00100000:2.0:1789117767.538697:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 357 00000100:00080000:1.0:1789117767.538778:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789117767.555454:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117767.555752:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572105216 00000100:00100000:0.0:1789117767.555763:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572105216 00000100:00100000:0.0:1789117767.555839:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 40 00000100:00100000:0.0:1789117767.555850:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:11343:x1876025572105216:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789117767.555872:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117767.555970:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be1fcbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ee2d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.556039:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fcc2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.556091:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fcc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.556106:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fcc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117767.556157:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789117767.556161:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789117767.556207:0:6519:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fcc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.556249:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be1fcbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee2d expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.556280:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fcc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee2d expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.556288:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b832c8700) 00010000:00010000:0.0:1789117767.556291:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789117767.556294:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813db800, rc 0) 00000100:00100000:0.0:1789117767.556363:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:11343:x1876025572105216:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 514us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117767.556370:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 40 00000100:00100000:3.0:1789117767.572439:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117767.573524:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572105344 00000100:00100000:0.0:1789117767.573556:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572105344 00000100:00100000:0.0:1789117767.573636:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 41 00000100:00100000:0.0:1789117767.573647:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:11344:x1876025572105344:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789117767.573677:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117767.573698:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be1fcc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ee34 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.573781:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be1fcd0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.573796:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be1fcd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.573807:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be1fcd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.573822:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fcd7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.573828:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fcd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.573835:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fcd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.573902:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fcde lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.573912:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fcde lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.573919:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fcde lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117767.573968:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789117767.573973:0:14247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789117767.573995:0:14247:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fcde lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.574005:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be1fcd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.574012:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be1fcd0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.574019:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be1fcd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.574025:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117767.574029:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be1fcd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.574037:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be1fcd0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.574049:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b832c8700) 00010000:00010000:0.0:1789117767.574051:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117767.574095:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be1fcd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.574102:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be1fcd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.574114:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fcd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.574129:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fcd7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.574134:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fcd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.574139:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dbe00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117767.574143:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fcd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.574148:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fcd7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.574161:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff962b832c8100) 00010000:00010000:0.0:1789117767.574164:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117767.574167:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fcd7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.574172:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fcd7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.574204:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be1fcc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee34 expref: 8 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.574219:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fcde lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee34 expref: 7 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117767.574237:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff962b832c8f00) 00010000:00010000:0.0:1789117767.574239:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789117767.574247:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813db200, rc 0) 00000100:00100000:2.0:1789117767.574719:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:11344:x1876025572105344:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 1071us (2287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117767.574729:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 41 00000100:00100000:1.0:1789117767.588585:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117767.588991:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572105472 00000100:00100000:2.0:1789117767.589002:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572105472 00000100:00100000:2.0:1789117767.589115:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:2.0:1789117767.589126:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8121d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:11344:x1876025572105472:12345-192.168.204.30@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789117767.589210:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8121d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:11344:x1876025572105472:12345-192.168.204.30@tcp:900:lhsmtool_posix.0 Request processed in 86us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117767.589219:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:0.0:1789117767.592160:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117767.592291:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572105728 00000100:00100000:3.0:1789117767.592301:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572105728 00000100:00100000:3.0:1789117767.592353:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 42 00000100:00100000:3.0:1789117767.592364:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a878883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:11344:x1876025572105728:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789117767.592384:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117767.592418:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1fce5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ee3b expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117767.592507:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fcec lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117767.592521:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fcec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117767.592534:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fcec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117767.592551:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be1fcf3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117767.592559:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be1fcf3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117767.592566:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be1fcf3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117767.592673:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be1fcfa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117767.592683:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be1fcfa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117767.592689:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be1fcfa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117767.592713:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789117767.592998:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fcec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117767.593006:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fcec lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117767.593019:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fcec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117767.593026:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117767.593029:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fcec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117767.593037:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fcec lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117767.593048:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff962b832c8f00) 00010000:00010000:3.0:1789117767.593474:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117767.593480:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fcec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117767.593487:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fcec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117767.593503:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be1fcf3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117767.593510:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be1fcf3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117767.593515:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be1fcf3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117767.593519:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117767.593522:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be1fcf3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117767.593540:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be1fcf3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117767.593549:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff962bbe7ec900) 00010000:00010000:3.0:1789117767.593551:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117767.593555:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be1fcf3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117767.593561:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be1fcf3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117767.599825:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1fce5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee3b expref: 10 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117767.599854:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be1fcfa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee3b expref: 9 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117767.599864:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff962bbe7ec500) 00010000:00010000:3.0:1789117767.599867:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117767.599870:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92c00, rc 0) 00000100:00100000:3.0:1789117767.599947:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a878883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:11344:x1876025572105728:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 7584us (7795us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789117767.599957:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 42 00000100:00100000:3.0:1789117767.628634:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117767.629563:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572105856 00000100:00100000:2.0:1789117767.629579:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572105856 00000100:00100000:2.0:1789117767.629678:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 43 00000100:00100000:2.0:1789117767.629690:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:11344:x1876025572105856:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789117767.629841:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:11344:x1876025572105856:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 Request processed in 153us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117767.629850:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 43 00000100:00100000:1.0:1789117767.635562:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117767.635832:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572105984 00000100:00100000:3.0:1789117767.635845:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572105984 00000100:00100000:3.0:1789117767.636017:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 44 00000100:00100000:3.0:1789117767.636029:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8121e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:11344:x1876025572105984:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1789117767.638542:0:6521:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2401us 00010000:00010000:1.0:1789117767.663083:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117767.670073:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8121e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:11344:x1876025572105984:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 Request processed in 34009us (34489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117767.670092:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 44 00000100:00100000:3.0:1789117768.549285:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789117768.549310:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593190016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789117768.549385:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117768.549503:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593190016 00000100:00100000:0.0:1789117768.549511:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593190016 00000100:00100000:0.0:1789117768.549575:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789117768.549584:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593190016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789117768.549619:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789117768.549665:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593190016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117768.549672:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789117768.549761:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593190016:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1789117768.617568:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789117768.620035:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789117768.686333:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789117769.638436:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789117769.639266:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789117769.704211:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117770.597960:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789117770.597983:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593190144:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789117770.598109:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117770.598309:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593190144 00000100:00100000:2.0:1789117770.598326:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593190144 00000100:00100000:2.0:1789117770.598375:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789117770.598386:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f72940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593190144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789117770.598446:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117770.598494:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f72940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593190144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117770.598500:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:2.0:1789117770.598522:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789117770.598873:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87d80f00 x1876025593190144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117786 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117770.598891:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593190144:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789117770.598910:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789117770.598918:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593190272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117770.598947:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117770.598974:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593190272 00000100:00100000:0.0:1789117770.598978:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593190272 00000100:00100000:0.0:1789117770.599011:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789117770.599017:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593190272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789117770.599029:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117770.599092:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593190272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117770.599211:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:0.0:1789117770.599229:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789117770.599246:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a77c00 x1876025593190272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117786 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117770.599258:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593190272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117770.642843:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117770.643013:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572106112 00000100:00100000:3.0:1789117770.643023:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572106112 00000100:00080000:0.0:1789117770.643140:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117770.643854:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 45 00000100:00100000:3.0:1789117770.643869:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8121f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:11387:x1876025572106112:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1789117770.643889:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117770.643912:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1fd08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ee42 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.643980:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be1fd0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.643995:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be1fd0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.644008:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be1fd0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.644022:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fd16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.644028:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fd16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.644034:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fd16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.644112:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be1fd0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.644120:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be1fd0f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.644127:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be1fd0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.644132:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117770.644136:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be1fd0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.644144:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be1fd0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.644157:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b832c8700) 00010000:00010000:3.0:1789117770.644160:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117770.644175:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be1fd0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.644183:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be1fd0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.644193:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fd16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.644199:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fd16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.644204:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fd16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.644215:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117770.644218:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fd16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.644225:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fd16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.644234:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff962bae4af900) 00010000:00010000:3.0:1789117770.644236:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117770.644238:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fd16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.644244:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fd16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.644330:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1fd08 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee42 expref: 10 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.644339:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b832c8700) 00010000:00010000:3.0:1789117770.644341:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117770.644344:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1fd08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee42 expref: 10 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.644351:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92e00, rc 0) 00000100:00100000:2.0:1789117770.644605:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8121f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:11387:x1876025572106112:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 738us (1770us total) trans 0 rc 301/301 00000100:00100000:2.0:1789117770.644614:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 45 00000100:00100000:3.0:1789117770.663882:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117770.664030:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572106368 00000100:00100000:0.0:1789117770.664041:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572106368 00000100:00100000:0.0:1789117770.664140:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 46 00000100:00100000:0.0:1789117770.664151:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:11387:x1876025572106368:12345-192.168.204.30@tcp:36:lfs.0 00010000:00010000:0.0:1789117770.664219:0:14247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117770.664245:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fcc2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee2d expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.664265:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b832c8700) 00010000:00010000:0.0:1789117770.664275:0:14247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117770.664343:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fd1d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.664356:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fd1d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.664365:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fd1d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.664391:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be1fd24 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.664418:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be1fd24 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.664427:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be1fd24 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.664927:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be1fd2b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.664937:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be1fd2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.664944:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be1fd2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789117770.664958:0:14247:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000cb311c5d reply state 000000001faf0ffd transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be1fd2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.664968:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be1fd2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.664975:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:0.0:1789117770.664978:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789117770.664980:0:14247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789117770.664985:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789117770.664992:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fd1d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.664999:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fd1d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.665004:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fd1d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.665019:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dba00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117770.665024:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fd1d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.665031:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fd1d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.665041:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b832d0d00) 00010000:00010000:0.0:1789117770.665044:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117770.665048:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fd1d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.665100:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fd1d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789117770.665116:0:14247:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000cb311c5d reply state 000000001faf0ffd transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be1fd24 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.665125:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be1fd24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.665131:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff962b832d0a00) 00010000:00010000:0.0:1789117770.665133:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789117770.665136:0:14247:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789117770.665256:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+10:11387:x1876025572106368:12345-192.168.204.30@tcp:36:lfs.0 Request processed in 1106us (1397us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789117770.665264:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 46 00010000:00010000:1.0:1789117770.727485:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117770.777316:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117770.779025:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572106496 00000100:00100000:3.0:1789117770.779038:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572106496 00000100:00100000:3.0:1789117770.779209:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 47 00000100:00100000:3.0:1789117770.779223:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8121c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+10:11395:x1876025572106496:12345-192.168.204.30@tcp:101:lctl.0 00010000:00010000:3.0:1789117770.779258:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117770.779284:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1fd32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ee49 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.779363:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fd39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.779597:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fd39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.779610:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fd39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117770.779660:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789117770.779664:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789117770.779710:0:6521:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fd39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.779734:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1fd32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee49 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.779754:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fd39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee49 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.779763:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4af900) 00010000:00010000:3.0:1789117770.779766:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789117770.779769:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93200, rc 0) 00000100:00100000:3.0:1789117770.779841:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8121c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+11:11395:x1876025572106496:12345-192.168.204.30@tcp:101:lctl.0 Request processed in 622us (2535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117770.779858:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 47 00000100:00100000:1.0:1789117770.854323:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117770.854446:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572106624 00000100:00100000:2.0:1789117770.854456:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572106624 00000100:00100000:2.0:1789117770.854549:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 48 00000100:00100000:2.0:1789117770.854559:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8121c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+11:11401:x1876025572106624:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1789117770.854580:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117770.854599:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be1fd40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ee50 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.854657:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fd47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.854672:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fd47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.854696:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fd47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.854707:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fd4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.854727:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fd4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.854734:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fd4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.854806:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68a00/0xaa253ed19be1fd55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.854814:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68a00/0xaa253ed19be1fd55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.854821:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68a00/0xaa253ed19be1fd55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117770.854859:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789117770.854863:0:9533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789117770.854912:0:9533:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68a00/0xaa253ed19be1fd55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.854926:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fd47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.854933:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fd47 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.854940:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fd47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.854946:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117770.854950:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fd47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.854964:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fd47 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.854979:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4af900) 00010000:00010000:2.0:1789117770.854982:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117770.854987:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fd47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.854994:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fd47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.855008:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fd4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.855015:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fd4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.855022:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fd4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.855027:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b68c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117770.855029:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fd4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.855035:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fd4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.855041:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff962b832d0a00) 00010000:00010000:2.0:1789117770.855043:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117770.855046:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fd4e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.855124:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fd4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.855157:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be1fd40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee50 expref: 13 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.855182:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68a00/0xaa253ed19be1fd55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee50 expref: 12 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.855190:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:2.0:1789117770.855193:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789117770.855196:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b68a00, rc 0) 00000100:00100000:2.0:1789117770.855373:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8121c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+12:11401:x1876025572106624:12345-192.168.204.30@tcp:101:bash.0 Request processed in 814us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117770.855381:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 48 00000100:00100000:3.0:1789117770.859995:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117770.860195:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572106880 00000100:00100000:0.0:1789117770.860207:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572106880 00000100:00100000:0.0:1789117770.860286:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 49 00000100:00100000:0.0:1789117770.860324:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+12:11401:x1876025572106880:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:0.0:1789117770.860346:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117770.860368:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be1fd5c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ee57 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.860471:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fd63 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.860486:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fd63 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.860498:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fd63 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.860533:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be1fd6a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.860546:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be1fd6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.860553:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be1fd6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789117770.860939:0:14247:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1789117770.861260:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fd71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.861270:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fd71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.861278:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fd71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.861318:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fd63 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.861325:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fd63 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.861332:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fd63 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.861338:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dbe00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117770.861342:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fd63 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.861349:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fd63 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.861361:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:0.0:1789117770.861364:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117770.861370:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fd63 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.861376:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fd63 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789117770.861387:0:14247:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000bf37faa7 reply state 00000000b23de910 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be1fd6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.861398:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be1fd6a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.861404:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff962b832d0d00) 00010000:00010000:0.0:1789117770.861412:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789117770.861415:0:14247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789117770.861448:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be1fd5c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee57 expref: 15 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.861464:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fd71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee57 expref: 14 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.861472:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962b832d0e00) 00010000:00010000:0.0:1789117770.861474:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117770.861477:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813db800, rc 0) 00000100:00100000:0.0:1789117770.861603:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+15:11401:x1876025572106880:12345-192.168.204.30@tcp:101:bash.0 Request processed in 1293us (1618us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789117770.861612:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 49 00000100:00100000:1.0:1789117770.867533:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117770.867637:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572107008 00000100:00100000:0.0:1789117770.867647:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572107008 00000100:00100000:0.0:1789117770.867703:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00100000:0.0:1789117770.867712:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8121c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2403:x1876025572107008:12345-192.168.204.30@tcp:8:bash.0 00010000:00080000:0.0:1789117770.867747:0:8437:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:0.0:1789117770.867783:0:8437:0:(genops.c:1385:class_connect()) connect: client 35e670b1-2cce-4394-8cb4-d5255c6a6a93, cookie 0xaa253ed19be1fd7f 00002000:00100000:0.0:1789117770.867795:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 35e670b1-2cce-4394-8cb4-d5255c6a6a93/ffff962bae85f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789117770.867806:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789117770.867888:0:8437:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789117770.867920:0:8437:0:(import.c:65:import_set_state_nolock()) ffff962bae85e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789117770.868046:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8121c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2403:x1876025572107008:12345-192.168.204.30@tcp:8:bash.0 Request processed in 334us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117770.868108:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00100000:1.0:1789117770.870761:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117770.870881:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572107136 00000100:00100000:3.0:1789117770.870891:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572107136 00000100:00100000:3.0:1789117770.871039:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00100000:3.0:1789117770.871050:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:0:x1876025572107136:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:3.0:1789117770.871122:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117770.871148:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cd644a7/0xaa253ed19be1fd86 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ee5e expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789117770.871190:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789117770.871216:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117770.871222:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117770.871233:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cd644a7/0xaa253ed19be1fd86 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee5e expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.871266:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002cd644a7/0xaa253ed19be1fd86 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee5e expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.871281:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92e00, rc 0) 00000100:00100000:3.0:1789117770.871354:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:0:x1876025572107136:12345-192.168.204.30@tcp:101:bash.0 Request processed in 306us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117770.871362:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00080000:0.0:1789117770.871482:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789117770.873942:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117770.874028:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572107264 00000100:00100000:2.0:1789117770.874038:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572107264 00000100:00100000:2.0:1789117770.874149:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:2.0:1789117770.874176:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:11401:x1876025572107264:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1789117770.874196:0:8833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117770.874222:0:8833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cb51510/0xaa253ed19be1fd8d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ee65 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.874263:0:8833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002cd644a7/0xaa253ed19be1fd86 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee5e expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.874292:0:8833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117770.874297:0:8833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117770.874304:0:8833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cb51510/0xaa253ed19be1fd8d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee65 expref: 8 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.874342:0:8833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002cd644a7/0xaa253ed19be1fd86 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee5e expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117770.874358:0:8833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002cd644a7/0xaa253ed19be1fd86 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee5e expref: 8 pid: 8433 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117770.874374:0:8833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d80f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8833:1876025593190400:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789117770.874513:0:8833:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c646c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117770.877535:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117770.877866:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572107392 00000100:00100000:3.0:1789117770.877877:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572107392 00010000:00010000:3.0:1789117770.877928:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002cd644a7/0xaa253ed19be1fd86 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee5e expref: 9 pid: 8433 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117770.878012:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 64 00000100:00100000:3.0:1789117770.878024:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d83c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:2406:x1876025572107392:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117770.878042:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789117770.878178:0:8833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d80f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8833:1876025593190400:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117770.878220:0:8833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001cb51510/0xaa253ed19be1fd8d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee65 expref: 9 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117770.878242:0:8833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b68c00, rc 0) 00000100:00100000:0.0:1789117770.878315:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:11401:x1876025572107264:12345-192.168.204.30@tcp:101:bash.0 Request processed in 4155us (4403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117770.878324:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 30 00010000:00010000:3.0:1789117770.878721:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002cd644a7/0xaa253ed19be1fd86 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee5e expref: 8 pid: 8433 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.878984:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002cd644a7/0xaa253ed19be1fd86 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee5e expref: 8 pid: 8433 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.879021:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cd644a7/0xaa253ed19be1fd86 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee5e expref: 8 pid: 8433 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.879039:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117770.879044:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117770.879107:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001cb51510/0xaa253ed19be1fd8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee65 expref: 7 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.879119:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cb51510/0xaa253ed19be1fd8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee65 expref: 7 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.879178:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001cb51510/0xaa253ed19be1fd8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee65 expref: 7 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117770.879195:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884e4b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1876025593190528:192.168.204.30@tcp:105: 00000100:00100000:3.0:1789117770.879305:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4f300 going to sleep for 11 seconds 00000100:00100000:3.0:1789117770.882510:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884e4b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1876025593190528:192.168.204.30@tcp:105: 00010000:00010000:3.0:1789117770.882538:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117770.882651:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d83c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2406:x1876025572107392:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 4618us (5116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117770.882664:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 64 00000100:00100000:1.0:1789117770.883804:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117770.883903:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572107648 00000100:00100000:3.0:1789117770.883912:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572107648 00000100:00100000:3.0:1789117770.884015:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:3.0:1789117770.884028:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+15:11401:x1876025572107648:12345-192.168.204.30@tcp:35:bash.0 00000100:00100000:3.0:1789117770.884448:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+16:11401:x1876025572107648:12345-192.168.204.30@tcp:35:bash.0 Request processed in 422us (649us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789117770.884456:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:2.0:1789117770.963713:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117770.964018:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572107904 00000100:00100000:3.0:1789117770.964033:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572107904 00000100:00100000:3.0:1789117770.964174:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 50 00000100:00100000:3.0:1789117770.964188:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+16:11411:x1876025572107904:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1789117770.964626:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117770.964812:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1fd94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ee6c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117770.964982:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789117770.965465:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1fd94 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee6c expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.965484:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4af900) 00010000:00010000:3.0:1789117770.965578:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789117770.965587:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1fd94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee6c expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117770.965743:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92e00, rc 0) 00000100:00100000:2.0:1789117770.966042:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+17:11411:x1876025572107904:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 1854us (2342us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1789117770.966165:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 50 00000100:00100000:1.0:1789117770.973674:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117770.974738:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572108160 00000100:00100000:2.0:1789117770.974751:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572108160 00000100:00100000:2.0:1789117770.974837:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:2.0:1789117770.974848:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf776940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+17:11411:x1876025572108160:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:2.0:1789117770.975242:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf776940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+18:11411:x1876025572108160:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 395us (1584us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789117770.975270:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:1.0:1789117771.051506:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117771.054822:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572108288 00000100:00100000:2.0:1789117771.054843:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572108288 00000100:00100000:2.0:1789117771.055013:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00100000:2.0:1789117771.055028:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf776d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+18:11417:x1876025572108288:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789117771.055074:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117771.055108:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fda2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ee73 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.055199:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fda9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.055218:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fda9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.055231:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fda9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117771.055284:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789117771.055290:0:9533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789117771.055315:0:9533:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fda9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.055342:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fda2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee73 expref: 20 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.055361:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fda9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee73 expref: 19 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.055390:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:2.0:1789117771.055394:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789117771.055398:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69800, rc 0) 00000100:00100000:2.0:1789117771.055499:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf776d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+19:11417:x1876025572108288:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 474us (4006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117771.055507:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00100000:2.0:1789117771.063005:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117771.063905:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572108544 00000100:00100000:1.0:1789117771.063917:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572108544 00000100:00100000:1.0:1789117771.063995:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 52 00000100:00100000:1.0:1789117771.064006:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+19:11417:x1876025572108544:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1789117771.064029:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117771.064097:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be1fdb0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ee7a expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.064468:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1fdb7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.064486:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1fdb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.064499:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1fdb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117771.064510:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789117771.064737:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be1fdb0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee7a expref: 22 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.064781:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1fdb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee7a expref: 21 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.064792:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962b832d0e00) 00010000:00010000:1.0:1789117771.064795:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117771.064799:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70d200, rc 0) 00000100:00100000:1.0:1789117771.064935:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+21:11417:x1876025572108544:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 930us (1943us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789117771.064944:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 52 00000100:00100000:1.0:1789117771.082550:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117771.082829:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117771.083620:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572108928 00000100:00100000:0.0:1789117771.083648:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572108928 00000100:00100000:0.0:1789117771.083762:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:0.0:1789117771.083778:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e4a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+21:2407:x1876025572108928:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117771.083800:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117771.083838:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1fdb7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee7a expref: 21 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117771.083864:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962b832d0e00) 00010000:00010000:0.0:1789117771.083871:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117771.083947:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572108800 00000100:00100000:2.0:1789117771.083954:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572108800 00000100:00100000:2.0:1789117771.083993:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 53 00000100:00100000:2.0:1789117771.084003:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+21:11417:x1876025572108800:12345-192.168.204.30@tcp:101:lfs.0 00000100:00100000:0.0:1789117771.084029:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e4a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+21:2407:x1876025572108928:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 253us (1198us total) trans 0 rc 0/0 00010000:00010000:2.0:1789117771.084034:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1789117771.084040:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 3 00010000:00010000:2.0:1789117771.084073:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fdc5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ee81 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.084235:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fdcc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.084255:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fdcc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.084270:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fdcc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117771.084285:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789117771.084439:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fdc5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee81 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.084496:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fdcc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee81 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.084504:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962b832d0e00) 00010000:00010000:2.0:1789117771.084507:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789117771.084509:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69400, rc 0) 00000100:00100000:2.0:1789117771.084539:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+22:11417:x1876025572108800:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 538us (1999us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789117771.084547:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 53 00000100:00100000:2.0:1789117771.093284:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117771.097544:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572109056 00000100:00100000:3.0:1789117771.097561:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572109056 00000100:00100000:3.0:1789117771.097806:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:3.0:1789117771.097819:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2406:x1876025572109056:12345-192.168.204.30@tcp:1:lfs.0 00010000:00010000:3.0:1789117771.097874:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001608b68a/0xaa253ed19be1fdda lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117771.097896:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001cb51510/0xaa253ed19be1fd8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee65 expref: 7 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117771.097906:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117771.097912:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789117771.097917:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001608b68a/0xaa253ed19be1fdda lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117771.097955:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001cb51510/0xaa253ed19be1fd8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee65 expref: 7 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117771.097970:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001cb51510/0xaa253ed19be1fd8d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee65 expref: 7 pid: 8833 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117771.097986:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884e4b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1876025593190656:192.168.204.30@tcp:104: 00000100:00100000:3.0:1789117771.098151:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4f780 going to sleep for 11 seconds 00000100:00100000:3.0:1789117771.103849:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117771.104098:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572109184 00000100:00100000:1.0:1789117771.104107:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572109184 00002000:00100000:1.0:1789117771.104173:0:8440:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff962bbf6ef480 x1876025572109184/t0(0) o4->35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp:322/0 lens 504/0 e 0 to 0 dl 1789117782 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789117771.104185:0:8440:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962bbf6ef480 with x1876025572109184 ext(0->12) 00010000:00010000:1.0:1789117771.104195:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001cb51510/0xaa253ed19be1fd8d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee65 expref: 8 pid: 8833 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.104213:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001cb51510/0xaa253ed19be1fd8d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee65 expref: 8 pid: 8833 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789117771.104222:0:8440:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff962bbf6ef480 00000100:00100000:1.0:1789117771.104251:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:1.0:1789117771.104261:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2407:x1876025572109184:12345-192.168.204.30@tcp:4:lfs.0 00000100:00100000:0.0:1789117771.106680:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884e4b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1876025593190656:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117771.106722:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001608b68a/0xaa253ed19be1fdda lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117771.109486:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593190784:0@lo:400:kworker.0 00000100:00100000:0.0:1789117771.109567:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117771.109630:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a884192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593191296:0@lo:400:kworker.0 00000100:00100000:0.0:1789117771.109659:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117771.109678:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a886252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593191808:0@lo:400:kworker.0 00000100:00100000:0.0:1789117771.109699:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117771.109713:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593192320:0@lo:400:kworker.0 00000100:00100000:0.0:1789117771.109731:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117771.109752:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789117771.109757:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593191168:0@lo:400:kworker.0 00000100:00100000:0.0:1789117771.109777:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117771.109791:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593191680:0@lo:400:kworker.0 00000100:00100000:0.0:1789117771.109810:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117771.109825:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593192192:0@lo:400:kworker.0 00000100:00100000:0.0:1789117771.109843:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117771.109870:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593191296 00000100:00100000:0.0:1789117771.109878:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593191296 00000100:00100000:0.0:1789117771.109926:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789117771.109934:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593191296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117771.109984:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593191296:12345-0@lo:400:kworker.0 Request processed in 51us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117771.109991:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789117771.110010:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593191808 00000100:00100000:0.0:1789117771.110024:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593191808 00000100:00100000:0.0:1789117771.110041:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593192320 00000100:00100000:0.0:1789117771.110043:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593192320 00000100:00100000:0.0:1789117771.110097:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593191680 00000100:00100000:0.0:1789117771.110100:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593191680 00000100:00100000:0.0:1789117771.110109:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593192192 00000100:00100000:0.0:1789117771.110111:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593192192 00000100:00100000:0.0:1789117771.110132:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789117771.110138:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593191808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117771.110178:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593191808:12345-0@lo:400:kworker.0 Request processed in 40us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117771.110183:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789117771.110194:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789117771.110199:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593192320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117771.110221:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593192320:12345-0@lo:400:kworker.0 Request processed in 22us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117771.110226:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789117771.110234:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789117771.110239:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593191680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117771.110258:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593191680:12345-0@lo:400:kworker.0 Request processed in 19us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117771.110263:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789117771.110271:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789117771.110275:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593192192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117771.110293:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593192192:12345-0@lo:400:kworker.0 Request processed in 18us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117771.110297:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1789117771.110319:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789117771.110353:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593191680:0@lo:400:kworker.0 00000100:00100000:0.0:1789117771.110362:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593192192:0@lo:400:kworker.0 00000100:00100000:0.0:1789117771.110371:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a884192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593191296:0@lo:400:kworker.0 00000100:00100000:0.0:1789117771.110378:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a886252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593191808:0@lo:400:kworker.0 00000100:00100000:0.0:1789117771.110386:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593192320:0@lo:400:kworker.0 00000100:00100000:3.0:1789117771.110979:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593191040:0@lo:400:kworker.0 00000100:00100000:3.0:1789117771.111029:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117771.111088:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593191552:0@lo:400:kworker.0 00000100:00100000:3.0:1789117771.111111:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117771.111138:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593192064:0@lo:400:kworker.0 00000100:00100000:3.0:1789117771.111167:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117771.111188:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789117771.111195:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593190912:0@lo:400:kworker.0 00000100:00100000:3.0:1789117771.111216:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117771.111228:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a886270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593191424:0@lo:400:kworker.0 00000100:00100000:3.0:1789117771.111247:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117771.111261:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593191936:0@lo:400:kworker.0 00000100:00100000:3.0:1789117771.111280:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117771.111302:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593191040 00000100:00100000:3.0:1789117771.111308:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593191040 00000100:00100000:3.0:1789117771.111338:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789117771.111345:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593191040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117771.111387:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593191040:12345-0@lo:400:kworker.0 Request processed in 42us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117771.111394:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789117771.111454:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593191168 00000100:00100000:3.0:1789117771.111457:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593191168 00000100:00100000:3.0:1789117771.111476:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593191552 00000100:00100000:3.0:1789117771.111478:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593191552 00000100:00100000:3.0:1789117771.111513:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593192064 00000100:00100000:3.0:1789117771.111516:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593192064 00000100:00100000:3.0:1789117771.111529:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593190912 00000100:00100000:3.0:1789117771.111531:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593190912 00000100:00100000:3.0:1789117771.111540:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593191424 00000100:00100000:3.0:1789117771.111542:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593191424 00000100:00100000:3.0:1789117771.111552:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593191936 00000100:00100000:3.0:1789117771.111554:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593191936 00000100:00100000:3.0:1789117771.111567:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1789117771.111573:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593191168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117771.111610:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593191168:12345-0@lo:400:kworker.0 Request processed in 37us (1831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117771.111617:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1789117771.111630:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789117771.111635:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593191552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117771.111662:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593191552:12345-0@lo:400:kworker.0 Request processed in 27us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117771.111668:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789117771.111678:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789117771.111683:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593192064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117771.111752:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593192064:12345-0@lo:400:kworker.0 Request processed in 68us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117771.111758:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789117771.111769:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789117771.111774:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593190912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117771.111800:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593190912:12345-0@lo:400:kworker.0 Request processed in 26us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117771.111814:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789117771.111827:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1789117771.111833:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593191424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117771.111864:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593191424:12345-0@lo:400:kworker.0 Request processed in 32us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117771.111869:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1789117771.111880:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1789117771.111885:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593191936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117771.111909:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593191936:12345-0@lo:400:kworker.0 Request processed in 24us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117771.111915:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1789117771.111959:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593190912:0@lo:400:kworker.0 00000100:00100000:3.0:1789117771.111970:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a886270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593191424:0@lo:400:kworker.0 00000100:00100000:3.0:1789117771.111979:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593191936:0@lo:400:kworker.0 00000100:00100000:3.0:1789117771.111990:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593191040:0@lo:400:kworker.0 00010000:00080000:3.0:1789117771.112004:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88627480 x1876025593191552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117771.112014:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593191552:0@lo:400:kworker.0 00010000:00080000:3.0:1789117771.112023:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87ef43c0 x1876025593192064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117771.112032:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593192064:0@lo:400:kworker.0 00000001:00100000:3.0:1789117771.112144:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 35e670b1-2cce-4394-8cb4-d5255c6a6a93 00000100:00100000:2.0:1789117771.112506:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593190784 00000100:00100000:2.0:1789117771.112511:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593190784 00000100:00100000:2.0:1789117771.112556:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:2.0:1789117771.112564:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3647:x1876025593190784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117771.112619:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3647:x1876025593190784:12345-0@lo:400:kworker.0 Request processed in 56us (3053us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117771.112626:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00080000:0.0:1789117771.112781:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789117771.112787:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789117771.112827:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593191168:0@lo:400:kworker.0 00000100:00100000:0.0:1789117771.112838:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593190784:0@lo:400:kworker.0 00000100:00100000:0.0:1789117771.119454:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593192448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117771.119551:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117771.120701:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593192448 00000100:00100000:3.0:1789117771.120714:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593192448 00000100:00100000:3.0:1789117771.120778:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789117771.120789:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593192448:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117771.120822:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:2407:x1876025572109184:12345-192.168.204.30@tcp:4:lfs.0 Request processed in 16557us (16981us total) trans 4294967300 rc 0/0 00000004:00000024:3.0:1789117771.120836:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1789117771.120837:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 0 00002000:00100000:1.0:1789117771.120855:0:8440:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff962bbf6ef480 x1876025572109184/t4294967300(0) o4->35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp:322/0 lens 504/448 e 0 to 0 dl 1789117782 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789117771.120865:0:8440:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962bbf6ef480 with x1876025572109184 ext(0->12) 00010000:00010000:1.0:1789117771.120877:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001cb51510/0xaa253ed19be1fd8d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee65 expref: 9 pid: 8833 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.120895:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001cb51510/0xaa253ed19be1fd8d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee65 expref: 9 pid: 8833 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789117771.120902:0:8440:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff962bbf6ef480 00000100:00100000:3.0:1789117771.122992:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593192448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2194us (3429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117771.123009:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789117771.124931:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117771.125135:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572109312 00000100:00100000:1.0:1789117771.125149:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572109312 00010000:00010000:1.0:1789117771.125207:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001cb51510/0xaa253ed19be1fd8d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee65 expref: 9 pid: 8833 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117771.125268:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 65 00000100:00100000:1.0:1789117771.125280:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb0939450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:2405:x1876025572109312:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117771.125300:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789117771.125328:0:6504:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789117771.125331:0:6504:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789117771 00002000:00010000:1.0:1789117771.125333:0:6504:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789117771 00002000:00010000:1.0:1789117771.125335:0:6504:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789117771 00002000:00010000:1.0:1789117771.125358:0:6504:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789117771.125367:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001cb51510/0xaa253ed19be1fd8d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee65 expref: 9 pid: 8833 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.125385:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001cb51510/0xaa253ed19be1fd8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee65 expref: 9 pid: 8833 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.125422:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cb51510/0xaa253ed19be1fd8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee65 expref: 9 pid: 8833 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.125449:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789117771.125454:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789117771.125459:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001608b68a/0xaa253ed19be1fdda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.125470:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001608b68a/0xaa253ed19be1fdda lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.125514:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117771.125586:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb0939450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2405:x1876025572109312:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 307us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117771.125595:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 65 00000100:00100000:0.0:1789117771.128551:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593192448:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789117771.128793:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001608b68a/0xaa253ed19be1fdda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.128808:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001608b68a/0xaa253ed19be1fdda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.128840:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001608b68a/0xaa253ed19be1fdda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.128871:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001608b68a/0xaa253ed19be1fdda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.128881:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001608b68a/0xaa253ed19be1fdda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.128888:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117771.128892:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001608b68a/0xaa253ed19be1fdda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.128900:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001608b68a/0xaa253ed19be1fdda lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.128924:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001608b68a/0xaa253ed19be1fdda lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.128931:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001608b68a/0xaa253ed19be1fdda lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117771.129040:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2406:x1876025572109056:12345-192.168.204.30@tcp:1:lfs.0 Request processed in 31221us (35764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117771.129050:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:3.0:1789117771.145604:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117771.145971:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572109568 00000100:00100000:2.0:1789117771.145982:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572109568 00000100:00100000:2.0:1789117771.146093:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:2.0:1789117771.146135:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+22:11417:x1876025572109568:12345-192.168.204.30@tcp:35:lfs.0 00000004:00010000:2.0:1789117771.146222:0:6522:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fdcc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee81 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789117771.146462:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1789117771.146515:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1789117771.146849:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1789117771.146888:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fde1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.146902:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fd71 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee57 expref: 26 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.146910:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fde1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.146943:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fd71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee57 expref: 26 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.146959:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fd71 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee57 expref: 26 pid: 14247 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117771.146976:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef70c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1876025593192576:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789117771.147122:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e46300 going to sleep for 11 seconds 00000100:00100000:2.0:1789117771.159711:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef70c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1876025593192576:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789117771.159743:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fde1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117771.162534:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117771.162860:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572109696 00000100:00100000:1.0:1789117771.162871:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572109696 00010000:00010000:1.0:1789117771.162916:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fd71 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee57 expref: 27 pid: 14247 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117771.162964:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 66 00000100:00100000:1.0:1789117771.162987:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+27:2407:x1876025572109696:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117771.163002:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117771.163009:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fd71 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee57 expref: 27 pid: 14247 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.163023:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fd71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee57 expref: 27 pid: 14247 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.163047:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fd71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee57 expref: 27 pid: 14247 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.163127:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962b832d0e00) 00010000:00010000:1.0:1789117771.163132:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fde1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.163142:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fde1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.163149:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fde1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.163187:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117771.163273:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+26:2407:x1876025572109696:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 288us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117771.163281:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 66 00010000:00010000:2.0:1789117771.164977:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fde1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.164993:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fde1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789117771.165166:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1789117771.165307:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1789117771.165400:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef70c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1876025593192704:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789117771.165466:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117771.165505:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e463c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117771.165793:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593192704 00000100:00100000:1.0:1789117771.165801:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593192704 00000100:00100000:1.0:1789117771.165853:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789117771.165864:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1876025593192704:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789117771.165983:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1876025593192704:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 121us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117771.165992:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789117771.166387:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef70c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1876025593192704:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789117771.166556:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1789117771.166768:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef70c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1876025593192832:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789117771.166822:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117771.166950:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e46540 going to sleep for 11 seconds 00000100:00100000:1.0:1789117771.168548:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593192832 00000100:00100000:1.0:1789117771.168561:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593192832 00000100:00100000:1.0:1789117771.168837:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789117771.168851:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1876025593192832:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789117771.169042:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6522:x1876025593192832:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 195us (2219us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789117771.169051:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789117771.169175:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef70c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1876025593192832:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789117771.169243:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1789117771.169303:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fde1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.169314:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fde1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.169321:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fde1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.169327:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117771.169346:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fde1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.169355:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fde1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.169373:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962b832d0e00) 00010000:00010000:2.0:1789117771.169377:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789117771.169382:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fde1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.169388:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fde1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789117771.169507:0:6522:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789117771.169566:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1789117771.169575:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 423452520806ns, next at 424452519017ns, rc = 0 00000001:00080000:2.0:1789117771.169581:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1789117771.169619:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962b832d0e00) 00010000:00010000:2.0:1789117771.169622:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789117771.169629:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fdcc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee81 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117771.169719:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+29:11417:x1876025572109568:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 23588us (24143us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1789117771.169726:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 8 00000020:00080000:2.0:1789117771.169729:0:6522:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789117771.175826:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117771.175921:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572109824 00000100:00100000:3.0:1789117771.175931:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572109824 00000100:00100000:2.0:1789117771.176543:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 54 00000100:00100000:2.0:1789117771.176561:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+29:11417:x1876025572109824:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789117771.176753:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117771.176781:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fde8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ee88 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.176844:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fde8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee88 expref: 30 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.176860:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fde8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee88 expref: 30 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.176879:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:2.0:1789117771.176882:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789117771.176886:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69000, rc 0) 00000100:00100000:2.0:1789117771.177001:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+30:11417:x1876025572109824:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 448us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117771.177009:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 54 00000100:00100000:2.0:1789117771.181506:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117771.181570:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572110080 00000100:00100000:3.0:1789117771.181580:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572110080 00000100:00100000:3.0:1789117771.181664:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:3.0:1789117771.181676:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb0809850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+30:11417:x1876025572110080:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:3.0:1789117771.182516:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb0809850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+31:11417:x1876025572110080:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 837us (1015us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789117771.182526:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:2.0:1789117771.303611:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117771.306921:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572110336 00000100:00100000:3.0:1789117771.306940:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572110336 00000100:00100000:3.0:1789117771.307125:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 55 00000100:00100000:3.0:1789117771.307139:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+31:11427:x1876025572110336:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1789117771.307193:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117771.307224:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1fdef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ee8f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117771.307388:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789117771.307548:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1fdef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee8f expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117771.307565:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4af900) 00010000:00010000:3.0:1789117771.307570:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789117771.307575:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1fdef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee8f expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117771.307602:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92e00, rc 0) 00000100:00100000:3.0:1789117771.308973:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+32:11427:x1876025572110336:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 1821us (5372us total) trans 4294967329 rc 301/301 00000100:00100000:3.0:1789117771.308990:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 55 00000100:00100000:0.0:1789117771.315770:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117771.315950:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572110464 00000100:00100000:1.0:1789117771.315963:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572110464 00000100:00100000:1.0:1789117771.316122:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 56 00000100:00100000:1.0:1789117771.316134:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+32:11427:x1876025572110464:12345-192.168.204.30@tcp:34:lfs.0 00010000:00010000:1.0:1789117771.316234:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fdfd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316264:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fdfd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316277:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fdfd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316289:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be1fe04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316296:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be1fe04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316318:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be1fe04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316409:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1fe0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316418:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1fe0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316425:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1fe0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789117771.316488:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1fe0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316504:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fdfd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316511:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fdfd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316517:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fdfd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316523:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70da00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117771.316528:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fdfd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316536:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fdfd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316550:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:1.0:1789117771.316560:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117771.316567:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fdfd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316575:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fdfd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316604:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be1fe04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316611:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be1fe04 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316617:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be1fe04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316622:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117771.316625:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be1fe04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316641:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be1fe04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316649:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff962b832d0d00) 00010000:00010000:1.0:1789117771.316652:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117771.316655:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be1fe04 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316660:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be1fe04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316674:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1fe0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316687:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1fe0b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316693:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1fe0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316698:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117771.316701:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1fe0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316707:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1fe0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316715:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:1.0:1789117771.316717:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117771.316720:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1fe0b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.316726:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1fe0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117771.316833:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+32:11427:x1876025572110464:12345-192.168.204.30@tcp:34:lfs.0 Request processed in 700us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117771.316843:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 56 00000100:00100000:3.0:1789117771.320224:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117771.320459:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572110720 00000100:00100000:0.0:1789117771.320473:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572110720 00000100:00100000:0.0:1789117771.320539:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:0.0:1789117771.320550:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+32:11427:x1876025572110720:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:0.0:1789117771.320833:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+33:11427:x1876025572110720:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 284us (624us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789117771.320840:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:3.0:1789117771.386497:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117771.386777:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572110976 00000100:00100000:2.0:1789117771.386803:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572110976 00000100:00100000:2.0:1789117771.386889:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 57 00000100:00100000:2.0:1789117771.386902:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+33:11430:x1876025572110976:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789117771.386937:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117771.386964:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fe12 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ee96 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.387092:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fe19 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.387121:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fe19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.387133:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fe19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.387146:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fe20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.387165:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fe20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.387172:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fe20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.387304:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fe27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.387313:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fe27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.387321:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fe27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117771.387332:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789117771.387413:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fe19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.387419:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fe19 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.387438:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fe19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.387452:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117771.387456:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fe19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.387464:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fe19 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.387476:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:2.0:1789117771.387480:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117771.387485:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fe19 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.387491:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1fe19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.387503:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fe20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.387509:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fe20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.387514:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fe20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.387519:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b68c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117771.387522:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fe20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.387527:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fe20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.387545:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff962b832d0d00) 00010000:00010000:2.0:1789117771.387548:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117771.387552:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fe20 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.387558:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fe20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.387616:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fe12 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee96 expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.388233:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fe27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee96 expref: 35 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.388243:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:2.0:1789117771.388246:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789117771.388249:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69e00, rc 0) 00000100:00100000:2.0:1789117771.388331:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+35:11430:x1876025572110976:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 1431us (1845us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789117771.388339:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 57 00000100:00100000:0.0:1789117771.398231:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117771.398420:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572111104 00000100:00100000:3.0:1789117771.398440:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572111104 00000100:00100000:3.0:1789117771.398508:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 58 00000100:00100000:3.0:1789117771.398519:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+35:11430:x1876025572111104:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:3.0:1789117771.398606:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1fe35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117771.398626:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1fe35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117771.398647:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1fe35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117771.398702:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1fe35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117771.398710:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1fe35 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117771.398717:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1fe35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117771.398722:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117771.398727:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1fe35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117771.398733:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1fe35 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117771.398745:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:3.0:1789117771.398748:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789117771.398753:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1fe35 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117771.398759:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1fe35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117771.398868:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+35:11430:x1876025572111104:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 351us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117771.398877:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 58 00000100:00100000:3.0:1789117771.404391:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117771.404677:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572111360 00000100:00100000:0.0:1789117771.404705:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572111360 00000100:00100000:0.0:1789117771.404776:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:0.0:1789117771.404798:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf776940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+35:11430:x1876025572111360:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:0.0:1789117771.405142:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf776940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+36:11430:x1876025572111360:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 346us (761us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1789117771.405161:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:2.0:1789117771.622977:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593192960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117771.623085:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117771.623286:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789117771.623298:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593193088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789117771.623343:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117771.623383:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593192960 00000100:00100000:0.0:1789117771.623392:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593192960 00000100:00100000:0.0:1789117771.623460:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593193088 00000100:00100000:0.0:1789117771.623464:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593193088 00000100:00100000:0.0:1789117771.623481:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789117771.623490:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593192960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789117771.623522:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117771.623567:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593192960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117771.623575:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789117771.623593:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789117771.623600:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a886270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593193088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789117771.623609:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117771.623995:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593192960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117771.624611:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a886270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593193088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1009us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117771.624620:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789117771.625114:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593193088:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789117771.751072:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117771.850237:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117771.850364:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572111616 00000100:00100000:1.0:1789117771.850393:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572111616 00000100:00100000:1.0:1789117771.850476:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 59 00000100:00100000:1.0:1789117771.850488:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a886252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+36:11461:x1876025572111616:12345-192.168.204.30@tcp:101:cat.0 00010000:00010000:1.0:1789117771.850519:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117771.850543:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be1fe3c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ee9d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.850686:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fe43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.850705:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fe43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.850719:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fe43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117771.850730:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789117771.850890:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be1fe3c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee9d expref: 39 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.850909:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fe43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee9d expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117771.850917:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:1.0:1789117771.850920:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117771.850924:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70da00, rc 0) 00000100:00100000:1.0:1789117771.850994:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a886252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+38:11461:x1876025572111616:12345-192.168.204.30@tcp:101:cat.0 Request processed in 509us (771us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1789117771.851002:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 59 00000100:00100000:1.0:1789117771.857496:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117771.857949:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572111872 00000100:00100000:0.0:1789117771.857986:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572111872 00000100:00100000:0.0:1789117771.858102:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:0.0:1789117771.858113:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+38:11461:x1876025572111872:12345-192.168.204.30@tcp:35:cat.0 00000100:00100000:0.0:1789117771.858529:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+39:11461:x1876025572111872:12345-192.168.204.30@tcp:35:cat.0 Request processed in 417us (1041us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1789117771.858537:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:1.0:1789117771.861830:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117771.862881:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572112000 00000100:00100000:2.0:1789117771.862896:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572112000 00000100:00100000:2.0:1789117771.862985:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:2.0:1789117771.862995:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e49a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+39:2407:x1876025572112000:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117771.863015:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117771.863082:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fe43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee9d expref: 39 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117771.863107:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:2.0:1789117771.863112:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117771.863266:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e49a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+38:2407:x1876025572112000:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 272us (1445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117771.863275:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:1.0:1789117772.005168:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117772.005349:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572112256 00000100:00100000:0.0:1789117772.005364:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572112256 00000100:00100000:0.0:1789117772.005452:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00100000:0.0:1789117772.005464:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+38:11467:x1876025572112256:12345-192.168.204.30@tcp:101:dd.0 00010000:00010000:0.0:1789117772.005487:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117772.005490:0:14247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789117772.005516:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1fda9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee73 expref: 38 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.005533:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:0.0:1789117772.005539:0:14247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117772.005553:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fe51 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0eea4 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789117772.005707:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789117772.005822:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fe58 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.005839:0:14247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fe27 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee96 expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.005849:0:14247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fe58 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.005917:0:14247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fe27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee96 expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.005933:0:14247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fe27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee96 expref: 38 pid: 6519 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117772.005948:0:14247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88627840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14247:1876025593193216:192.168.204.30@tcp:104: 00000100:00100000:0.0:1789117772.006229:0:14247:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b86fac3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117772.014932:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117772.015129:0:14247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88627840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14247:1876025593193216:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117772.015171:0:14247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fe58 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117772.015260:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572112384 00000100:00100000:2.0:1789117772.015269:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572112384 00010000:00010000:2.0:1789117772.015318:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fe27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee96 expref: 39 pid: 6519 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117772.015365:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00100000:2.0:1789117772.015376:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+39:2407:x1876025572112384:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117772.015394:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117772.015401:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fe27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee96 expref: 39 pid: 6519 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117772.015415:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fe27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee96 expref: 39 pid: 6519 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117772.015441:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fe27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee96 expref: 39 pid: 6519 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117772.015457:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:2.0:1789117772.015461:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fe58 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117772.015485:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fe58 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117772.015493:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fe58 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117772.015523:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117772.015589:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+38:2407:x1876025572112384:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 214us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117772.015598:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 67 00010000:00010000:0.0:1789117772.015713:0:14247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fe58 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.015720:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fe58 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117772.015741:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789117772.015918:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fe51 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eea4 expref: 39 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.015936:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fe58 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eea4 expref: 38 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.015944:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:0.0:1789117772.015947:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789117772.015958:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813db800, rc 0) 00000100:00100000:0.0:1789117772.015991:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+38:11467:x1876025572112256:12345-192.168.204.30@tcp:101:dd.0 Request processed in 10530us (10835us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1789117772.015998:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00100000:1.0:1789117772.020284:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117772.020519:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572112512 00000100:00100000:2.0:1789117772.020532:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572112512 00000100:00100000:2.0:1789117772.020630:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 61 00000100:00100000:2.0:1789117772.020642:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+38:11467:x1876025572112512:12345-192.168.204.30@tcp:101:dd.0 00010000:00010000:2.0:1789117772.020670:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117772.020699:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fe66 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0eeab expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117772.020734:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fe6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117772.020750:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fe6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117772.020761:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fe6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117772.020891:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fe66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeab expref: 40 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117772.020923:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fe6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeab expref: 39 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117772.020931:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:2.0:1789117772.020934:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789117772.020937:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b68c00, rc 0) 00000100:00100000:2.0:1789117772.021020:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+39:11467:x1876025572112512:12345-192.168.204.30@tcp:101:dd.0 Request processed in 380us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117772.021027:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 61 00000100:00100000:3.0:1789117772.027243:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117772.027362:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572112768 00000100:00100000:2.0:1789117772.027373:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572112768 00000100:00100000:2.0:1789117772.027436:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 62 00000100:00100000:2.0:1789117772.027447:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+39:11467:x1876025572112768:12345-192.168.204.30@tcp:36:dd.0 00010000:00010000:2.0:1789117772.027781:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fe74 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117772.027807:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fe74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117772.027822:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fe74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789117772.027879:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1789117772.027904:0:6519:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e9b98c01 reply state 000000000adca68a transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fe74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117772.027917:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fe74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117772.027933:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:2.0:1789117772.027936:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789117772.027940:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789117772.028039:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+42:11467:x1876025572112768:12345-192.168.204.30@tcp:36:dd.0 Request processed in 593us (809us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1789117772.028048:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 62 00000020:00080000:2.0:1789117772.028077:0:6519:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789117772.344461:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117772.345178:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572112896 00000100:00100000:0.0:1789117772.345193:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572112896 00000100:00100000:0.0:1789117772.345288:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 63 00000100:00100000:0.0:1789117772.345300:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+42:11481:x1876025572112896:12345-192.168.204.30@tcp:101:stat.0 00010000:00010000:0.0:1789117772.345332:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117772.345360:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fe7b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0eeb2 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.345839:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fe82 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.345867:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fe82 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.345882:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fe82 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.345896:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be1fe89 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.345902:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be1fe89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.345909:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be1fe89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.346019:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be1fe90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.346046:0:14247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fe58 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eea4 expref: 43 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.346085:0:14247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be1fe90 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.346145:0:14247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fe58 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eea4 expref: 43 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.346163:0:14247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fe58 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eea4 expref: 43 pid: 14247 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117772.346181:0:14247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88627840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14247:1876025593193344:192.168.204.30@tcp:104: 00000100:00100000:0.0:1789117772.346419:0:14247:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b86fac3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117772.354651:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117772.354756:0:14247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88627840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14247:1876025593193344:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117772.354788:0:14247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be1fe90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117772.355033:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572113152 00000100:00100000:3.0:1789117772.355041:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572113152 00000100:00100000:3.0:1789117772.355141:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:3.0:1789117772.355153:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+44:6177:x1876025572113152:12345-192.168.204.30@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789117772.355563:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+45:6177:x1876025572113152:12345-192.168.204.30@tcp:35:ldlm_bl.0 Request processed in 410us (926us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1789117772.355572:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:3.0:1789117772.360883:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117772.361013:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572113280 00000100:00100000:0.0:1789117772.361024:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572113280 00010000:00010000:0.0:1789117772.361100:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fe58 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eea4 expref: 45 pid: 14247 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117772.361156:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 68 00000100:00100000:0.0:1789117772.361168:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa85a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+45:2406:x1876025572113280:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117772.361183:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117772.361212:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fe58 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eea4 expref: 45 pid: 14247 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.361227:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fe58 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eea4 expref: 45 pid: 14247 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.361251:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be1fe58 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eea4 expref: 45 pid: 14247 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.361268:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:0.0:1789117772.361274:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be1fe90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.361285:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be1fe90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.361295:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be1fe90 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.361336:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117772.361406:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa85a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+44:2406:x1876025572113280:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 240us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117772.361415:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 68 00010000:00010000:1.0:1789117772.361553:0:14247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be1fe90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.361563:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be1fe90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117772.361618:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789117772.361623:0:14247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789117772.361667:0:14247:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be1fe90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.361681:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be1fe90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.361690:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fe82 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.361697:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fe82 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.361703:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fe82 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.361709:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dba00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117772.361713:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fe82 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.361731:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fe82 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.361741:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:1.0:1789117772.361744:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117772.361748:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fe82 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.361754:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be1fe82 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.361765:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be1fe89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.361770:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be1fe89 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.361776:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be1fe89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.361781:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813daa00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117772.361784:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be1fe89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.361789:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be1fe89 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.361796:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff962b832d0d00) 00010000:00010000:1.0:1789117772.361798:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117772.361802:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be1fe89 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.361817:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be1fe89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.361853:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be1fe7b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeb2 expref: 44 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.361867:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be1fe90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeb2 expref: 43 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.361874:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:1.0:1789117772.361877:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117772.361879:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962baea9bc00, rc 0) 00000100:00100000:1.0:1789117772.361910:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+43:11481:x1876025572112896:12345-192.168.204.30@tcp:101:stat.0 Request processed in 16613us (17464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117772.361917:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 63 00000100:00100000:1.0:1789117772.519482:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117772.519607:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572113536 00000100:00100000:2.0:1789117772.519617:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572113536 00000100:00100000:2.0:1789117772.519685:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 64 00000100:00100000:2.0:1789117772.519695:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+43:11487:x1876025572113536:12345-192.168.204.30@tcp:36:truncate.0 00010000:00010000:2.0:1789117772.519749:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117772.519775:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be1fe90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeb2 expref: 43 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117772.519796:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:2.0:1789117772.519802:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117772.520013:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fe97 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117772.520030:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fe97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117772.520040:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fe97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789117772.520149:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1789117772.520170:0:6520:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009be0d142 reply state 00000000f46da302 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fe97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117772.520210:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fe97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117772.520216:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:2.0:1789117772.520219:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789117772.520222:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789117772.520339:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+45:11487:x1876025572113536:12345-192.168.204.30@tcp:36:truncate.0 Request processed in 645us (868us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1789117772.520348:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 64 00000020:00080000:2.0:1789117772.520353:0:6520:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789117772.646818:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117772.646884:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117772.646926:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117772.646960:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117772.646982:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117772.647156:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572113664 00000100:00100000:2.0:1789117772.647168:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572113664 00000100:00100000:2.0:1789117772.647251:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 457 00000100:00100000:2.0:1789117772.647262:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572113664:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117772.647357:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572113664:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 96us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117772.647365:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 457 00000100:00100000:0.0:1789117772.647629:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572113920 00000100:00100000:0.0:1789117772.647635:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572113920 00000100:00080000:0.0:1789117772.647668:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789117772.647703:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572114176 00000100:00100000:0.0:1789117772.647706:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572114176 00000100:00080000:0.0:1789117772.647724:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117772.647732:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572113792 00000100:00100000:0.0:1789117772.647735:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572113792 00000100:00100000:0.0:1789117772.647775:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 365 00000100:00100000:0.0:1789117772.647782:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572113920:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117772.647835:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572113920:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 53us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117772.647842:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 365 00000100:00100000:0.0:1789117772.647859:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 366 00000100:00100000:0.0:1789117772.647865:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+45:2407:x1876025572113792:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117772.647892:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+45:2407:x1876025572113792:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 27us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117772.647897:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 366 00000100:00100000:0.0:1789117772.647928:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 367 00000100:00100000:0.0:1789117772.647934:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572114176:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117772.647957:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572114176:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 23us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117772.647963:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 367 00000100:00100000:3.0:1789117772.648501:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117772.648690:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572114304 00000100:00100000:1.0:1789117772.648697:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572114304 00000100:00100000:1.0:1789117772.648753:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 368 00000100:00100000:1.0:1789117772.648760:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572114304:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117772.648803:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572114304:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 44us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117772.648810:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 368 00000100:00080000:3.0:1789117772.648902:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789117772.652350:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572114048 00000100:00100000:2.0:1789117772.652367:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572114048 00000100:00100000:2.0:1789117772.652472:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 134 00000100:00100000:2.0:1789117772.652488:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2407:x1876025572114048:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117772.652590:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2407:x1876025572114048:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 108us (5606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117772.652598:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 134 00000100:00080000:0.0:1789117772.653544:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789117772.773743:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117772.799634:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117772.799859:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572114432 00000100:00100000:0.0:1789117772.799875:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572114432 00000100:00100000:0.0:1789117772.799955:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 65 00000100:00100000:0.0:1789117772.799967:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+45:11501:x1876025572114432:12345-192.168.204.30@tcp:101:stat.0 00010000:00010000:0.0:1789117772.799996:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117772.800023:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be1fe9e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0eeb9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.800151:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b400/0xaa253ed19be1fea5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.800188:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b400/0xaa253ed19be1fea5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.800208:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b400/0xaa253ed19be1fea5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.800521:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be1feac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.800531:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be1feac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.800539:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be1feac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.800696:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1feb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.800705:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1feb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.800712:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1feb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117772.800758:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1789117772.800763:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789117772.800804:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1feb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.800819:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1feb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.800839:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b400/0xaa253ed19be1fea5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.800845:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b400/0xaa253ed19be1fea5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.800853:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b400/0xaa253ed19be1fea5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.800860:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9b400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117772.800865:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b400/0xaa253ed19be1fea5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.800872:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b400/0xaa253ed19be1fea5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.800884:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:0.0:1789117772.800887:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117772.800893:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b400/0xaa253ed19be1fea5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.800899:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b400/0xaa253ed19be1fea5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.800912:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be1feac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.800917:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be1feac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.800923:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be1feac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.800933:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9bc00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117772.800936:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be1feac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.800941:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be1feac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.800948:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff962b832d0d00) 00010000:00010000:0.0:1789117772.800950:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117772.800953:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be1feac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.800960:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be1feac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.800990:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be1fe9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeb9 expref: 47 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.801005:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1feb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeb9 expref: 46 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.801012:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:0.0:1789117772.801015:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117772.801017:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f4600, rc 0) 00000100:00100000:0.0:1789117772.801283:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+46:11501:x1876025572114432:12345-192.168.204.30@tcp:101:stat.0 Request processed in 1318us (1664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117772.801293:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 65 00000100:00100000:3.0:1789117772.925219:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117772.925503:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572114688 00000100:00100000:1.0:1789117772.925529:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572114688 00000100:00100000:1.0:1789117772.925629:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 66 00000100:00100000:1.0:1789117772.925647:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+46:11511:x1876025572114688:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1789117772.925679:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117772.925711:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1feba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0eec0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117772.925854:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789117772.926006:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1feba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eec0 expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.926022:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4af900) 00010000:00010000:1.0:1789117772.926025:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789117772.926031:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1feba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eec0 expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.926048:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70d200, rc 0) 00000100:00100000:1.0:1789117772.926192:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+47:11511:x1876025572114688:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 551us (988us total) trans 4294967341 rc 301/301 00000100:00100000:1.0:1789117772.926200:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 66 00000001:00080000:3.0:1789117772.930354:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967341 is committed 00000004:00080000:3.0:1789117772.930408:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1789117772.930444:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff962a87e463c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789117772.930452:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962a87f7b100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff962a87e46480 00000020:00080000:3.0:1789117772.930456:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962a87f7bb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff962a86e2f200 00000020:00080000:2.0:1789117772.930541:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00010000:00010000:1.0:1789117772.930771:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be1fd24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.930791:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be1fd24 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.930801:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be1fd24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.930817:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813da800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117772.930824:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be1fd24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.930834:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be1fd24 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789117772.930842:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:1.0:1789117772.930858:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff962b832d0a00) 00010000:00010000:1.0:1789117772.930862:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117772.930870:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be1fd24 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.930878:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be1fd24 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.930902:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be1fd2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.930908:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be1fd2b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.930914:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be1fd2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.930919:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117772.930922:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be1fd2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.930929:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be1fd2b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.930949:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:1.0:1789117772.930952:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117772.930956:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be1fd2b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.930962:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be1fd2b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.930981:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be1fd6a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.930986:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be1fd6a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.930992:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be1fd6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.930996:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117772.930999:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be1fd6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.931005:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be1fd6a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.931012:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff962b832d0d00) 00010000:00010000:1.0:1789117772.931015:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117772.931017:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be1fd6a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.931023:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be1fd6a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.931047:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fe74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.931076:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fe74 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.931082:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fe74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.931088:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117772.931090:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fe74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.931097:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fe74 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.931105:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:1.0:1789117772.931108:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117772.931111:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fe74 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.931117:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fe74 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117772.931129:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1789117772.931141:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fe97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.931147:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fe97 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.931152:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fe97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.931162:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69600 already unused, calling callback (ffffffffc19ea4f0) 00000100:00100000:0.0:1789117772.931163:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593193472:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789117772.931166:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fe97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.931171:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fe97 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.931179:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:1.0:1789117772.931181:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117772.931184:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fe97 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.931190:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be1fe97 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117772.931276:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117772.931348:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593193472 00000100:00100000:1.0:1789117772.931357:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593193472 00000100:00100000:1.0:1789117772.931422:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789117772.931434:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88627c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1876025593193472:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789117772.931477:0:8833:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1789117772.931523:0:8833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aa3c54b, atime: 0x6aa3c54b, ctime: 0x6aa3c54b, blocks: 0x8 00010000:00010000:1.0:1789117772.931531:0:8833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000048cb404/0xaa253ed19be1fec8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.931548:0:8833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=425s v=(0 0) 00000100:00080000:0.0:1789117772.931551:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789117772.931554:0:8833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117772.931572:0:8833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000048cb404/0xaa253ed19be1fec8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.931736:0:8833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000048cb404/0xaa253ed19be1fec8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.931747:0:8833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000048cb404/0xaa253ed19be1fec8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.931755:0:8833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000048cb404/0xaa253ed19be1fec8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117772.931780:0:8833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789117772.931948:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88627c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3646:x1876025593193472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 514us (670us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789117772.931955:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:2.0:1789117772.932086:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff962a88627840/2, rc 0, transno 4294967302 00000100:00100000:2.0:1789117772.932093:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88627840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593193472:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789117772.932349:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117772.932358:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000048cb404/0xaa253ed19be1fec8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.932368:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d200 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789117772.932372:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000048cb404/0xaa253ed19be1fec8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.932380:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000048cb404/0xaa253ed19be1fec8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.932405:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000048cb404/0xaa253ed19be1fec8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.932414:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000048cb404/0xaa253ed19be1fec8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117772.932439:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117772.932441:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117772.932442:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117772.947817:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117772.947929:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572114944 00000100:00100000:3.0:1789117772.947945:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572114944 00000100:00100000:3.0:1789117772.948032:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:3.0:1789117772.948044:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1bbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+12:11511:x1876025572114944:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:3.0:1789117772.948520:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1bbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+13:11511:x1876025572114944:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 476us (711us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1789117772.948537:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:2.0:1789117773.028573:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117773.030249:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572115200 00000100:00100000:0.0:1789117773.030275:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572115200 00000100:00100000:1.0:1789117773.031090:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00100000:1.0:1789117773.031108:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+13:11517:x1876025572115200:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:1.0:1789117773.031151:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117773.031193:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be1fecf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0eec7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.031344:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fed6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.031362:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1feb3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeb9 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.031407:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fed6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.031452:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1feb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeb9 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.031467:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1feb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeb9 expref: 14 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117773.031484:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1bbe1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876025593193600:192.168.204.30@tcp:104: 00000100:00100000:1.0:1789117773.031647:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84b7e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789117773.035421:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1bbe1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876025593193600:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117773.035458:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fed6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117773.037024:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117773.037883:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572115328 00000100:00100000:3.0:1789117773.037897:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572115328 00010000:00010000:3.0:1789117773.037961:0:7470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1feb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeb9 expref: 15 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117773.038097:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 69 00000100:00100000:3.0:1789117773.038111:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b64f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+15:2407:x1876025572115328:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117773.038142:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117773.038149:0:7470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1feb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeb9 expref: 15 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.038166:0:7470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1feb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeb9 expref: 15 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.038327:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1feb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeb9 expref: 15 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.038351:0:7470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:3.0:1789117773.038359:0:7470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fed6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.038382:0:7470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fed6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.038392:0:7470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fed6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.038812:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117773.038940:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b64f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+14:2407:x1876025572115328:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 828us (1924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117773.038949:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 69 00010000:00010000:1.0:1789117773.039048:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fed6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.039075:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fed6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117773.039104:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1789117773.039316:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be1fecf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eec7 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.039339:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fed6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eec7 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.039349:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:1.0:1789117773.039352:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789117773.039355:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70da00, rc 0) 00000100:00100000:1.0:1789117773.039415:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+14:11517:x1876025572115200:12345-192.168.204.30@tcp:101:bash.0 Request processed in 8313us (10863us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1789117773.039424:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00100000:1.0:1789117773.043850:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117773.043979:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572115584 00000100:00100000:0.0:1789117773.043998:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572115584 00000100:00100000:0.0:1789117773.044251:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 68 00000100:00100000:0.0:1789117773.044269:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1bbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+14:11517:x1876025572115584:12345-192.168.204.30@tcp:36:bash.0 00010000:00010000:0.0:1789117773.044907:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be1fee4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.044931:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be1fee4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.044945:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be1fee4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789117773.045001:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:0.0:1789117773.045026:0:6520:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c63d3cc4 reply state 00000000854de7f6 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be1fee4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.045038:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be1fee4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.045046:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:0.0:1789117773.045050:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789117773.045645:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789117773.045819:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1bbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+17:11517:x1876025572115584:12345-192.168.204.30@tcp:36:bash.0 Request processed in 1552us (1990us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1789117773.045849:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 68 00000020:00080000:0.0:1789117773.045855:0:6520:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789117773.053044:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117773.053301:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572115712 00000100:00100000:1.0:1789117773.053315:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572115712 00000100:00100000:1.0:1789117773.053413:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 69 00000100:00100000:1.0:1789117773.053428:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+17:11517:x1876025572115712:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:1.0:1789117773.053464:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117773.053499:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be1feeb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0eece expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.053639:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be1fef2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.053657:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fed6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eec7 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.053668:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be1fef2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.053710:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fed6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eec7 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.053726:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fed6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eec7 expref: 18 pid: 6519 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117773.053744:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1bbc780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593193728:192.168.204.30@tcp:104: 00000100:00100000:1.0:1789117773.053895:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84b7e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789117773.064509:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117773.067672:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572115840 00000100:00100000:3.0:1789117773.067695:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572115840 00010000:00010000:3.0:1789117773.067778:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fed6 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eec7 expref: 19 pid: 6519 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117773.068091:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 70 00000100:00100000:3.0:1789117773.068106:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b643c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+19:2406:x1876025572115840:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117773.068137:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117773.068148:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fed6 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eec7 expref: 19 pid: 6519 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.068163:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fed6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eec7 expref: 19 pid: 6519 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.068189:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:3.0:1789117773.068196:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be1fef2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.068207:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be1fef2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.068215:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be1fef2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.068237:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117773.068309:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b643c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+19:2406:x1876025572115840:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 207us (3812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117773.068316:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 70 00010000:00010000:1.0:1789117773.069618:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1fed6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eec7 expref: 18 pid: 6519 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117773.069646:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1bbc780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593193728:192.168.204.30@tcp:104: 00010000:00010000:1.0:1789117773.069686:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be1fef2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.069698:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be1fef2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.069704:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be1fef2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117773.069795:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789117773.069800:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789117773.069827:0:6521:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be1fef2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.069874:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be1feeb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eece expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.069891:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be1fef2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eece expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.069899:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:1.0:1789117773.069902:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117773.069906:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70ca00, rc 0) 00000100:00100000:1.0:1789117773.069978:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+17:11517:x1876025572115712:12345-192.168.204.30@tcp:101:bash.0 Request processed in 16554us (16947us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117773.070013:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 69 00000100:00100000:2.0:1789117773.086255:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117773.086476:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572116096 00000100:00100000:3.0:1789117773.086491:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572116096 00000100:00100000:3.0:1789117773.086584:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:3.0:1789117773.086597:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb080b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+17:11517:x1876025572116096:12345-192.168.204.30@tcp:35:bash.0 00000100:00100000:3.0:1789117773.086934:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb080b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+18:11517:x1876025572116096:12345-192.168.204.30@tcp:35:bash.0 Request processed in 339us (697us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1789117773.086944:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:0.0:1789117773.192457:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117773.192646:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572116352 00000100:00100000:1.0:1789117773.192659:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572116352 00000100:00100000:1.0:1789117773.192737:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 70 00000100:00100000:1.0:1789117773.192748:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+18:11527:x1876025572116352:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1789117773.192780:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117773.192808:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be1fef9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0eed5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117773.192931:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789117773.193049:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be1fef9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eed5 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.193096:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4af900) 00010000:00010000:1.0:1789117773.193099:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789117773.193105:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be1fef9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eed5 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.193134:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70c800, rc 0) 00000100:00100000:1.0:1789117773.193222:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+19:11527:x1876025572116352:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 466us (769us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1789117773.193231:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 70 00000100:00100000:2.0:1789117773.198018:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117773.198153:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572116480 00000100:00100000:0.0:1789117773.198162:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572116480 00000100:00100000:0.0:1789117773.198229:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 71 00000100:00100000:0.0:1789117773.198239:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+19:11527:x1876025572116480:12345-192.168.204.30@tcp:34:lfs.0 00010000:00010000:0.0:1789117773.198321:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff07 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198339:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198352:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198366:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198373:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198379:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198458:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be1ff15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198467:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be1ff15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198488:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be1ff15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789117773.198540:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be1ff15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198554:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198560:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff07 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198578:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198585:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f5e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117773.198589:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198604:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff07 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198618:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:0.0:1789117773.198621:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117773.198626:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff07 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198632:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff07 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198646:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198658:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff0e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198663:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198667:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117773.198670:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198676:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198683:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff962b832d0800) 00010000:00010000:0.0:1789117773.198686:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117773.198688:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff0e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198693:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198708:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be1ff15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198714:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be1ff15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198719:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be1ff15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198724:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f5a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117773.198732:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be1ff15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198738:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be1ff15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198746:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:0.0:1789117773.198748:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117773.198751:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be1ff15 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.198756:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be1ff15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117773.198838:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+19:11527:x1876025572116480:12345-192.168.204.30@tcp:34:lfs.0 Request processed in 599us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117773.198846:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 71 00000100:00100000:3.0:1789117773.206025:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117773.206447:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572116736 00000100:00100000:1.0:1789117773.206460:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572116736 00000100:00100000:1.0:1789117773.206732:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:1.0:1789117773.206744:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+19:11527:x1876025572116736:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:1.0:1789117773.207147:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+20:11527:x1876025572116736:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 404us (1130us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1789117773.207156:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:1.0:1789117773.236011:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117773.239708:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572116992 00000100:00100000:0.0:1789117773.239738:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572116992 00000100:00100000:0.0:1789117773.239858:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 72 00000100:00100000:0.0:1789117773.239872:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1bbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+20:11530:x1876025572116992:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1789117773.239919:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117773.239947:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be1ff1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0eedc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.240049:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff23 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.240112:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.240169:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.240190:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.240199:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.240206:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.240369:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1ff31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.240381:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1ff31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.240387:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1ff31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117773.240403:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789117773.240524:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.240532:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff23 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.240540:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.240546:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117773.240557:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.240565:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff23 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.240579:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:0.0:1789117773.240582:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117773.240589:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff23 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.240612:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff23 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.240632:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.240639:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.240645:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.240651:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f5e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117773.240655:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.240661:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.240670:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff962b832d0800) 00010000:00010000:0.0:1789117773.240672:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117773.240686:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff2a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.240692:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.240748:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be1ff1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eedc expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.240763:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1ff31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eedc expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.240770:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:0.0:1789117773.240773:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117773.240776:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f4600, rc 0) 00000100:00100000:0.0:1789117773.240879:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1bbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+22:11530:x1876025572116992:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 1009us (4888us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1789117773.240888:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 72 00000100:00100000:2.0:1789117773.247048:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117773.247156:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117773.247217:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572117120 00000100:00100000:3.0:1789117773.247229:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572117120 00000100:00100000:0.0:1789117773.247270:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572117248 00000100:00100000:0.0:1789117773.247277:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572117248 00000100:00100000:3.0:1789117773.247327:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 73 00000100:00100000:0.0:1789117773.247336:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:3.0:1789117773.247343:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+23:11530:x1876025572117120:12345-192.168.204.30@tcp:54:lfs.0 00000100:00100000:0.0:1789117773.247350:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb0938450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+23:2404:x1876025572117248:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117773.247370:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117773.247402:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1ff31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eedc expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.247430:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:0.0:1789117773.247437:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789117773.247439:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ff3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.247460:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ff3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.247474:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ff3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.247521:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ff3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.247529:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ff3f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117773.247535:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb0938450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+22:2404:x1876025572117248:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 188us (377us total) trans 0 rc 0/0 00010000:00010000:3.0:1789117773.247538:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ff3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117773.247548:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 5 00010000:00010000:3.0:1789117773.247573:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117773.247579:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ff3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.247588:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ff3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.247606:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:3.0:1789117773.247609:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789117773.247613:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ff3f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.247620:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ff3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117773.247661:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+21:11530:x1876025572117120:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 324us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117773.247667:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 73 00000100:00100000:3.0:1789117773.251222:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117773.251333:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572117504 00000100:00100000:0.0:1789117773.251350:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572117504 00000100:00100000:0.0:1789117773.251441:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:0.0:1789117773.251453:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+21:11530:x1876025572117504:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:0.0:1789117773.251821:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+22:11530:x1876025572117504:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 369us (616us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789117773.251830:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:1.0:1789117773.504353:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117773.504467:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572117760 00000100:00100000:2.0:1789117773.504477:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572117760 00000100:00100000:2.0:1789117773.504595:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 74 00000100:00100000:2.0:1789117773.504606:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1bbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+22:11548:x1876025572117760:12345-192.168.204.30@tcp:101:cat.0 00010000:00010000:2.0:1789117773.504645:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117773.504668:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1ff46 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0eee3 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117773.506078:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1ff4d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117773.506100:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1ff4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117773.506125:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1ff4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117773.506139:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789117773.506286:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be1ff46 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eee3 expref: 25 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117773.506331:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1ff4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eee3 expref: 24 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117773.506340:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:2.0:1789117773.506344:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789117773.506348:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69800, rc 0) 00000100:00100000:2.0:1789117773.506447:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1bbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+24:11548:x1876025572117760:12345-192.168.204.30@tcp:101:cat.0 Request processed in 1843us (2112us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1789117773.506457:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 74 00000100:00100000:2.0:1789117773.538969:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117773.539082:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572117888 00000100:00100000:1.0:1789117773.539093:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572117888 00000100:00100000:1.0:1789117773.539174:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 75 00000100:00100000:1.0:1789117773.539187:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+24:11549:x1876025572117888:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1789117773.539221:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117773.539251:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be1ff5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0eeea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.539326:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1ff62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.539342:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1ff62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.539355:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1ff62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117773.539403:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789117773.539408:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789117773.539429:0:6519:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1ff62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.539456:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be1ff5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeea expref: 26 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.539497:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1ff62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeea expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.539506:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:1.0:1789117773.539510:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789117773.539514:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70da00, rc 0) 00000100:00100000:1.0:1789117773.539591:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+25:11549:x1876025572117888:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 407us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117773.539599:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 75 00000100:00100000:3.0:1789117773.545171:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117773.545331:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572118272 00000100:00100000:0.0:1789117773.545341:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572118272 00000100:00100000:0.0:1789117773.545406:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:0.0:1789117773.545416:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+25:11549:x1876025572118272:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:0.0:1789117773.545782:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+26:11549:x1876025572118272:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 366us (623us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1789117773.545796:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:2.0:1789117773.551031:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117773.551271:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572118400 00000100:00100000:0.0:1789117773.551285:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572118400 00000100:00100000:0.0:1789117773.551377:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:0.0:1789117773.551390:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b67c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+26:11549:x1876025572118400:12345-192.168.204.30@tcp:103:lfs.0 00010000:00010000:0.0:1789117773.551410:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789117773.551441:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be1fef2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eece expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.551472:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be1ff4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eee3 expref: 25 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.551500:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be1fde8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee88 expref: 24 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.551512:0:7470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:0.0:1789117773.551517:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117773.551603:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b67c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+23:11549:x1876025572118400:12345-192.168.204.30@tcp:103:lfs.0 Request processed in 216us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117773.551611:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:2.0:1789117773.558643:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117773.561948:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572118528 00000100:00100000:0.0:1789117773.561963:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572118528 00000100:00100000:0.0:1789117773.562035:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 76 00000100:00100000:0.0:1789117773.562046:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+23:11549:x1876025572118528:12345-192.168.204.30@tcp:58:lfs.0 00010000:00010000:0.0:1789117773.562231:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1ff69 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.562250:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1ff69 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.562264:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1ff69 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789117773.562522:0:6520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789117773.567490:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1789117773.567623:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1789117773.568423:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+23:11549:x1876025572118528:12345-192.168.204.30@tcp:58:lfs.0 Request processed in 6371us (9796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117773.568436:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 76 00000100:00100000:2.0:1789117773.622407:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117773.622813:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572118656 00000100:00100000:1.0:1789117773.622826:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572118656 00000100:00100000:1.0:1789117773.622960:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 77 00000100:00100000:1.0:1789117773.622971:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+23:11551:x1876025572118656:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1789117773.622994:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117773.623017:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be1ff70 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0eef1 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623131:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be1ff77 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623147:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be1ff77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623160:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be1ff77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623175:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1ff7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623196:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1ff7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623203:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1ff7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623292:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be1ff85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623302:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be1ff85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623308:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be1ff85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117773.623351:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789117773.623355:0:9533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789117773.623373:0:9533:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be1ff85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623384:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be1ff85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623392:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be1ff77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623399:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be1ff77 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623405:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be1ff77 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623421:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117773.623426:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be1ff77 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623434:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be1ff77 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623446:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:1.0:1789117773.623450:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117773.623455:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be1ff77 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623461:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be1ff77 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623476:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1ff7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623481:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1ff7e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623487:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1ff7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623493:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117773.623496:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1ff7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623502:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1ff7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623521:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff962b83a07900) 00010000:00010000:1.0:1789117773.623523:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117773.623526:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1ff7e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623532:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1ff7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623578:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be1ff70 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eef1 expref: 25 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623592:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be1ff85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eef1 expref: 24 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.623600:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:1.0:1789117773.623602:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789117773.623605:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70ca00, rc 0) 00000100:00100000:1.0:1789117773.623670:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+24:11551:x1876025572118656:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 701us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117773.623679:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 77 00000100:00100000:1.0:1789117773.669374:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789117773.669405:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593193856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789117773.669499:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117773.669751:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593193856 00000100:00100000:0.0:1789117773.669759:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593193856 00000100:00100000:0.0:1789117773.669814:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789117773.669824:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1bbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593193856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789117773.669865:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789117773.669925:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1bbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593193856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117773.669933:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789117773.671215:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593193856:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1789117773.733337:0:14501:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789117773.733351:0:14501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789117773.733406:0:14501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789117773.733419:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789117773.734339:0:14501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1bbed00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14501:1876025593193984:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789117773.734472:0:14501:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84b7e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789117773.747382:0:14501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1bbed00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14501:1876025593193984:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789117773.757081:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117773.757411:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572118784 00000100:00100000:3.0:1789117773.757421:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572118784 00000100:00100000:3.0:1789117773.757481:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 78 00000100:00100000:3.0:1789117773.757491:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+24:11562:x1876025572118784:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789117773.757523:0:14247:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789117773.757682:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+24:11562:x1876025572118784:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 191us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117773.757690:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 78 00000100:00100000:2.0:1789117773.767837:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117773.768007:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572118912 00000100:00100000:0.0:1789117773.768018:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572118912 00000100:00100000:0.0:1789117773.768128:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 79 00000100:00100000:0.0:1789117773.768139:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+24:11562:x1876025572118912:12345-192.168.204.30@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789117773.768218:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be1ff8c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768235:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be1ff8c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768249:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be1ff8c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768311:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff93 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768319:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff93 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768326:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff93 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768380:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768389:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768396:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117773.768447:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789117773.768451:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789117773.768464:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768475:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be1ff8c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768481:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be1ff8c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768488:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be1ff8c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768494:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f5a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117773.768498:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be1ff8c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768505:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be1ff8c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768517:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff962bbe7ec500) 00010000:00010000:0.0:1789117773.768528:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117773.768534:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be1ff8c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768540:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be1ff8c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768554:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff93 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768558:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff93 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768563:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff93 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768568:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f5e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117773.768571:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff93 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768575:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff93 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768582:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff962b832d0800) 00010000:00010000:0.0:1789117773.768604:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117773.768607:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff93 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768612:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ff93 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768628:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768640:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff9a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768646:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768651:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117773.768653:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768658:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff9a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768666:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:0.0:1789117773.768668:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117773.768670:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff9a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.768676:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ff9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117773.769330:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+24:11562:x1876025572118912:12345-192.168.204.30@tcp:34:lhsmtool_posix.0 Request processed in 1190us (1505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117773.769339:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 79 00000100:00100000:3.0:1789117773.785217:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117773.785358:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572119168 00000100:00100000:1.0:1789117773.785371:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572119168 00000100:00100000:1.0:1789117773.785447:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 80 00000100:00100000:1.0:1789117773.785461:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+24:11562:x1876025572119168:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789117773.785489:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117773.785515:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be1ffa1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0eef8 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.785674:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1ffa8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.785692:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1ffa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.785707:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1ffa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117773.785721:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789117773.785831:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1ffa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.785839:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1ffa8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.785845:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1ffa8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.785865:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117773.785869:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1ffa8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.785876:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1ffa8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.785889:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:1.0:1789117773.785892:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789117773.785897:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1ffa8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.785904:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be1ffa8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.785957:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be1ffa1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eef8 expref: 26 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.785969:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff962bbe7ec500) 00010000:00010000:1.0:1789117773.785971:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789117773.785975:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be1ffa1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eef8 expref: 26 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117773.785986:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70c800, rc 0) 00000100:00100000:1.0:1789117773.786096:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+25:11562:x1876025572119168:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 639us (893us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1789117773.786116:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 80 00010000:00010000:0.0:1789117773.798507:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117773.798665:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117773.798807:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572119296 00000100:00100000:0.0:1789117773.798817:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572119296 00000100:00100000:0.0:1789117773.798885:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 81 00000100:00100000:0.0:1789117773.798899:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1bbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+25:11562:x1876025572119296:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789117773.798949:0:6521:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789117773.799120:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1bbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+25:11562:x1876025572119296:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 224us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117773.799129:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 81 00000100:00100000:1.0:1789117773.808226:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117773.808377:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572119552 00000100:00100000:0.0:1789117773.808387:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572119552 00000100:00100000:0.0:1789117773.808457:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 82 00000100:00100000:0.0:1789117773.808471:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1bbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+25:11562:x1876025572119552:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789117773.808496:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117773.808500:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789117773.808546:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be1ff62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeea expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.808570:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:0.0:1789117773.808576:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117773.808605:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ffb6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0eeff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789117773.809301:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1789117773.809457:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ffbd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.809472:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ffbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.809484:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ffbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.810339:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be1ffb6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeff expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.810359:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ffbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeff expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.810367:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff962b832d0800) 00010000:00010000:0.0:1789117773.810370:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117773.810373:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f5e00, rc 0) 00000100:00100000:0.0:1789117773.810445:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1bbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+26:11562:x1876025572119552:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 1977us (2228us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1789117773.810454:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 82 00000100:00100000:0.0:1789117773.833945:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117773.834126:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572119808 00000100:00100000:3.0:1789117773.834137:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572119808 00000100:00100000:3.0:1789117773.834197:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 83 00000100:00100000:3.0:1789117773.834207:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+26:11562:x1876025572119808:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789117773.834270:0:14247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117773.834301:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be1ffbd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeff expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.834325:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff962b832d0800) 00010000:00010000:3.0:1789117773.834335:0:14247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789117773.834363:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ffcb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.834377:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ffcb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.834387:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ffcb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.834401:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1ffd2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x1e88e475 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.834407:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1ffd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1e88e475 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.834413:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1ffd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1e88e475 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.834465:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ffcb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.834489:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ffcb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.834497:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ffcb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.834503:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117773.834507:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ffcb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.834515:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ffcb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.834523:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:3.0:1789117773.834526:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117773.834530:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ffcb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.834536:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ffcb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.834546:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1ffd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1e88e475 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.834552:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1ffd2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1e88e475 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.834557:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1ffd2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1e88e475 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.834563:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117773.834572:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1ffd2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1e88e475 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.834579:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1ffd2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1e88e475 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.834772:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x1e88e475 (ffff962b8ebd4500) 00010000:00010000:3.0:1789117773.834775:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117773.834779:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1ffd2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x1e88e475 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.834785:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1ffd2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x1e88e475 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117773.835039:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+25:11562:x1876025572119808:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 831us (1104us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789117773.835048:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 83 00000100:00100000:1.0:1789117773.853776:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117773.858092:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572119936 00000100:00100000:0.0:1789117773.858125:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572119936 00000100:00100000:0.0:1789117773.858218:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 84 00000100:00100000:0.0:1789117773.858230:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1bbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+25:11562:x1876025572119936:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789117773.858260:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117773.858292:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be1ffd9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ef06 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.858343:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be1ffe0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.858358:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be1ffe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.858383:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be1ffe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.858520:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be1ffd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef06 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.858540:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be1ffe0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef06 expref: 26 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117773.858550:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff962b832d0200) 00010000:00010000:0.0:1789117773.858553:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789117773.858558:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f4c00, rc 0) 00000100:00100000:0.0:1789117773.859366:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1bbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+26:11562:x1876025572119936:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 1133us (5600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117773.859377:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 84 00000100:00100000:0.0:1789117773.867970:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117773.868429:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572120192 00000100:00100000:3.0:1789117773.868442:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572120192 00000100:00100000:3.0:1789117773.869838:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 85 00000100:00100000:3.0:1789117773.869859:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+26:11562:x1876025572120192:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789117773.869972:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1ffe7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.869993:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1ffe7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.870008:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1ffe7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789117773.870252:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1789117773.870278:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 426153223401ns, next at 427153217296ns, rc = 0 00000004:00010000:3.0:1789117773.870349:0:6520:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000cd36416d reply state 0000000077542694 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1ffe7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.870365:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1ffe7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.870374:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff962b832d0200) 00010000:00010000:3.0:1789117773.870377:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789117773.870382:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789117773.870531:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+28:11562:x1876025572120192:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 679us (2572us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1789117773.870539:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 85 00000100:00100000:1.0:1789117773.884578:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117773.886258:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572120320 00000100:00100000:3.0:1789117773.886274:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572120320 00000100:00100000:3.0:1789117773.886368:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 86 00000100:00100000:3.0:1789117773.886381:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1bbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+28:11562:x1876025572120320:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789117773.886411:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117773.886437:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ffee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ef0d expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.886507:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ffee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef0d expref: 29 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.886526:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ffee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef0d expref: 29 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117773.886549:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff962b832d0200) 00010000:00010000:3.0:1789117773.886552:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789117773.886566:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93000, rc 0) 00000100:00100000:3.0:1789117773.886655:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1bbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+29:11562:x1876025572120320:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 277us (2088us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117773.886663:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 86 00000100:00100000:3.0:1789117773.901768:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117773.902826:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572120448 00000100:00100000:0.0:1789117773.902842:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572120448 00000100:00100000:0.0:1789117773.902910:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:0.0:1789117773.902920:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b83c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2403:x1876025572120448:12345-192.168.204.30@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1789117773.902982:0:8434:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:0.0:1789117773.903014:0:8434:0:(genops.c:1385:class_connect()) connect: client 35e670b1-2cce-4394-8cb4-d5255c6a6a93, cookie 0xaa253ed19be1fff5 00002000:00100000:0.0:1789117773.903025:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 35e670b1-2cce-4394-8cb4-d5255c6a6a93/ffff962bc1bc3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789117773.903043:0:8434:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789117773.903165:0:8434:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789117773.903229:0:8434:0:(import.c:65:import_set_state_nolock()) ffff962bc1bc4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789117773.903314:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b83c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2403:x1876025572120448:12345-192.168.204.30@tcp:8:lhsmtool_posix.0 Request processed in 393us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117773.903323:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:2.0:1789117773.907945:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117773.908087:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572120576 00000100:00100000:0.0:1789117773.908112:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572120576 00000100:00080000:3.0:1789117773.908190:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789117773.908220:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 34 00000100:00100000:0.0:1789117773.908234:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b65a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:0:x1876025572120576:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 00000001:00080000:3.0:1789117773.911284:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:3.0:1789117773.911308:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35e670b1-2cce-4394-8cb4-d5255c6a6a93 00000100:00100000:3.0:1789117773.911521:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b65a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:0:x1876025572120576:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 Request processed in 3280us (3588us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789117773.911533:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 34 00000100:00100000:3.0:1789117773.916029:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117773.921018:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572120832 00000100:00100000:2.0:1789117773.921046:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572120832 00000100:00100000:2.0:1789117773.927368:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:2.0:1789117773.927382:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+29:11562:x1876025572120832:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789117773.928080:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+30:11562:x1876025572120832:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 696us (12062us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1789117773.928090:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:3.0:1789117773.947809:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117773.948098:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572121088 00000100:00100000:0.0:1789117773.948117:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572121088 00000100:00100000:0.0:1789117773.948179:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 87 00000100:00100000:0.0:1789117773.948190:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+30:11562:x1876025572121088:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789117773.948306:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+30:11562:x1876025572121088:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 117us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117773.948314:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 87 00000100:00100000:0.0:1789117773.968378:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117773.970318:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572121216 00000100:00100000:2.0:1789117773.970337:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572121216 00000100:00100000:2.0:1789117773.970414:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 88 00000100:00100000:2.0:1789117773.970425:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+30:11562:x1876025572121216:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117773.970452:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117773.970483:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fffc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ef14 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117773.970573:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20003 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117773.970591:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20003 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117773.970604:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20003 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117773.970672:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789117773.970702:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20003 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117773.970736:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be1fffc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef14 expref: 32 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117773.970752:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20003 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef14 expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117773.970760:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff962b832d0200) 00010000:00010000:2.0:1789117773.970763:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789117773.970767:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69400, rc 0) 00000100:00100000:2.0:1789117773.970858:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+31:11562:x1876025572121216:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 436us (2492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117773.970867:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 88 00000100:00100000:0.0:1789117773.976886:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117773.977112:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572121344 00000100:00100000:2.0:1789117773.977122:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572121344 00000100:00100000:2.0:1789117773.977179:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 35 00000100:00100000:2.0:1789117773.977188:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572121344:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117773.977207:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117773.977227:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a7250b3/0xaa253ed19be2000a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ef1b expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789117773.977251:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3c54e, blocks: 0x0 00010000:00010000:2.0:1789117773.977272:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=426s v=(0 0) 00010000:00010000:2.0:1789117773.977276:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117773.977285:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a7250b3/0xaa253ed19be2000a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef1b expref: 6 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117773.977304:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a7250b3/0xaa253ed19be2000a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef1b expref: 6 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117773.977317:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69800, rc 0) 00000100:00100000:2.0:1789117773.978115:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2407:x1876025572121344:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 911us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117773.978127:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 35 00000100:00100000:1.0:1789117773.994305:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117773.994797:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572121600 00000100:00100000:2.0:1789117773.994809:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572121600 00000100:00100000:2.0:1789117773.994895:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 89 00000100:00100000:2.0:1789117773.994905:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+31:11562:x1876025572121600:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789117773.995375:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+31:11562:x1876025572121600:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 470us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117773.995385:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 89 00000100:00100000:0.0:1789117774.011259:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117774.012125:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572121728 00000100:00100000:2.0:1789117774.012139:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572121728 00000100:00100000:2.0:1789117774.012214:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:2.0:1789117774.012225:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88570780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:11562:x1876025572121728:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117774.012246:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117774.012267:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a4322e0/0xaa253ed19be20011 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ef22 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.012303:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007a7250b3/0xaa253ed19be2000a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef1b expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.012314:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117774.012319:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117774.012325:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a4322e0/0xaa253ed19be20011 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef22 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.012374:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007a7250b3/0xaa253ed19be2000a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef1b expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.012392:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007a7250b3/0xaa253ed19be2000a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef1b expref: 7 pid: 8434 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117774.012411:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1b66d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1876025593194112:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789117774.012535:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e46780 going to sleep for 11 seconds 00000100:00100000:0.0:1789117774.027135:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117774.027437:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1b66d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1876025593194112:192.168.204.30@tcp:104: 00010000:00010000:3.0:1789117774.027474:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a4322e0/0xaa253ed19be20011 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef22 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.027497:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69e00, rc 0) 00000100:00100000:3.0:1789117774.027572:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88570780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:11562:x1876025572121728:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 15348us (16325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117774.027582:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:1.0:1789117774.029670:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572121856 00000100:00100000:1.0:1789117774.029685:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572121856 00010000:00010000:1.0:1789117774.029734:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007a7250b3/0xaa253ed19be2000a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef1b expref: 7 pid: 8434 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117774.029775:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 71 00000100:00100000:1.0:1789117774.029785:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88571680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2406:x1876025572121856:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117774.029803:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117774.029827:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007a7250b3/0xaa253ed19be2000a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef1b expref: 7 pid: 8434 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117774.029842:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007a7250b3/0xaa253ed19be2000a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef1b expref: 7 pid: 8434 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117774.029870:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a7250b3/0xaa253ed19be2000a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef1b expref: 7 pid: 8434 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117774.029886:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117774.029891:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117774.029909:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a4322e0/0xaa253ed19be20011 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef22 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117774.029919:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a4322e0/0xaa253ed19be20011 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef22 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117774.029969:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000a4322e0/0xaa253ed19be20011 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef22 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117774.029984:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1bbcf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6506:1876025593194240:192.168.204.30@tcp:105: 00000100:00100000:1.0:1789117774.030126:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84b7e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789117774.039032:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1bbcf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6506:1876025593194240:192.168.204.30@tcp:105: 00010000:00010000:1.0:1789117774.039095:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117774.039171:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88571680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572121856:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 9385us (12046us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117774.039187:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 71 00000100:00100000:0.0:1789117774.043151:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117774.043544:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572121984 00000100:00100000:1.0:1789117774.043555:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572121984 00002000:00100000:1.0:1789117774.043607:0:8442:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff962a88571a40 x1876025572121984/t0(0) o4->35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp:325/0 lens 504/0 e 0 to 0 dl 1789117785 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789117774.043618:0:8442:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962a88571a40 with x1876025572121984 ext(0->8) 00002000:00010000:1.0:1789117774.043624:0:8442:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff962a88571a40 00000100:00100000:1.0:1789117774.043652:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:1.0:1789117774.043662:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88571a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2407:x1876025572121984:12345-192.168.204.30@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789117774.048412:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88571a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2407:x1876025572121984:12345-192.168.204.30@tcp:4:lhsmtool_posix.0 Request processed in 4737us (5259us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789117774.048437:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 0 00002000:00100000:1.0:1789117774.048453:0:8442:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff962a88571a40 x1876025572121984/t4294967303(0) o4->35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp:325/0 lens 504/448 e 0 to 0 dl 1789117785 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789117774.048465:0:8442:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962a88571a40 with x1876025572121984 ext(0->8) 00002000:00010000:1.0:1789117774.048473:0:8442:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff962a88571a40 00000100:00100000:2.0:1789117774.064170:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117774.064260:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572122112 00000100:00100000:3.0:1789117774.064270:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572122112 00000100:00100000:3.0:1789117774.064357:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 90 00000100:00100000:3.0:1789117774.064370:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+31:11562:x1876025572122112:12345-192.168.204.30@tcp:44:lhsmtool_posix.0 00000100:00080000:1.0:1789117774.064646:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789117774.067213:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1789117774.067235:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1789117774.067281:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:1.0:1789117774.067453:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+16:11562:x1876025572122112:12345-192.168.204.30@tcp:44:lhsmtool_posix.0 Request processed in 3081us (3289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117774.067464:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 90 00000100:00100000:3.0:1789117774.067682:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117774.067713:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1b830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593194368:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789117774.067772:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789117774.067805:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be1fee4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.067817:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be1fee4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.067824:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be1fee4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.067830:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117774.067835:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be1fee4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.067843:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be1fee4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.067859:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:2.0:1789117774.067863:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117774.067868:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be1fee4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.067873:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be1fee4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.067892:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1ffe7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.067898:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1ffe7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.067903:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1ffe7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.067919:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117774.067923:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1ffe7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.067929:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1ffe7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.067938:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff962b832d0200) 00010000:00010000:2.0:1789117774.067941:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789117774.067944:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1ffe7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.067950:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be1ffe7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789117774.067969:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1789117774.067980:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789117774.067988:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593194368 00000100:00100000:3.0:1789117774.067997:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593194368 00000100:00100000:3.0:1789117774.068074:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789117774.068084:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b80780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593194368:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789117774.068222:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789117774.068226:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789117774 00002000:00010000:3.0:1789117774.068228:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789117774.068230:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789117774 -> 1789117774 00002000:00010000:3.0:1789117774.068232:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789117774.068266:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b80780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1876025593194368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 185us (493us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789117774.068272:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:3.0:1789117774.068314:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff962bc1b830c0/2, rc 0, transno 4294967304 00000100:00100000:3.0:1789117774.068320:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1b830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593194368:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1789117774.070947:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789117774.074251:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117774.074373:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572122240 00000100:00100000:1.0:1789117774.074383:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572122240 00000100:00100000:1.0:1789117774.074489:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 38 00000100:00100000:1.0:1789117774.074502:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2406:x1876025572122240:12345-192.168.204.30@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789117774.078566:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1789117774.078760:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1789117774.079608:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572122240:12345-192.168.204.30@tcp:16:lhsmtool_posix.0 Request processed in 5101us (5360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117774.079621:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 38 00000100:00100000:1.0:1789117774.108894:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117774.108987:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572122496 00000100:00100000:0.0:1789117774.108998:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572122496 00000100:00100000:0.0:1789117774.109093:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 91 00000100:00100000:0.0:1789117774.113848:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1bbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+14:11562:x1876025572122496:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789117774.113912:0:14247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117774.113948:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20003 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef14 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.113988:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff962b832d0200) 00010000:00010000:0.0:1789117774.113994:0:14247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117774.114027:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20018 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.114043:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20018 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.114072:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20018 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789117774.114895:0:14247:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006679ae45 reply state 0000000009f6645b transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20018 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.114913:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20018 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.114919:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff962b832d0200) 00010000:00010000:0.0:1789117774.114922:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789117774.114925:0:14247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789117774.115148:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1bbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+15:11562:x1876025572122496:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 1330us (6265us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1789117774.115158:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 91 00000100:00100000:1.0:1789117774.144304:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117774.144448:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572122624 00000100:00100000:3.0:1789117774.144462:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572122624 00000100:00100000:3.0:1789117774.144538:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:3.0:1789117774.144548:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfc05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2407:x1876025572122624:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789117774.144872:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789117774.144876:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789117774 -> 1789117773 00002000:00010000:3.0:1789117774.144879:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789117771 00002000:00010000:3.0:1789117774.144881:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789117774 -> 1789117773 00002000:00010000:3.0:1789117774.144884:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789117774.144989:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfc05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2407:x1876025572122624:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 Request processed in 441us (695us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789117774.144999:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:1.0:1789117774.162626:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117774.163227:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572122880 00000100:00100000:2.0:1789117774.163240:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572122880 00000100:00100000:2.0:1789117774.163315:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 92 00000100:00100000:2.0:1789117774.163327:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1bbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+15:11562:x1876025572122880:12345-192.168.204.30@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789117774.163408:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2001f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.163426:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be1ffe0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef06 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.163459:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2001f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.163495:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be1ffe0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef06 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.163510:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be1ffe0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef06 expref: 15 pid: 6519 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117774.163525:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1b65a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1876025593194496:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789117774.167329:0:9533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e46c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789117774.180753:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117774.180785:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572123008 00000100:00100000:0.0:1789117774.180794:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572123008 00010000:00010000:0.0:1789117774.180839:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be1ffe0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef06 expref: 16 pid: 6519 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117774.180888:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 72 00000100:00100000:0.0:1789117774.180899:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88572d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+16:2407:x1876025572123008:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117774.180916:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117774.180923:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be1ffe0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef06 expref: 16 pid: 6519 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.180936:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be1ffe0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef06 expref: 16 pid: 6519 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.180962:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff962b832d0200) 00010000:00010000:0.0:1789117774.180967:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2001f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.180977:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2001f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.180985:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2001f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.181004:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117774.181076:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88572d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+16:2407:x1876025572123008:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 179us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117774.181084:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 72 00010000:00010000:3.0:1789117774.182560:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be1ffe0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef06 expref: 15 pid: 6519 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117774.182593:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1b65a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1876025593194496:192.168.204.30@tcp:104: 00010000:00010000:3.0:1789117774.182619:0:9533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2001f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.182628:0:9533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2001f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.182635:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2001f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.182673:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2001f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.182681:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2001f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.182807:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2001f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.182814:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117774.182818:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2001f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.182825:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2001f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.182850:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff962b832d0200) 00010000:00010000:3.0:1789117774.182853:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789117774.182858:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2001f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.182865:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2001f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117774.182942:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1bbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+14:11562:x1876025572122880:12345-192.168.204.30@tcp:55:lhsmtool_posix.0 Request processed in 19616us (20337us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789117774.182952:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 92 00000100:00100000:0.0:1789117774.190508:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117774.191433:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572123136 00000100:00100000:3.0:1789117774.191445:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572123136 00000100:00100000:3.0:1789117774.191519:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 40 00000100:00100000:3.0:1789117774.191529:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88571e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2405:x1876025572123136:12345-192.168.204.30@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789117774.191588:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003ad08759/0xaa253ed19be20026 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.191609:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a4322e0/0xaa253ed19be20011 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef22 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.191619:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117774.191623:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789117774.191628:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ad08759/0xaa253ed19be20026 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.191663:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a4322e0/0xaa253ed19be20011 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef22 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.193444:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a4322e0/0xaa253ed19be20011 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef22 expref: 7 pid: 8433 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117774.193469:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1b80b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1876025593194624:192.168.204.30@tcp:104: 00000100:00100000:3.0:1789117774.193559:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4f780 going to sleep for 11 seconds 00000100:00100000:0.0:1789117774.225043:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117774.225120:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572123264 00000100:00100000:0.0:1789117774.225129:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572123264 00010000:00010000:0.0:1789117774.225185:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000a4322e0/0xaa253ed19be20011 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef22 expref: 8 pid: 8433 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117774.225220:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 73 00000100:00100000:0.0:1789117774.225230:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88572940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2406:x1876025572123264:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117774.225245:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117774.225267:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a4322e0/0xaa253ed19be20011 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef22 expref: 8 pid: 8433 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.225281:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a4322e0/0xaa253ed19be20011 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef22 expref: 8 pid: 8433 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.225310:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789117774.225315:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789117774.225321:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ad08759/0xaa253ed19be20026 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.225331:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ad08759/0xaa253ed19be20026 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.225367:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117774.225417:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88572940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2406:x1876025572123264:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 188us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117774.225424:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 73 00010000:00010000:3.0:1789117774.226130:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a4322e0/0xaa253ed19be20011 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef22 expref: 7 pid: 8433 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117774.226147:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1b80b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1876025593194624:192.168.204.30@tcp:104: 00010000:00010000:3.0:1789117774.226168:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003ad08759/0xaa253ed19be20026 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.226179:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003ad08759/0xaa253ed19be20026 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.226187:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ad08759/0xaa253ed19be20026 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.226209:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003ad08759/0xaa253ed19be20026 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.226216:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ad08759/0xaa253ed19be20026 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.226239:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ad08759/0xaa253ed19be20026 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.226246:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92200 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789117774.226250:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad08759/0xaa253ed19be20026 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.226259:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad08759/0xaa253ed19be20026 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.226274:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ad08759/0xaa253ed19be20026 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.226282:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ad08759/0xaa253ed19be20026 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117774.226358:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88571e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2405:x1876025572123136:12345-192.168.204.30@tcp:1:lhsmtool_posix.0 Request processed in 34830us (35861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117774.226366:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 40 00000100:00100000:1.0:1789117774.246773:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117774.246950:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572123520 00000100:00100000:2.0:1789117774.246969:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572123520 00000100:00100000:2.0:1789117774.247026:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 93 00000100:00100000:2.0:1789117774.247037:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+14:11562:x1876025572123520:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789117774.247153:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2002d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.247171:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fe6d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeab expref: 14 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.247181:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2002d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.247220:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fe6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeab expref: 14 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.247255:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fe6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeab expref: 14 pid: 9533 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117774.247270:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1b66d00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593194752:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789117774.247382:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e463c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117774.260176:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1b66d00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593194752:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117774.260211:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2002d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117774.261493:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117774.262259:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572123648 00000100:00100000:0.0:1789117774.262276:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572123648 00010000:00010000:0.0:1789117774.262352:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fe6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeab expref: 15 pid: 9533 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117774.262406:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 74 00000100:00100000:0.0:1789117774.262418:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1bbf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+15:2407:x1876025572123648:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117774.262435:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117774.262442:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fe6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeab expref: 15 pid: 9533 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.262454:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fe6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeab expref: 15 pid: 9533 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.262477:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be1fe6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eeab expref: 15 pid: 9533 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.262495:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:0.0:1789117774.262500:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2002d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.262510:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2002d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.262519:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2002d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.262552:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117774.262649:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1bbf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+14:2407:x1876025572123648:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 233us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117774.262659:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 74 00010000:00010000:3.0:1789117774.266183:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2002d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.266222:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2002d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.266505:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92600/0xaa253ed19be20034 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.266554:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ffee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef0d expref: 14 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.266565:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92600/0xaa253ed19be20034 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.266875:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ffee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef0d expref: 14 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.266900:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ffee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef0d expref: 14 pid: 14247 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117774.266919:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1b80b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593194880:192.168.204.30@tcp:104: 00000100:00100000:3.0:1789117774.267035:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789117774.295646:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1b80b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593194880:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117774.295681:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92600/0xaa253ed19be20034 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117774.304301:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117774.304397:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572123776 00000100:00100000:2.0:1789117774.304417:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572123776 00010000:00010000:2.0:1789117774.304698:0:7470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ffee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef0d expref: 15 pid: 14247 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117774.304753:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 75 00000100:00100000:2.0:1789117774.304767:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1bbe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+15:2406:x1876025572123776:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117774.304791:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117774.304800:0:7470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ffee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef0d expref: 15 pid: 14247 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.304819:0:7470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ffee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef0d expref: 15 pid: 14247 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.304855:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be1ffee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef0d expref: 15 pid: 14247 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.304886:0:7470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff962b832d0200) 00010000:00010000:2.0:1789117774.304894:0:7470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92600/0xaa253ed19be20034 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.304919:0:7470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92600/0xaa253ed19be20034 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.304929:0:7470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92600/0xaa253ed19be20034 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.304987:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789117774.305205:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92600/0xaa253ed19be20034 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117774.305215:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92600/0xaa253ed19be20034 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789117774.305364:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1789117774.305528:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1789117774.305639:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1bbe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+16:2406:x1876025572123776:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 873us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117774.305650:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 75 00000001:00080000:1.0:1789117774.306742:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1789117774.306890:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1bbfc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1876025593195008:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789117774.306979:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117774.307025:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86f3fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117774.307078:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593195008 00000100:00100000:1.0:1789117774.307105:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593195008 00000100:00100000:1.0:1789117774.307157:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789117774.307166:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1bbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1876025593195008:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789117774.307261:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1bbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1876025593195008:12345-0@lo:1000:mdt00_002.0 Request processed in 96us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117774.307269:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789117774.307313:0:6521:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1789117774.307321:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff962bc1b830c0, transno 4294967304 00000100:00100000:1.0:1789117774.307338:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1bbfc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1876025593195008:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789117774.307483:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1789117774.307532:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1bbfc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1876025593195136:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789117774.309853:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117774.311200:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86f3f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117774.313270:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593195136 00000100:00100000:2.0:1789117774.313291:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593195136 00000100:00100000:2.0:1789117774.313375:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789117774.313387:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1bbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1876025593195136:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789117774.313789:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1bbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6521:x1876025593195136:12345-0@lo:1000:mdt00_002.0 Request processed in 402us (3937us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789117774.313802:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789117774.313871:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1bbfc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1876025593195136:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789117774.313961:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92600/0xaa253ed19be20034 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.313972:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92600/0xaa253ed19be20034 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.313979:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92600/0xaa253ed19be20034 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.313987:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117774.313991:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92600/0xaa253ed19be20034 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.314024:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92600/0xaa253ed19be20034 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.314043:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff962b832d0200) 00010000:00010000:3.0:1789117774.314048:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789117774.314081:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92600/0xaa253ed19be20034 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.314091:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92600/0xaa253ed19be20034 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.314146:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1ff69 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.314154:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1ff69 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.314161:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1ff69 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.314169:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117774.314172:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1ff69 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.314179:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1ff69 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.314189:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:3.0:1789117774.314193:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789117774.314197:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1ff69 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.314214:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be1ff69 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.314243:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be2003b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.314257:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be1ff85 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eef1 expref: 17 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.314266:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be2003b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.314308:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be1ff85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eef1 expref: 17 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.314325:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be1ff85 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eef1 expref: 17 pid: 9533 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117774.314350:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1b83c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593195264:192.168.204.30@tcp:104: 00000100:00100000:3.0:1789117774.314469:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4f300 going to sleep for 11 seconds 00000100:00100000:1.0:1789117774.318353:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117774.318432:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1b83c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593195264:192.168.204.30@tcp:104: 00010000:00010000:1.0:1789117774.318480:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be2003b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117774.319112:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572123904 00000100:00100000:3.0:1789117774.319130:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572123904 00010000:00010000:3.0:1789117774.324823:0:9524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be1ff85 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eef1 expref: 18 pid: 9533 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117774.324896:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 76 00000100:00100000:3.0:1789117774.324920:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb0938050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+18:2406:x1876025572123904:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117774.324940:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117774.324955:0:9524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be1ff85 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eef1 expref: 18 pid: 9533 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.324971:0:9524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be1ff85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eef1 expref: 18 pid: 9533 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.325001:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be1ff85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eef1 expref: 18 pid: 9533 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.325022:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:3.0:1789117774.325028:0:9524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be2003b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.325037:0:9524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be2003b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.325045:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be2003b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.325119:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117774.325205:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb0938050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+17:2406:x1876025572123904:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 298us (6865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117774.325214:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 76 00010000:00010000:0.0:1789117774.325321:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be2003b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.325339:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be2003b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.325360:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be2003b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.325368:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be2003b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.325377:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be2003b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.325383:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117774.325389:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be2003b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.325398:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be2003b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.325415:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:0.0:1789117774.325418:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117774.325441:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be2003b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.325448:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be2003b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.325466:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2002d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.325474:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2002d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.325479:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2002d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.325485:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117774.325488:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2002d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.325494:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2002d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.325502:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24100) 00010000:00010000:0.0:1789117774.325504:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789117774.325507:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2002d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117774.325514:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be2002d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117774.325777:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+16:11562:x1876025572123520:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 78737us (79010us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1789117774.325790:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 93 00000020:00080000:0.0:1789117774.325804:0:6521:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789117774.326682:0:14501:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789117774.326692:0:14501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789117774.326713:0:14501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789117774.326719:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789117774.347474:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117774.347710:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572124160 00000100:00100000:3.0:1789117774.347724:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572124160 00000100:00100000:3.0:1789117774.347808:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:3.0:1789117774.347835:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+16:11562:x1876025572124160:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789117774.350976:0:6522:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789117774.351035:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:2.0:1789117774.351131:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be20042 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.351152:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be20042 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.351166:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be20042 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.351196:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be20042 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.351203:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be20042 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.351209:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be20042 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117774.351233:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789117774.351385:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+18:11562:x1876025572124160:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 3548us (3922us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1789117774.351397:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 20 00000020:00080000:2.0:1789117774.351405:0:6522:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789117774.351948:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117774.351963:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be20042 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117774.351974:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69e00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117774.351978:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be20042 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117774.351988:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be20042 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117774.352007:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff962b832d0200) 00010000:00010000:1.0:1789117774.352010:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789117774.352015:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be20042 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117774.352021:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be20042 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117774.352037:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117774.352039:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117774.352041:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789117774.796493:0:14913:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789117774.796505:0:14913:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789117774.796534:0:14913:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789117774.796540:0:14913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789117774.833869:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117774.998025:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117774.998251:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572124416 00000100:00100000:3.0:1789117774.998263:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572124416 00000100:00100000:3.0:1789117774.998407:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 94 00000100:00100000:3.0:1789117774.998418:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+18:11573:x1876025572124416:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1789117774.998448:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117774.998476:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20049 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ef29 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.998624:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92600/0xaa253ed19be20050 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.998643:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92600/0xaa253ed19be20050 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.998656:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92600/0xaa253ed19be20050 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117774.998668:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789117774.998784:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20049 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef29 expref: 21 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.998808:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92600/0xaa253ed19be20050 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef29 expref: 20 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117774.998816:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:3.0:1789117774.998820:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789117774.998824:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92600, rc 0) 00000100:00100000:3.0:1789117774.998896:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+20:11573:x1876025572124416:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 479us (884us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789117774.998923:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 94 00000100:00100000:1.0:1789117775.003719:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117775.003861:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572124544 00000100:00100000:2.0:1789117775.003871:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572124544 00000100:00100000:2.0:1789117775.003931:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 95 00000100:00100000:2.0:1789117775.003942:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1bbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+20:11573:x1876025572124544:12345-192.168.204.30@tcp:34:lfs.0 00010000:00010000:2.0:1789117775.004025:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be2005e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.004752:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be2005e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.004856:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be2005e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.004875:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20065 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.004883:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20065 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.004890:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20065 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.004978:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be2006c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.004986:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be2006c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.004993:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be2006c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789117775.006594:0:9533:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be2006c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.006620:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be2005e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.006628:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be2005e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.006636:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be2005e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.006673:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117775.006679:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be2005e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.006686:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be2005e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.006702:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:2.0:1789117775.006705:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117775.006710:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be2005e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.006716:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be2005e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.006733:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20065 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.006739:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20065 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.006745:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20065 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.006751:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117775.006754:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20065 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.006760:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20065 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.006913:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff962a87c24b00) 00010000:00010000:2.0:1789117775.006916:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117775.006919:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20065 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.006924:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20065 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.006945:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be2006c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.006951:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be2006c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.006957:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be2006c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.006962:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117775.006965:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be2006c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.006971:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be2006c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.006979:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962a87c24700) 00010000:00010000:2.0:1789117775.006981:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117775.006983:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be2006c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.006989:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be2006c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117775.007218:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1bbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+20:11573:x1876025572124544:12345-192.168.204.30@tcp:34:lfs.0 Request processed in 3268us (3498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117775.007231:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 95 00000100:00100000:0.0:1789117775.066851:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117775.066893:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572124800 00000100:00100000:0.0:1789117775.066901:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572124800 00000100:00100000:0.0:1789117775.066957:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 96 00000100:00100000:0.0:1789117775.066967:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88570b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+20:11576:x1876025572124800:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1789117775.066987:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117775.067010:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20073 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ef30 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.067277:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be2007a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.067293:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be2007a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.067305:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be2007a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.067319:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20081 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.067326:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20081 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.067331:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20081 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.067441:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be20088 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.067465:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be20088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.067473:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be20088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117775.067483:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789117775.067560:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be2007a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.067568:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be2007a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.067575:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be2007a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.067580:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117775.067585:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be2007a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.067592:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be2007a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.067604:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:0.0:1789117775.067607:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117775.067611:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be2007a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.067618:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be2007a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.067630:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20081 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.067642:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20081 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.067648:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20081 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.067653:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117775.069321:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20081 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.069337:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20081 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.069357:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff962b832d0600) 00010000:00010000:0.0:1789117775.069360:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117775.069364:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20081 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.069382:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20081 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.069460:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20073 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef30 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.069478:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be20088 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef30 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.069485:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962b832d0100) 00010000:00010000:0.0:1789117775.069488:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117775.069501:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f5a00, rc 0) 00000100:00100000:0.0:1789117775.069581:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88570b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+22:11576:x1876025572124800:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 2614us (2739us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1789117775.069589:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 96 00000100:00100000:0.0:1789117775.079669:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117775.080777:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572124928 00000100:00100000:2.0:1789117775.080791:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572124928 00000100:00100000:2.0:1789117775.080871:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 97 00000100:00100000:2.0:1789117775.080883:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+22:11576:x1876025572124928:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:2.0:1789117775.080970:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20096 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.080990:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20096 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.081014:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20096 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.081078:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20096 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.081094:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20096 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.081100:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20096 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.081107:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117775.081112:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20096 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.081120:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20096 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.081147:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962b832d0100) 00010000:00010000:2.0:1789117775.081150:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789117775.081156:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20096 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.081164:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20096 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117775.081278:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+22:11576:x1876025572124928:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 396us (1630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117775.081287:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 97 00000100:00100000:0.0:1789117775.086597:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117775.086905:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572125184 00000100:00100000:1.0:1789117775.086917:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572125184 00000100:00100000:1.0:1789117775.087007:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:1.0:1789117775.087020:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962baeaa7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+22:11576:x1876025572125184:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:1.0:1789117775.087310:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962baeaa7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+23:11576:x1876025572125184:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 293us (726us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1789117775.087334:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:0.0:1789117775.122740:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117775.122928:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572125440 00000100:00100000:2.0:1789117775.122938:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572125440 00000100:00100000:2.0:1789117775.123093:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 98 00000100:00100000:2.0:1789117775.123105:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88570f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+23:11104:x1876025572125440:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1789117775.123130:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117775.123149:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be2009d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ef37 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.123266:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be200a4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.123282:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be20088 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef30 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.123292:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be200a4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.123323:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be20088 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef30 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.123348:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be20088 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef30 expref: 24 pid: 6521 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117775.123363:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1b67c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1876025593195392:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789117775.123456:0:9533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e46900 going to sleep for 11 seconds 00000100:00100000:2.0:1789117775.130822:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1b67c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1876025593195392:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789117775.130862:0:9533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be200a4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117775.135488:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117775.135621:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572125568 00000100:00100000:1.0:1789117775.135633:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572125568 00010000:00010000:1.0:1789117775.135682:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be20088 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef30 expref: 25 pid: 6521 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117775.135734:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 77 00000100:00100000:1.0:1789117775.135745:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885703c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+25:2406:x1876025572125568:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117775.135761:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117775.135769:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be20088 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef30 expref: 25 pid: 6521 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.135783:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be20088 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef30 expref: 25 pid: 6521 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.135807:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be20088 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef30 expref: 25 pid: 6521 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.135825:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962b832d0100) 00010000:00010000:1.0:1789117775.135831:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be200a4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.135840:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be200a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.135849:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be200a4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.135901:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117775.135955:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885703c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+24:2406:x1876025572125568:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 213us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117775.135963:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 77 00010000:00010000:3.0:1789117775.137097:0:9533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be200a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117775.137111:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be200a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117775.137134:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789117775.137333:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be2009d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef37 expref: 25 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117775.137353:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be200a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef37 expref: 24 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117775.137363:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962b832d0100) 00010000:00010000:3.0:1789117775.137366:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789117775.137369:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69000, rc 0) 00000100:00100000:3.0:1789117775.137441:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88570f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+24:11104:x1876025572125440:12345-192.168.204.30@tcp:101:bash.0 Request processed in 14338us (14710us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1789117775.137450:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 98 00000100:00100000:0.0:1789117775.146680:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117775.146895:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572125696 00000100:00100000:1.0:1789117775.146908:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572125696 00000100:00100000:1.0:1789117775.146979:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 99 00000100:00100000:1.0:1789117775.146990:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+24:11104:x1876025572125696:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:1.0:1789117775.147017:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117775.147045:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be200b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ef3e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.147115:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be200b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.147130:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be200b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.147143:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be200b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.147277:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be200b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef3e expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.147299:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be200b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef3e expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.147308:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962b832d0100) 00010000:00010000:1.0:1789117775.147319:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789117775.147324:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70c200, rc 0) 00000100:00100000:1.0:1789117775.147394:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+25:11104:x1876025572125696:12345-192.168.204.30@tcp:101:bash.0 Request processed in 406us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117775.147401:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 99 00000100:00100000:2.0:1789117775.155391:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117775.155541:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572125952 00000100:00100000:1.0:1789117775.155551:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572125952 00000100:00100000:1.0:1789117775.155634:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 100 00000100:00100000:1.0:1789117775.155646:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+25:11104:x1876025572125952:12345-192.168.204.30@tcp:36:bash.0 00010000:00010000:1.0:1789117775.155891:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be200c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.155909:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be200c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.155921:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be200c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789117775.155960:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:1.0:1789117775.155982:0:6519:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003e8ddfcc reply state 000000002bc64922 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be200c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.155995:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be200c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.156003:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962b832d0100) 00010000:00010000:1.0:1789117775.156005:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789117775.156009:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789117775.156121:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:1.0:1789117775.156224:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+29:11104:x1876025572125952:12345-192.168.204.30@tcp:36:bash.0 Request processed in 579us (843us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789117775.156241:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 100 00000020:00080000:1.0:1789117775.156246:0:6519:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789117775.165892:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117775.166390:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572126080 00000100:00100000:3.0:1789117775.166405:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572126080 00000100:00100000:3.0:1789117775.166481:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 101 00000100:00100000:3.0:1789117775.166494:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88573840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+29:11104:x1876025572126080:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:3.0:1789117775.166533:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117775.166568:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be200c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ef45 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.167017:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be200c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef45 expref: 30 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.167038:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be200c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef45 expref: 30 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.167106:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962b832d0100) 00010000:00010000:1.0:1789117775.167110:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789117775.167117:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92a00, rc 0) 00000100:00100000:1.0:1789117775.167217:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88573840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+30:11104:x1876025572126080:12345-192.168.204.30@tcp:101:bash.0 Request processed in 724us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117775.167226:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 101 00000100:00100000:3.0:1789117775.172952:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117775.173786:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572126208 00000100:00100000:2.0:1789117775.173798:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572126208 00000100:00100000:2.0:1789117775.173880:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 41 00000100:00100000:2.0:1789117775.173892:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b80780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:11104:x1876025572126208:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1789117775.173909:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117775.173931:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cb51510/0xaa253ed19be200ce lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ef4c expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789117775.173970:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3c54d, atime: 0x6aa3c54b, ctime: 0x6aa3c54d, blocks: 0x8 00010000:00010000:2.0:1789117775.173993:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=427s v=(0 0) 00010000:00010000:2.0:1789117775.173997:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117775.174207:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cb51510/0xaa253ed19be200ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef4c expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.174227:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001cb51510/0xaa253ed19be200ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef4c expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.174258:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b68c00, rc 0) 00000100:00080000:1.0:1789117775.174381:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117775.174428:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b80780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:11104:x1876025572126208:12345-192.168.204.30@tcp:101:bash.0 Request processed in 539us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117775.174435:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 41 00000100:00100000:2.0:1789117775.182241:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117775.182363:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572126336 00000100:00100000:1.0:1789117775.182375:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572126336 00002000:00010000:1.0:1789117775.182437:0:8440:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1789117775.182442:0:8440:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962bc1b66d00 with x1876025572126336 ext(0->18446744073709551615) 00002000:00010000:1.0:1789117775.182460:0:8440:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff962bc1b66d00. 00000100:00100000:1.0:1789117775.182505:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00100000:1.0:1789117775.182517:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b66d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2407:x1876025572126336:12345-192.168.204.30@tcp:10:bash.0 00002000:00010000:1.0:1789117775.182854:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789117775.182858:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789117773 -> 1789117775 00002000:00010000:1.0:1789117775.182861:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1789117771 -> 1789117771 00002000:00010000:1.0:1789117775.182863:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789117773 -> 1789117775 00002000:00010000:1.0:1789117775.182879:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1789117775.182966:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b66d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2407:x1876025572126336:12345-192.168.204.30@tcp:10:bash.0 Request processed in 452us (739us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789117775.182977:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 1 00002000:00010000:1.0:1789117775.182981:0:8440:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1789117775.182984:0:8440:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962bc1b66d00 with x1876025572126336 ext(0->18446744073709551615) 00002000:00010000:1.0:1789117775.182989:0:8440:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff962bc1b66d00. 00000100:00100000:1.0:1789117775.323123:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117775.323273:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572126464 00000100:00100000:2.0:1789117775.323289:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572126464 00000100:00100000:2.0:1789117775.323370:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 102 00000100:00100000:2.0:1789117775.323381:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1bbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+30:11590:x1876025572126464:12345-192.168.204.30@tcp:34:lfs.0 00010000:00010000:2.0:1789117775.323473:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be200d5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323492:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be200d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323504:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be200d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323534:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be200dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323542:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be200dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323548:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be200dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323630:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be200e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323655:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be200e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323662:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be200e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789117775.323714:0:14247:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be200e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323727:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be200d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323734:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be200d5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323741:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be200d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323747:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117775.323752:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be200d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323760:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be200d5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323774:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:2.0:1789117775.323777:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117775.323783:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be200d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323788:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be200d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323811:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be200dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323818:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be200dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323823:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be200dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323828:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117775.323831:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be200dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323836:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be200dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323844:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff962a87c24900) 00010000:00010000:2.0:1789117775.323846:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117775.323849:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be200dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323854:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be200dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323867:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be200e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323873:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be200e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323878:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be200e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323888:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117775.323891:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be200e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323897:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be200e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323903:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962b832d0100) 00010000:00010000:2.0:1789117775.323906:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117775.323909:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be200e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.323915:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be200e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117775.324009:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1bbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+30:11590:x1876025572126464:12345-192.168.204.30@tcp:34:lfs.0 Request processed in 628us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117775.324018:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 102 00000100:00100000:3.0:1789117775.402561:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117775.402688:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572126720 00000100:00100000:2.0:1789117775.402698:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572126720 00000100:00100000:2.0:1789117775.402767:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 103 00000100:00100000:2.0:1789117775.402778:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+30:11593:x1876025572126720:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789117775.402799:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117775.402822:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be200ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ef53 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.402899:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be200f1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.402931:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be200f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.402948:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be200f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.402974:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be200f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.402981:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be200f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.402987:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be200f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.403141:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be200ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.403151:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be200ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.403158:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be200ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117775.403168:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789117775.403250:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be200f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.403257:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be200f1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.403263:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be200f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.403276:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117775.403282:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be200f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.403290:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be200f1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.403304:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:2.0:1789117775.403308:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117775.403314:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be200f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.403321:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be200f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.403335:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be200f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.403340:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be200f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.403346:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be200f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.403351:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117775.403354:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be200f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.403359:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be200f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.403376:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff962a87c24900) 00010000:00010000:2.0:1789117775.403378:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117775.403381:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be200f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.403387:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be200f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.403428:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be200ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef53 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.403440:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be200ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef53 expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.403448:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962b832d0100) 00010000:00010000:2.0:1789117775.403450:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789117775.403453:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69600, rc 0) 00000100:00100000:2.0:1789117775.403531:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+32:11593:x1876025572126720:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 754us (981us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789117775.403538:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 103 00000100:00100000:0.0:1789117775.416854:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117775.417232:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572126848 00000100:00100000:1.0:1789117775.417242:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572126848 00000100:00100000:1.0:1789117775.417310:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 104 00000100:00100000:1.0:1789117775.417321:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88572580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+32:11593:x1876025572126848:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:1.0:1789117775.417392:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be2010d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.417409:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be200a4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef37 expref: 32 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.417419:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be2010d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.417458:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be200a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef37 expref: 32 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.417471:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be200a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef37 expref: 32 pid: 9533 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117775.417485:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a33480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1876025593195520:192.168.204.30@tcp:104: 00000100:00100000:1.0:1789117775.417604:0:9533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86f3f900 going to sleep for 11 seconds 00000100:00100000:1.0:1789117775.420444:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a33480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1876025593195520:192.168.204.30@tcp:104: 00010000:00010000:1.0:1789117775.420484:0:9533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be2010d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117775.423409:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117775.423524:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572127104 00000100:00100000:1.0:1789117775.423535:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572127104 00000100:00100000:1.0:1789117775.423604:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:1.0:1789117775.423616:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88573c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+33:6643:x1876025572127104:12345-192.168.204.30@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789117775.424023:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88573c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+34:6643:x1876025572127104:12345-192.168.204.30@tcp:35:ldlm_bl.0 Request processed in 407us (625us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1789117775.424031:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:3.0:1789117775.440247:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117775.444280:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572127232 00000100:00100000:0.0:1789117775.444297:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572127232 00010000:00010000:0.0:1789117775.444352:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be200a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef37 expref: 34 pid: 9533 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117775.444405:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 78 00000100:00100000:0.0:1789117775.444416:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b81a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+34:2407:x1876025572127232:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117775.444433:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117775.444440:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be200a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef37 expref: 34 pid: 9533 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.444455:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be200a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef37 expref: 34 pid: 9533 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.444480:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be200a4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef37 expref: 34 pid: 9533 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.444519:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962b832d0100) 00010000:00010000:0.0:1789117775.444524:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be2010d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.444535:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be2010d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.444542:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be2010d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.444640:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117775.444725:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b81a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+33:2407:x1876025572127232:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 310us (4490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117775.444735:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 78 00010000:00010000:2.0:1789117775.450434:0:9533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be2010d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.450452:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be2010d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.450508:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be2010d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.450541:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be2010d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.450550:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be2010d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.450556:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117775.450561:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be2010d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.450569:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be2010d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.450585:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962b832d0100) 00010000:00010000:2.0:1789117775.450588:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789117775.450592:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be2010d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.450599:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be2010d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117775.450876:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88572580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+32:11593:x1876025572126848:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 33549us (34028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117775.450889:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 104 00000100:00100000:3.0:1789117775.458009:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117775.458265:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572127488 00000100:00100000:1.0:1789117775.458277:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572127488 00000100:00100000:1.0:1789117775.458347:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:1.0:1789117775.458358:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+32:11593:x1876025572127488:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:1.0:1789117775.458644:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+33:11593:x1876025572127488:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 287us (651us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789117775.458666:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:0.0:1789117775.630201:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117775.630448:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572127744 00000100:00100000:1.0:1789117775.630459:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572127744 00000100:00100000:1.0:1789117775.630529:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 105 00000100:00100000:1.0:1789117775.630540:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+33:11604:x1876025572127744:12345-192.168.204.30@tcp:101:cat.0 00010000:00010000:1.0:1789117775.630572:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117775.630593:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be20114 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ef5a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.631144:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be2011b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.631159:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be2011b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.631170:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be2011b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.631184:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be20122 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.631191:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be20122 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.631197:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be20122 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.631388:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20129 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.631398:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20129 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.631406:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20129 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117775.631417:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789117775.631496:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be2011b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.631503:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be2011b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.634875:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be2011b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.634882:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117775.634886:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be2011b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.634896:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be2011b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.634915:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:1.0:1789117775.634918:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117775.634923:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be2011b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.634930:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be2011b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.634950:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be20122 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.634957:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be20122 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.634962:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be20122 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.634967:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117775.634969:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be20122 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.634990:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be20122 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.634998:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff962b83a07900) 00010000:00010000:1.0:1789117775.635000:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117775.635003:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be20122 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.635009:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be20122 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.635129:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be20114 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef5a expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.635144:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20129 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef5a expref: 35 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.635151:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962b832d0100) 00010000:00010000:1.0:1789117775.635153:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117775.635156:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813db600, rc 0) 00000100:00100000:1.0:1789117775.635296:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+35:11604:x1876025572127744:12345-192.168.204.30@tcp:101:cat.0 Request processed in 4756us (5103us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1789117775.635305:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 105 00000100:00100000:0.0:1789117775.645588:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117775.645774:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572128000 00000100:00100000:1.0:1789117775.645787:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572128000 00000100:00100000:1.0:1789117775.645844:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:1.0:1789117775.645853:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88571680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+35:11604:x1876025572128000:12345-192.168.204.30@tcp:35:cat.0 00000100:00100000:1.0:1789117775.646223:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88571680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+36:11604:x1876025572128000:12345-192.168.204.30@tcp:35:cat.0 Request processed in 369us (647us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1789117775.646231:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:3.0:1789117775.690293:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117775.691413:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572128256 00000100:00100000:1.0:1789117775.691441:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572128256 00000100:00100000:1.0:1789117775.691533:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 106 00000100:00100000:1.0:1789117775.691558:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+36:11605:x1876025572128256:12345-192.168.204.30@tcp:36:rm.0 00010000:00010000:1.0:1789117775.691688:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1789117775.692136:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be200c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef45 expref: 36 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.692173:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20129 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef5a expref: 35 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.692191:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be200ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef53 expref: 34 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.692204:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be200b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef3e expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.692217:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962b832d0100) 00010000:00010000:1.0:1789117775.692228:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789117775.692255:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20137 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.692271:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20137 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.692295:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20137 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.692313:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be2013e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.692325:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be2013e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.692331:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be2013e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.692426:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20145 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.692434:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20145 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.692441:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20145 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789117775.693951:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1789117775.693966:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 427976911576ns, next at 428976908288ns, rc = 0 00010000:00010000:1.0:1789117775.694039:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2014c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.694085:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2014c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.694096:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2014c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.694123:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2014c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.694130:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2014c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.694135:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2014c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.694278:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789117775.694303:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20145 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.694310:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20145 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.694316:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20145 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.694322:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117775.694327:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20145 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.694334:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20145 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.694345:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962b832d0100) 00010000:00010000:1.0:1789117775.694349:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789117775.694353:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20145 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.694368:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20145 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.694386:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20137 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.694391:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20137 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.694397:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20137 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.694402:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117775.694405:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20137 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.694410:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20137 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.694417:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:1.0:1789117775.694419:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117775.694421:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20137 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.694438:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20137 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789117775.694448:0:6520:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000005eb3778 reply state 00000000e848ce5d transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be2013e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.694458:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be2013e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117775.694470:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff962b83a07900) 00010000:00010000:1.0:1789117775.694472:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789117775.694476:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789117775.694589:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+34:11605:x1876025572128256:12345-192.168.204.30@tcp:36:rm.0 Request processed in 3043us (4305us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789117775.694599:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 106 00010000:00010000:0.0:1789117775.699205:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117775.699220:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2014c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.699231:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dbe00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789117775.699235:0:9523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2014c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.699244:0:9523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2014c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.699263:0:9523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962b832d0100) 00010000:00010000:0.0:1789117775.699266:0:9523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789117775.699290:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2014c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.699297:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2014c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.699318:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117775.699320:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117775.699322:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117775.718023:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88572d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593195648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117775.718162:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117775.719103:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1b65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593195776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789117775.719158:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117775.719673:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593195648 00000100:00100000:0.0:1789117775.719682:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593195648 00000100:00100000:0.0:1789117775.719763:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593195776 00000100:00100000:0.0:1789117775.719767:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593195776 00000100:00100000:0.0:1789117775.719794:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789117775.719804:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876025593195648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789117775.719835:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117775.719886:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876025593195648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117775.719893:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789117775.719909:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789117775.719916:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b83840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593195776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789117775.719927:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117775.719955:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b83840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593195776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117775.719962:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:3.0:1789117775.720481:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789117775.720553:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1b65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593195776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789117775.720812:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88572d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593195648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117775.811862:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117775.811999:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572128512 00000100:00100000:2.0:1789117775.812010:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572128512 00000100:00100000:2.0:1789117775.812127:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 107 00000100:00100000:2.0:1789117775.812138:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88572940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+34:11611:x1876025572128512:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1789117775.812163:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117775.812200:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20153 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ef61 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.812308:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2015a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.812322:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2015a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.812336:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2015a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.812346:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be20161 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.812352:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be20161 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.812357:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be20161 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789117775.815581:0:9533:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1789117775.816207:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be20168 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117775.816225:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be20168 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117775.816238:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be20168 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117775.816275:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2015a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117775.816281:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2015a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117775.816287:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2015a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117775.816314:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117775.816319:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2015a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117775.816326:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2015a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117775.816341:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:3.0:1789117775.816345:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117775.816349:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2015a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117775.816355:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2015a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789117775.816370:0:9533:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000292224b4 reply state 000000009c929ea1 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be20161 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117775.816381:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be20161 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117775.816387:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff962b83a07900) 00010000:00010000:3.0:1789117775.816389:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789117775.816392:0:9533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789117775.816429:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20153 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef61 expref: 37 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117775.816445:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be20168 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef61 expref: 36 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117775.816464:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962bae4ae400) 00010000:00010000:3.0:1789117775.816466:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789117775.816468:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93c00, rc 0) 00000100:00100000:3.0:1789117775.816624:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88572940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+37:11611:x1876025572128512:12345-192.168.204.30@tcp:101:bash.0 Request processed in 4486us (4772us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1789117775.816633:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 107 00000100:00100000:3.0:1789117775.836405:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117775.837407:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572128640 00000100:00100000:2.0:1789117775.837424:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572128640 00000100:00100000:2.0:1789117775.837528:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 42 00000100:00100000:2.0:1789117775.837539:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2407:x1876025572128640:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1789117775.837556:0:8833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117775.837577:0:8833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a4322e0/0xaa253ed19be20176 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ef68 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789117775.837602:0:8833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789117775.837624:0:8833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1789117775.837657:0:8833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117775.837666:0:8833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a4322e0/0xaa253ed19be20176 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef68 expref: 8 pid: 8833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.837688:0:8833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000a4322e0/0xaa253ed19be20176 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef68 expref: 8 pid: 8833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117775.837703:0:8833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69e00, rc 0) 00000100:00100000:2.0:1789117775.837800:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2407:x1876025572128640:12345-192.168.204.30@tcp:101:bash.0 Request processed in 261us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117775.837808:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 42 00000100:00080000:3.0:1789117775.838098:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789117775.845340:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117775.850979:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117775.851104:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572128768 00000100:00100000:0.0:1789117775.851115:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572128768 00000100:00100000:0.0:1789117775.851182:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 43 00000100:00100000:0.0:1789117775.851193:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:11611:x1876025572128768:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:0.0:1789117775.851230:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117775.851248:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be2017d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ef6f expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.851280:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000a4322e0/0xaa253ed19be20176 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef68 expref: 9 pid: 8833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.851290:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117775.851294:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117775.851300:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be2017d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef6f expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.851334:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000a4322e0/0xaa253ed19be20176 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef68 expref: 9 pid: 8833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.851347:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000a4322e0/0xaa253ed19be20176 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef68 expref: 9 pid: 8833 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117775.851362:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a885730c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1876025593195904:192.168.204.30@tcp:104: 00000100:00100000:0.0:1789117775.851466:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b900190c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117775.853824:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a885730c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1876025593195904:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117775.853863:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be2017d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef6f expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.853885:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f4c00, rc 0) 00000100:00100000:0.0:1789117775.855093:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:11611:x1876025572128768:12345-192.168.204.30@tcp:101:bash.0 Request processed in 3865us (4087us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117775.855175:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 43 00000100:00100000:1.0:1789117775.855789:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117775.856144:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572128896 00000100:00100000:0.0:1789117775.856153:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572128896 00010000:00010000:0.0:1789117775.856211:0:9524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000a4322e0/0xaa253ed19be20176 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef68 expref: 9 pid: 8833 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117775.856250:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 79 00000100:00100000:0.0:1789117775.856261:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8ded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:2406:x1876025572128896:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117775.856277:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117775.856300:0:9524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000a4322e0/0xaa253ed19be20176 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef68 expref: 9 pid: 8833 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.856313:0:9524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000a4322e0/0xaa253ed19be20176 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef68 expref: 9 pid: 8833 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.856337:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a4322e0/0xaa253ed19be20176 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef68 expref: 9 pid: 8833 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.856354:0:9524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117775.856358:0:9524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117775.856366:0:9524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be2017d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef6f expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.856377:0:9524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be2017d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef6f expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117775.856424:0:9524:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be2017d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef6f expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117775.856438:0:9524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a885730c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9524:1876025593196032:192.168.204.30@tcp:105: 00000100:00100000:0.0:1789117775.856499:0:9524:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b900190c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117775.859466:0:9524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a885730c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9524:1876025593196032:192.168.204.30@tcp:105: 00010000:00010000:0.0:1789117775.859494:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117775.861866:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8ded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2406:x1876025572128896:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 3288us (3761us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117775.861891:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 79 00000100:00100000:0.0:1789117775.867167:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117775.867255:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572129152 00000100:00100000:1.0:1789117775.867266:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572129152 00000100:00100000:1.0:1789117775.867329:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:1.0:1789117775.867341:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+37:11611:x1876025572129152:12345-192.168.204.30@tcp:35:bash.0 00000100:00100000:1.0:1789117775.867692:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+38:11611:x1876025572129152:12345-192.168.204.30@tcp:35:bash.0 Request processed in 352us (535us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1789117775.867702:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:3.0:1789117776.012828:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117776.015522:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572129280 00000100:00100000:1.0:1789117776.015537:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572129280 00000100:00100000:1.0:1789117776.015657:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 108 00000100:00100000:1.0:1789117776.015671:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+38:11627:x1876025572129280:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1789117776.015704:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117776.015728:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20184 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ef76 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.015841:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2018b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.015857:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2018b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.015871:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2018b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117776.015924:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789117776.015928:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00080000:3.0:1789117776.018895:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:1.0:1789117776.019016:0:6519:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2018b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.019095:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20184 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef76 expref: 40 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.019122:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2018b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef76 expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.019142:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:1.0:1789117776.019145:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789117776.019149:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813dba00, rc 0) 00000100:00100000:1.0:1789117776.020210:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+39:11627:x1876025572129280:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 4536us (7385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117776.020222:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 108 00000100:00100000:0.0:1789117776.029294:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117776.029413:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572129536 00000100:00100000:1.0:1789117776.029424:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572129536 00000100:00100000:0.0:1789117776.029701:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 109 00000100:00100000:0.0:1789117776.029713:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88570780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+39:11627:x1876025572129536:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1789117776.029735:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117776.029772:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20192 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ef7d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.029902:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20199 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.029921:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20199 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.029933:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20199 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117776.029966:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789117776.030121:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20192 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef7d expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.030154:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20199 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef7d expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.030165:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962bae4ae400) 00010000:00010000:0.0:1789117776.030168:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117776.030173:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f4400, rc 0) 00000100:00100000:0.0:1789117776.030258:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88570780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+41:11627:x1876025572129536:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 548us (974us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1789117776.030267:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 109 00000100:00100000:0.0:1789117776.042649:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117776.043029:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572129792 00000100:00100000:3.0:1789117776.043040:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572129792 00000100:00100000:3.0:1789117776.043159:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 110 00000100:00100000:3.0:1789117776.043171:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88572d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+41:11627:x1876025572129792:12345-192.168.204.30@tcp:101:lfs.0 00000100:00100000:0.0:1789117776.043583:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117776.043651:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572129920 00000100:00100000:2.0:1789117776.043657:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572129920 00000100:00100000:2.0:1789117776.043713:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:2.0:1789117776.043721:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8121c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+42:2405:x1876025572129920:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117776.043735:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117776.043739:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117776.043761:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be201a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ef84 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.043873:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be201ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.043888:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be201ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.043902:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be201ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117776.043915:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789117776.044027:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20199 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef7d expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.044047:0:7470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962bae4ae400) 00010000:00010000:2.0:1789117776.044135:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117776.044205:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8121c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+42:2405:x1876025572129920:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 484us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117776.044213:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00010000:00010000:3.0:1789117776.044479:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be201a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef84 expref: 43 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.044496:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be201ae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef84 expref: 42 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.046896:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962bae4ae400) 00010000:00010000:3.0:1789117776.046906:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789117776.046911:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92a00, rc 0) 00000100:00100000:3.0:1789117776.046992:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88572d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+42:11627:x1876025572129792:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 3819us (4349us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1789117776.047001:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 110 00000100:00100000:0.0:1789117776.077022:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117776.077301:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572130048 00000100:00100000:1.0:1789117776.077311:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572130048 00000100:00100000:1.0:1789117776.077362:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 44 00000100:00100000:1.0:1789117776.077371:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2406:x1876025572130048:12345-192.168.204.30@tcp:1:lfs.0 00010000:00010000:1.0:1789117776.077415:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be201bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.077437:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be2017d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef6f expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.077447:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117776.077451:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789117776.077456:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be201bc lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.077492:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be2017d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef6f expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.077516:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be2017d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef6f expref: 8 pid: 8437 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117776.077530:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8dde00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1876025593196160:192.168.204.30@tcp:104: 00000100:00100000:1.0:1789117776.077630:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86f3f900 going to sleep for 11 seconds 00000100:00100000:1.0:1789117776.089361:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8dde00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1876025593196160:192.168.204.30@tcp:104: 00010000:00010000:1.0:1789117776.089398:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be201bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117776.092565:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117776.092913:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572130176 00000100:00100000:1.0:1789117776.092927:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572130176 00002000:00100000:1.0:1789117776.092999:0:8442:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff962bc1a483c0 x1876025572130176/t0(0) o4->35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp:327/0 lens 504/0 e 0 to 0 dl 1789117787 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789117776.093013:0:8442:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962bc1a483c0 with x1876025572130176 ext(0->8) 00010000:00010000:1.0:1789117776.093024:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be2017d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef6f expref: 9 pid: 8437 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.093042:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be2017d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef6f expref: 9 pid: 8437 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789117776.093050:0:8442:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff962bc1a483c0 00000100:00100000:1.0:1789117776.093157:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00100000:1.0:1789117776.093169:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:2407:x1876025572130176:12345-192.168.204.30@tcp:4:lfs.0 00000100:00100000:1.0:1789117776.097439:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+11:2407:x1876025572130176:12345-192.168.204.30@tcp:4:lfs.0 Request processed in 4257us (4867us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789117776.097456:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 1 00002000:00100000:1.0:1789117776.097474:0:8442:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff962bc1a483c0 x1876025572130176/t4294967303(0) o4->35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp:327/0 lens 504/448 e 0 to 0 dl 1789117787 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789117776.097486:0:8442:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962bc1a483c0 with x1876025572130176 ext(0->8) 00010000:00010000:1.0:1789117776.097509:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be2017d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef6f expref: 11 pid: 8437 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.097565:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be2017d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef6f expref: 11 pid: 8437 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789117776.097574:0:8442:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff962bc1a483c0 00000100:00100000:0.0:1789117776.109117:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117776.109405:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572130304 00000100:00100000:1.0:1789117776.109449:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572130304 00010000:00010000:1.0:1789117776.109513:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be2017d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef6f expref: 11 pid: 8437 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117776.109569:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 80 00000100:00100000:1.0:1789117776.109581:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a48b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+11:2406:x1876025572130304:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117776.109603:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789117776.109626:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789117776.109629:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789117776 00002000:00010000:1.0:1789117776.109631:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789117776 00002000:00010000:1.0:1789117776.109634:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789117776 00002000:00010000:1.0:1789117776.109636:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789117776.109643:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be2017d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef6f expref: 11 pid: 8437 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.109658:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be2017d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef6f expref: 11 pid: 8437 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.109694:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be2017d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef6f expref: 11 pid: 8437 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.109744:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789117776.109750:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789117776.109756:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be201bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.109765:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be201bc lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.109805:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117776.109870:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a48b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+10:2406:x1876025572130304:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 290us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117776.109877:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 80 00010000:00010000:3.0:1789117776.111635:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be201bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.111656:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be201bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.111697:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be201bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.111705:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be201bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.111712:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be201bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.111744:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813daa00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789117776.111749:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be201bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.111758:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be201bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.111782:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be201bc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.111790:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be201bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117776.111922:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:2406:x1876025572130048:12345-192.168.204.30@tcp:1:lfs.0 Request processed in 34546us (34909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117776.111932:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 44 00000100:00100000:0.0:1789117776.117712:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117776.117814:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572130560 00000100:00100000:1.0:1789117776.117828:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572130560 00000100:00100000:1.0:1789117776.117910:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:1.0:1789117776.117925:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962baeaa6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+42:11627:x1876025572130560:12345-192.168.204.30@tcp:35:lfs.0 00000004:00010000:1.0:1789117776.118693:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be201ae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef84 expref: 42 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789117776.122143:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1789117776.124172:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1789117776.124744:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:1.0:1789117776.124795:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be201c3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.124824:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be20168 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef61 expref: 46 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.124842:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be201c3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.124897:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be20168 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef61 expref: 46 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.124919:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be20168 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef61 expref: 46 pid: 9533 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117776.124937:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8dde00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1876025593196288:192.168.204.30@tcp:104: 00000100:00100000:1.0:1789117776.125038:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86f3f900 going to sleep for 11 seconds 00000100:00100000:1.0:1789117776.133896:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117776.134017:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8dde00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1876025593196288:192.168.204.30@tcp:104: 00010000:00010000:3.0:1789117776.134048:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be201c3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117776.134337:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572130688 00000100:00100000:0.0:1789117776.134347:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572130688 00010000:00010000:0.0:1789117776.134403:0:9524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be20168 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef61 expref: 47 pid: 9533 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117776.134444:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 81 00000100:00100000:0.0:1789117776.134454:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+47:2406:x1876025572130688:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117776.134490:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117776.134507:0:9524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be20168 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef61 expref: 47 pid: 9533 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.134521:0:9524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be20168 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef61 expref: 47 pid: 9533 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.134701:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be20168 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef61 expref: 47 pid: 9533 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.134720:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962bae4ae400) 00010000:00010000:0.0:1789117776.134725:0:9524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be201c3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.134735:0:9524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be201c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.134742:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be201c3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.134771:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117776.134835:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+46:2406:x1876025572130688:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 382us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117776.134843:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 81 00010000:00010000:3.0:1789117776.134913:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be201c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.134921:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be201c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789117776.135106:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1789117776.135265:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1789117776.135366:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1b830c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876025593196416:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789117776.135428:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117776.135533:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117776.137726:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593196416 00000100:00100000:2.0:1789117776.137740:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593196416 00000100:00100000:2.0:1789117776.137876:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789117776.137899:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6523:x1876025593196416:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789117776.138050:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6523:x1876025593196416:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 153us (2621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117776.138087:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789117776.138202:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1b830c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876025593196416:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789117776.138373:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1789117776.138455:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1b830c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876025593196544:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789117776.138514:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117776.139443:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4f900 going to sleep for 11 seconds 00000100:00100000:1.0:1789117776.139673:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593196544 00000100:00100000:1.0:1789117776.139683:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593196544 00000100:00100000:0.0:1789117776.139983:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789117776.139996:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6523:x1876025593196544:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789117776.141384:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6523:x1876025593196544:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1384us (2875us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789117776.141408:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789117776.141533:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1b830c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876025593196544:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789117776.141631:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1789117776.141681:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be201c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.141692:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be201c3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.141699:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be201c3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.141706:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117776.141709:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be201c3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.141718:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be201c3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.141748:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962bae4ae400) 00010000:00010000:3.0:1789117776.141750:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789117776.141755:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be201c3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.141761:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be201c3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789117776.141882:0:6523:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789117776.141942:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1789117776.141976:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 428424919499ns, next at 429424894789ns, rc = 0 00000001:00080000:3.0:1789117776.141985:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1789117776.142012:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962bae4ae400) 00010000:00010000:3.0:1789117776.142015:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789117776.142021:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be201ae lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef84 expref: 50 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117776.142161:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962baeaa6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+49:11627:x1876025572130560:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 24239us (24464us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1789117776.142171:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 26 00000020:00080000:3.0:1789117776.142174:0:6523:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000001:00080000:2.0:1789117776.146811:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1789117776.146830:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1789117776.148258:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117776.148418:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572130816 00000100:00100000:0.0:1789117776.148429:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572130816 00000100:00100000:0.0:1789117776.148501:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 111 00000100:00100000:0.0:1789117776.148512:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+49:11627:x1876025572130816:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1789117776.148539:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117776.148573:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be201ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ef8b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.148641:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be201ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef8b expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.148655:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be201ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef8b expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.148675:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:0.0:1789117776.148678:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789117776.148682:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f5a00, rc 0) 00000100:00100000:0.0:1789117776.148891:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+50:11627:x1876025572130816:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 379us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117776.148899:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 111 00000100:00100000:1.0:1789117776.152715:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117776.153187:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572131072 00000100:00100000:3.0:1789117776.153277:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572131072 00000100:00100000:3.0:1789117776.153395:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00100000:3.0:1789117776.153405:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+50:11627:x1876025572131072:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:3.0:1789117776.153665:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+51:11627:x1876025572131072:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 261us (958us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1789117776.153691:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00100000:3.0:1789117776.230768:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1b65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593196672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789117776.230849:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117776.231168:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593196672 00000100:00100000:2.0:1789117776.231176:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593196672 00000100:00100000:2.0:1789117776.231231:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789117776.231241:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593196672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789117776.231275:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1789117776.231329:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593196672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117776.231337:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789117776.231605:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593197056:0@lo:400:kworker.0 00000100:00100000:1.0:1789117776.231639:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117776.231661:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88626940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876025593197568:0@lo:400:kworker.0 00000100:00100000:1.0:1789117776.231682:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117776.231706:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789117776.231711:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593196928:0@lo:400:kworker.0 00000100:00100000:1.0:1789117776.231734:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117776.231914:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593196800:0@lo:400:kworker.0 00000100:00100000:0.0:1789117776.231950:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117776.231974:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593197312:0@lo:400:kworker.0 00000100:00100000:0.0:1789117776.232003:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593196800 00000100:00100000:0.0:1789117776.232020:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593196800 00000100:00100000:0.0:1789117776.232093:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:0.0:1789117776.232102:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593196800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117776.232142:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593196800:12345-0@lo:400:kworker.0 Request processed in 43us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117776.232148:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:1.0:1789117776.232245:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a886261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876025593197440:0@lo:400:kworker.0 00000100:00100000:1.0:1789117776.232271:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117776.234542:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593197184:0@lo:400:kworker.0 00000100:00100000:3.0:1789117776.234647:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117776.234703:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593197696:0@lo:400:kworker.0 00000100:00100000:2.0:1789117776.235976:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593197184 00000100:00100000:2.0:1789117776.235992:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593197184 00000100:00100000:2.0:1789117776.236112:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789117776.236122:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593197184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117776.236208:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593197184:12345-0@lo:400:kworker.0 Request processed in 88us (1561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117776.236215:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789117776.240144:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117776.240462:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593197056 00000100:00100000:2.0:1789117776.240474:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593197056 00000100:00100000:2.0:1789117776.240559:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593197568 00000100:00100000:2.0:1789117776.240563:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593197568 00000100:00100000:2.0:1789117776.240597:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593196928 00000100:00100000:2.0:1789117776.240601:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593196928 00000100:00100000:2.0:1789117776.240613:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593197440 00000100:00100000:2.0:1789117776.240629:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593197440 00000100:00100000:2.0:1789117776.240652:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1789117776.240662:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf776940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593197056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117776.241198:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf776940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593197056:12345-0@lo:400:kworker.0 Request processed in 536us (9556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117776.241207:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1789117776.241229:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1789117776.241237:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876025593197568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117776.241283:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876025593197568:12345-0@lo:400:kworker.0 Request processed in 48us (9599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117776.241290:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1789117776.241303:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1789117776.241308:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593196928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117776.241340:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593196928:12345-0@lo:400:kworker.0 Request processed in 32us (9606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117776.241346:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1789117776.241359:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1789117776.241366:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876025593197440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117776.241394:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876025593197440:12345-0@lo:400:kworker.0 Request processed in 30us (9123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117776.241401:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1789117776.242669:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117776.242699:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf775a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593197824:0@lo:400:kworker.0 00000100:00100000:1.0:1789117776.242807:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1b65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593196672:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117776.242852:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593197184:0@lo:400:kworker.0 00010000:00080000:1.0:1789117776.242930:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a886261c0 x1876025593197440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117776.242942:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a886261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876025593197440:0@lo:400:kworker.0 00000100:00100000:1.0:1789117776.242949:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf775680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593197952:0@lo:400:kworker.0 00000100:00100000:2.0:1789117776.243145:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593197696 00000100:00100000:2.0:1789117776.243151:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593197696 00000100:00100000:2.0:1789117776.243192:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593197312 00000100:00100000:2.0:1789117776.243196:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593197312 00000100:00100000:2.0:1789117776.243217:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1789117776.243224:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593197696:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789117776.243651:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789117776.243656:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117776.243668:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1789117776.243680:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593197312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117776.243961:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117776.244024:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593196800:0@lo:400:kworker.0 00000100:00100000:0.0:1789117776.244079:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593197824 00000100:00100000:0.0:1789117776.244235:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593197824 00000100:00100000:0.0:1789117776.244294:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789117776.244301:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593197824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117776.244348:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593197824:12345-0@lo:400:kworker.0 Request processed in 48us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117776.244355:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:0.0:1789117776.244374:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789117776.244394:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf775a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593197824:0@lo:400:kworker.0 00000100:00100000:1.0:1789117776.246188:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117776.246321:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593197056:0@lo:400:kworker.0 00000100:00100000:1.0:1789117776.246339:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88626940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876025593197568:0@lo:400:kworker.0 00000100:00100000:1.0:1789117776.246365:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593196928:0@lo:400:kworker.0 00000100:00100000:0.0:1789117776.247698:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593197952 00000100:00100000:0.0:1789117776.247708:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593197952 00000100:00100000:2.0:1789117776.247841:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593197696:12345-0@lo:400:kworker.0 Request processed in 4614us (7705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117776.247850:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00010000:00080000:1.0:1789117776.249491:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a88627c00 x1876025593197696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117776.249519:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88627c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593197696:0@lo:400:kworker.0 00000100:00100000:0.0:1789117776.251133:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789117776.251147:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1876025593197952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117776.251248:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1876025593197952:12345-0@lo:400:kworker.0 Request processed in 105us (5066us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117776.251327:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789117776.251395:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf775680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593197952:0@lo:400:kworker.0 00000100:00100000:3.0:1789117776.251526:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593197312:12345-0@lo:400:kworker.0 Request processed in 7847us (8855us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117776.251548:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1789117776.253292:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593197312:0@lo:400:kworker.0 00000100:00080000:1.0:1789117776.253463:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789117776.291799:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117776.291944:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572131200 00000100:00100000:0.0:1789117776.291954:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572131200 00000100:00100000:0.0:1789117776.292019:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 112 00000100:00100000:0.0:1789117776.292029:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+51:11637:x1876025572131200:12345-192.168.204.30@tcp:34:lfs.0 00010000:00010000:0.0:1789117776.292169:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be201d1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292191:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be201d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292204:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be201d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292217:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be201d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292225:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be201d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292231:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be201d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292312:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be201df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292319:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be201df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292325:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be201df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789117776.292388:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be201df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292401:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be201d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292408:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be201d1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292415:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be201d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292421:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f5e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117776.292425:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be201d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292432:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be201d1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292444:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:0.0:1789117776.292447:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117776.292451:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be201d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292457:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be201d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292470:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be201d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292477:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be201d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292487:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be201d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292492:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117776.292495:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be201d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292501:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be201d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292507:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff962b83a07900) 00010000:00010000:0.0:1789117776.292509:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117776.292512:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be201d8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292517:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be201d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292526:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be201df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292531:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be201df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292598:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be201df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292603:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117776.292606:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be201df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292621:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be201df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292629:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:0.0:1789117776.292632:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117776.292635:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be201df lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.292641:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be201df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117776.292703:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+51:11637:x1876025572131200:12345-192.168.204.30@tcp:34:lfs.0 Request processed in 675us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117776.292711:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 112 00000100:00100000:1.0:1789117776.339291:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117776.339418:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572131456 00000100:00100000:2.0:1789117776.339431:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572131456 00000100:00100000:2.0:1789117776.339522:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 113 00000100:00100000:2.0:1789117776.339541:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+51:11640:x1876025572131456:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789117776.339563:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117776.339594:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be201e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ef92 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.339686:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be201ed lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.339703:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be201ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.339716:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be201ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.339727:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be201f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.339734:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be201f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.339741:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be201f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.339867:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be201fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.339893:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be201fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.339901:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be201fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117776.339914:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789117776.340032:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be201ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.340039:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be201ed lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.340045:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be201ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.340051:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117776.340303:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be201ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.340311:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be201ed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.340325:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:2.0:1789117776.340328:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117776.342135:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be201ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.342149:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be201ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.342173:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be201f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.342199:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be201f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.342205:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be201f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.342211:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117776.342215:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be201f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.342221:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be201f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.342234:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff962b83a07900) 00010000:00010000:2.0:1789117776.342237:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117776.342240:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be201f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.342245:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be201f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.342301:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be201e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef92 expref: 54 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.342316:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be201fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef92 expref: 53 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.342322:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:2.0:1789117776.342325:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789117776.342334:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69000, rc 0) 00000100:00100000:2.0:1789117776.342406:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+53:11640:x1876025572131456:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 2873us (3130us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1789117776.342415:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 113 00000100:00100000:2.0:1789117776.348038:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117776.348189:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572131584 00000100:00100000:3.0:1789117776.348198:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572131584 00000100:00100000:3.0:1789117776.348252:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 114 00000100:00100000:3.0:1789117776.348260:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+53:11640:x1876025572131584:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:3.0:1789117776.348323:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20209 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.348340:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20209 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.348351:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20209 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.348402:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20209 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.348409:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20209 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.348416:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20209 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.348422:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117776.348426:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20209 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.348433:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20209 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.348445:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:3.0:1789117776.348448:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789117776.348452:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20209 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.348458:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20209 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117776.348552:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+53:11640:x1876025572131584:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 291us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117776.348560:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 114 00000100:00100000:0.0:1789117776.359569:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117776.359641:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572131840 00000100:00100000:2.0:1789117776.359651:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572131840 00000100:00100000:2.0:1789117776.359712:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00100000:2.0:1789117776.359722:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+53:11640:x1876025572131840:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:2.0:1789117776.359992:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+54:11640:x1876025572131840:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 270us (497us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1789117776.360000:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00100000:1.0:1789117776.493760:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117776.494000:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572132096 00000100:00100000:2.0:1789117776.494015:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572132096 00000100:00100000:2.0:1789117776.494133:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 115 00000100:00100000:2.0:1789117776.494145:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+54:11650:x1876025572132096:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1789117776.494177:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117776.494183:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789117776.494224:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2018b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef76 expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.494252:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:2.0:1789117776.494259:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117776.494278:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20210 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0ef99 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.494420:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20217 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.494451:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20217 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.494462:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20217 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117776.494475:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789117776.494939:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20210 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef99 expref: 56 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.494962:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20217 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef99 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.494971:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:2.0:1789117776.494974:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789117776.494977:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69600, rc 0) 00000100:00100000:2.0:1789117776.495160:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+55:11650:x1876025572132096:12345-192.168.204.30@tcp:101:bash.0 Request processed in 1016us (1427us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789117776.495169:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 115 00000100:00100000:2.0:1789117776.504404:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117776.504554:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117776.504637:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572132352 00000100:00100000:0.0:1789117776.504649:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572132352 00000100:00100000:0.0:1789117776.504751:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:0.0:1789117776.504763:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb093a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+55:2404:x1876025572132352:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117776.504781:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117776.504814:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20217 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef99 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.504838:0:7470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:0.0:1789117776.504846:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117776.504928:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb093a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+54:2404:x1876025572132352:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 167us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117776.504954:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:1.0:1789117776.513985:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572132224 00000100:00100000:1.0:1789117776.514002:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572132224 00000100:00100000:1.0:1789117776.514301:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 116 00000100:00100000:1.0:1789117776.514314:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+54:11650:x1876025572132224:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:1.0:1789117776.514344:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117776.514386:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20225 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0efa0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.514425:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2022c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.514440:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2022c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.514451:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2022c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.514592:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20225 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efa0 expref: 56 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.514613:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2022c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efa0 expref: 55 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.514622:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:1.0:1789117776.514625:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789117776.514629:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813dba00, rc 0) 00000100:00100000:1.0:1789117776.514706:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+55:11650:x1876025572132224:12345-192.168.204.30@tcp:101:bash.0 Request processed in 395us (10316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117776.514713:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 116 00000100:00100000:2.0:1789117776.528431:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117776.528711:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572132608 00000100:00100000:0.0:1789117776.528723:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572132608 00000100:00100000:0.0:1789117776.528911:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 117 00000100:00100000:0.0:1789117776.528935:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+55:11650:x1876025572132608:12345-192.168.204.30@tcp:36:bash.0 00010000:00010000:0.0:1789117776.528995:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117776.529026:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be201fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef92 expref: 55 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.529047:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:0.0:1789117776.529086:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117776.529275:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20233 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.529289:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20233 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.529299:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20233 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789117776.529340:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:0.0:1789117776.529364:0:6520:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000036e47b7b reply state 000000008dd72194 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20233 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.529375:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20233 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.529381:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:0.0:1789117776.529383:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789117776.529399:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789117776.529517:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+57:11650:x1876025572132608:12345-192.168.204.30@tcp:36:bash.0 Request processed in 588us (1087us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1789117776.529525:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 117 00000020:00080000:0.0:1789117776.529539:0:6520:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789117776.534938:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117776.543321:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572132736 00000100:00100000:2.0:1789117776.543335:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572132736 00000100:00100000:2.0:1789117776.543409:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 118 00000100:00100000:2.0:1789117776.543418:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+57:11650:x1876025572132736:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1789117776.543440:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117776.543472:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be2023a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0efa7 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.543603:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be20241 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.543619:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be20241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.543630:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be20241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117776.544098:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789117776.544104:0:14247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789117776.544130:0:14247:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be20241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.544163:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be2023a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efa7 expref: 59 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.544182:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be20241 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efa7 expref: 58 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.544192:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:2.0:1789117776.544195:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789117776.544200:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69800, rc 0) 00000100:00100000:2.0:1789117776.544275:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+58:11650:x1876025572132736:12345-192.168.204.30@tcp:101:bash.0 Request processed in 856us (9357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117776.544284:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 118 00000100:00100000:3.0:1789117776.556194:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117776.556554:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572132992 00000100:00100000:2.0:1789117776.556586:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572132992 00000100:00100000:2.0:1789117776.556654:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00100000:2.0:1789117776.556664:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+58:11650:x1876025572132992:12345-192.168.204.30@tcp:35:bash.0 00000100:00100000:2.0:1789117776.557363:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+59:11650:x1876025572132992:12345-192.168.204.30@tcp:35:bash.0 Request processed in 696us (1178us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1789117776.557373:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00100000:3.0:1789117776.647832:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117776.648121:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572133120 00000100:00100000:1.0:1789117776.648135:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572133120 00000100:00100000:1.0:1789117776.648217:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 119 00000100:00100000:1.0:1789117776.648231:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+59:11656:x1876025572133120:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1789117776.648267:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117776.648305:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20248 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0efae expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.648399:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be2024f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.648417:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be2024f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.648431:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be2024f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117776.648494:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789117776.648499:0:9533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789117776.648524:0:9533:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be2024f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.648570:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20248 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efae expref: 61 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.648595:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be2024f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efae expref: 60 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.648606:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:1.0:1789117776.648609:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789117776.648614:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813db400, rc 0) 00000100:00100000:1.0:1789117776.648696:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+60:11656:x1876025572133120:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 468us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117776.648704:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 119 00000100:00100000:1.0:1789117776.654954:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117776.655215:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572133248 00000100:00100000:2.0:1789117776.655228:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572133248 00000100:00100000:3.0:1789117776.655412:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 120 00000100:00100000:3.0:1789117776.655426:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88627c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+60:11656:x1876025572133248:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1789117776.655455:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117776.655480:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20256 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0efb5 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.655584:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be2025d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.655601:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be2025d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.655614:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be2025d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.655626:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20264 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.655634:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20264 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.655640:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20264 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.655733:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be2026b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.655742:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be2026b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.655749:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be2026b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117776.655878:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789117776.655884:0:14247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789117776.655909:0:14247:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be2026b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.655925:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be2026b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.655935:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be2025d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.655942:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be2025d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.655949:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be2025d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.655956:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117776.655960:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be2025d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.655969:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be2025d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.655984:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:3.0:1789117776.655988:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117776.655993:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be2025d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.656000:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be2025d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.656026:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20264 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.656033:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20264 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.656039:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20264 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.656045:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117776.656048:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20264 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.656170:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20264 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.656180:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff962b83a07900) 00010000:00010000:3.0:1789117776.656183:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117776.656186:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20264 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.656193:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20264 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.656231:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20256 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efb5 expref: 62 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.656246:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be2026b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efb5 expref: 61 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.656266:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:3.0:1789117776.656268:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789117776.656272:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93000, rc 0) 00000100:00100000:3.0:1789117776.656373:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88627c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+61:11656:x1876025572133248:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 949us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117776.656382:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 120 00000100:00100000:0.0:1789117776.660977:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117776.661181:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117776.662047:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572133504 00000100:00100000:2.0:1789117776.662102:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572133504 00000100:00100000:1.0:1789117776.662252:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572133632 00000100:00100000:1.0:1789117776.662259:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572133632 00000100:00100000:1.0:1789117776.662350:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:1.0:1789117776.662363:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a48b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+62:2404:x1876025572133632:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117776.662384:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789117776.662598:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 121 00000100:00100000:2.0:1789117776.662607:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8121c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+62:11656:x1876025572133504:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789117776.662630:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117776.662653:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20272 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0efbc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.662735:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be2026b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efb5 expref: 63 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.662755:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:1.0:1789117776.662761:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117776.662791:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20279 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.662805:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be20241 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efa7 expref: 62 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.662814:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20279 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117776.662840:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a48b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+62:2404:x1876025572133632:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 480us (1659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117776.662847:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 9 00010000:00010000:2.0:1789117776.662882:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be20241 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efa7 expref: 61 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.662899:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be20241 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efa7 expref: 61 pid: 14247 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117776.662924:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593198080:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789117776.663007:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e46840 going to sleep for 11 seconds 00000100:00100000:3.0:1789117776.670892:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117776.672232:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593198080:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117776.672271:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20279 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117776.672306:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572133760 00000100:00100000:1.0:1789117776.672319:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572133760 00010000:00010000:1.0:1789117776.672374:0:9524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be20241 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efa7 expref: 62 pid: 14247 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117776.672432:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 82 00000100:00100000:1.0:1789117776.672445:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88573c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+62:2407:x1876025572133760:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117776.672465:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117776.672473:0:9524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be20241 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efa7 expref: 62 pid: 14247 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.672488:0:9524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be20241 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efa7 expref: 62 pid: 14247 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.672546:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be20241 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efa7 expref: 62 pid: 14247 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.672566:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:1.0:1789117776.672572:0:9524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20279 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.672585:0:9524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20279 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.672595:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20279 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117776.672634:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117776.672708:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88573c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+61:2407:x1876025572133760:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 265us (1832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117776.672717:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 82 00010000:00010000:3.0:1789117776.673568:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20279 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.673582:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20279 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117776.673613:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789117776.673836:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20272 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efbc expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.673858:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20279 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efbc expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117776.673867:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:3.0:1789117776.673870:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789117776.673874:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69000, rc 0) 00000100:00100000:3.0:1789117776.674292:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8121c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+61:11656:x1876025572133504:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 11684us (13336us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1789117776.674301:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 121 00000100:00100000:3.0:1789117776.688796:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117776.689371:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572134016 00000100:00100000:2.0:1789117776.689385:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572134016 00000100:00100000:2.0:1789117776.689507:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:2.0:1789117776.689521:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88571680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+61:11656:x1876025572134016:12345-192.168.204.30@tcp:103:lfs.0 00010000:00010000:2.0:1789117776.689550:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117776.689604:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be201ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef8b expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.689637:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:2.0:1789117776.689644:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117776.689725:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88571680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+60:11656:x1876025572134016:12345-192.168.204.30@tcp:103:lfs.0 Request processed in 207us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117776.689734:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:3.0:1789117776.695756:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117776.696634:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572134144 00000100:00100000:0.0:1789117776.696648:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572134144 00000100:00100000:0.0:1789117776.696725:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 122 00000100:00100000:0.0:1789117776.696736:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+60:11656:x1876025572134144:12345-192.168.204.30@tcp:58:lfs.0 00010000:00010000:0.0:1789117776.696852:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20287 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.696872:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20287 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117776.696885:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20287 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789117776.696984:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1789117776.697514:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+60:11656:x1876025572134144:12345-192.168.204.30@tcp:58:lfs.0 Request processed in 777us (1765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117776.697523:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 122 00000100:00100000:1.0:1789117776.709264:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117776.710743:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572134272 00000100:00100000:3.0:1789117776.710757:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572134272 00000100:00100000:2.0:1789117776.710957:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 123 00000100:00100000:2.0:1789117776.710967:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88626940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+60:11656:x1876025572134272:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789117776.710988:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117776.711009:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be2028e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0efc3 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.711210:0:14247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20287 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.711222:0:14247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be2028e lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efc3 expref: 61 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.711256:0:14247:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20287 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.711270:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be2028e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efc3 expref: 61 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.711284:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:2.0:1789117776.711287:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789117776.711291:0:14247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be2028e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efc3 expref: 61 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117776.711300:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69e00, rc 0) 00000100:00100000:2.0:1789117776.711418:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88626940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+61:11656:x1876025572134272:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 451us (2173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117776.711426:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 123 00000004:00080000:1.0:1789117776.741900:0:9922:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 429024842733ns, next at 430024839996ns, rc = 0 00000100:00100000:2.0:1789117776.743164:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a886261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593198208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117776.743244:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117776.743467:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593198208 00000100:00100000:1.0:1789117776.743475:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593198208 00000100:00100000:1.0:1789117776.743590:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789117776.743602:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876025593198208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789117776.743632:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117776.743677:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876025593198208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117776.743684:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789117776.743980:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789117776.743990:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593198336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789117776.744030:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117776.744092:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593198336 00000100:00100000:0.0:1789117776.744096:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593198336 00000100:00100000:0.0:1789117776.744124:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789117776.744130:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593198336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789117776.744140:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117776.744166:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593198336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117776.744171:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789117776.744208:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593198336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789117776.744382:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a886261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593198208:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789117776.870797:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789117777.383093:0:14501:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789117777.383104:0:14501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789117777.383138:0:14501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1789117777.383151:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789117777.383316:0:14501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a886261c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14501:1876025593198464:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789117777.383453:0:14501:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86f3f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117777.401730:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117777.401847:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572134400 00000100:00100000:0.0:1789117777.401861:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572134400 00000100:00100000:0.0:1789117777.401949:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 124 00000100:00100000:0.0:1789117777.401963:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88679680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+62:11657:x1876025572134400:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789117777.402023:0:6521:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789117777.402128:0:14501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a886261c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14501:1876025593198464:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789117777.402192:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88679680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+61:11657:x1876025572134400:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 233us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117777.402200:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 124 00000100:00100000:3.0:1789117777.418091:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117777.421495:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572134528 00000100:00100000:0.0:1789117777.421515:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572134528 00000100:00100000:0.0:1789117777.421606:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 125 00000100:00100000:0.0:1789117777.421618:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a886261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+61:11657:x1876025572134528:12345-192.168.204.30@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789117777.421743:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20295 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.421792:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20295 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.421809:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20295 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.421832:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2029c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.421840:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2029c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.421847:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2029c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.421877:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be202a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.421887:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be202a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.421893:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be202a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117777.421944:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789117777.421948:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789117777.421963:0:6519:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be202a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.421975:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20295 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.421993:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20295 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.422000:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20295 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.422007:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117777.422013:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20295 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.422021:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20295 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.422046:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff962bbe7ec500) 00010000:00010000:0.0:1789117777.422049:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117777.422092:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20295 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.422100:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20295 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.422118:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2029c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.422123:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2029c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.422129:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2029c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.422134:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f5a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117777.422143:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2029c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.422149:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2029c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.422157:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff962b832d0700) 00010000:00010000:0.0:1789117777.422160:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117777.422163:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2029c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.422701:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2029c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.422765:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be202a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.422771:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be202a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.422777:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be202a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.422781:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f5e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117777.422785:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be202a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.422791:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be202a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.422799:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:0.0:1789117777.422802:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117777.422817:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be202a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.422823:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be202a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117777.423010:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a886261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+61:11657:x1876025572134528:12345-192.168.204.30@tcp:34:lhsmtool_posix.0 Request processed in 1388us (4974us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117777.423022:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 125 00000100:00100000:1.0:1789117777.432582:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117777.432671:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572134784 00000100:00100000:2.0:1789117777.432681:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572134784 00000100:00100000:2.0:1789117777.432740:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 126 00000100:00100000:2.0:1789117777.432750:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88679a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+61:11657:x1876025572134784:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117777.432772:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117777.432793:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be202aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0efca expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.432919:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be202b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.432941:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be202b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.432970:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be202b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117777.432984:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789117777.433107:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be202b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.433115:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be202b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.433122:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be202b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.433127:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117777.433132:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be202b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.433139:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be202b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.433151:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:2.0:1789117777.433154:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789117777.433160:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be202b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.433177:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be202b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.433222:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be202aa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efca expref: 63 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.433239:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff962bbe7ec500) 00010000:00010000:2.0:1789117777.433241:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789117777.433245:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be202aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efca expref: 63 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.433254:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69400, rc 0) 00000100:00100000:2.0:1789117777.433325:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88679a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+62:11657:x1876025572134784:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 576us (754us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1789117777.433333:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 126 00000100:00100000:1.0:1789117777.443710:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117777.445952:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572134912 00000100:00100000:2.0:1789117777.445978:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572134912 00000100:00100000:2.0:1789117777.446106:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 127 00000100:00100000:2.0:1789117777.446120:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8867ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+62:11657:x1876025572134912:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789117777.446174:0:6520:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789117777.446373:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8867ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+62:11657:x1876025572134912:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 253us (2675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117777.446383:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 127 00000100:00100000:3.0:1789117777.451045:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117777.453964:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572135168 00000100:00100000:0.0:1789117777.453987:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572135168 00000100:00100000:0.0:1789117777.454134:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 128 00000100:00100000:0.0:1789117777.454148:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+62:11657:x1876025572135168:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789117777.454179:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117777.454184:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789117777.454218:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be2024f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efae expref: 62 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.454243:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:0.0:1789117777.454249:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117777.454264:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be202bf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0efd1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789117777.454688:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1789117777.454908:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be202c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.454925:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be202c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.454962:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be202c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.455031:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be202bf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efd1 expref: 64 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.455120:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be202c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efd1 expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.455129:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff962b832d0700) 00010000:00010000:0.0:1789117777.455132:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117777.455134:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f5a00, rc 0) 00000100:00100000:0.0:1789117777.455214:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+63:11657:x1876025572135168:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 1069us (4192us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1789117777.455223:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 128 00000100:00100000:3.0:1789117777.460197:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117777.461342:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572135424 00000100:00100000:0.0:1789117777.461357:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572135424 00000100:00100000:0.0:1789117777.461438:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 129 00000100:00100000:0.0:1789117777.461451:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+63:11657:x1876025572135424:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789117777.461517:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117777.461544:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be202c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efd1 expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.461565:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff962b832d0700) 00010000:00010000:0.0:1789117777.461578:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117777.461599:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be202d4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.461628:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be202d4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.461639:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be202d4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.461657:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be202db lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xfe05ab7e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.461665:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be202db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xfe05ab7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.461671:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be202db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xfe05ab7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.461719:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be202d4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.461727:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be202d4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.461734:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be202d4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.461740:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117777.461745:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be202d4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.461752:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be202d4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.461760:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:0.0:1789117777.461770:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117777.461775:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be202d4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.461782:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be202d4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.461793:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be202db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xfe05ab7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.461800:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be202db lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfe05ab7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.461806:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be202db lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfe05ab7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.461811:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9ba00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117777.461814:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be202db lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfe05ab7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.461821:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be202db lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfe05ab7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.461828:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xfe05ab7e (ffff962b832d0500) 00010000:00010000:0.0:1789117777.461830:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117777.461833:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be202db lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xfe05ab7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.461838:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be202db lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xfe05ab7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117777.461948:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+62:11657:x1876025572135424:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 500us (1763us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789117777.462078:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 129 00000100:00100000:1.0:1789117777.470929:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117777.471045:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572135552 00000100:00100000:0.0:1789117777.471093:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572135552 00000100:00100000:0.0:1789117777.471163:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 130 00000100:00100000:0.0:1789117777.471175:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88679e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+62:11657:x1876025572135552:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789117777.471201:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117777.471227:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be202e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0efd8 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.471275:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b400/0xaa253ed19be202e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.471294:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b400/0xaa253ed19be202e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.471321:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b400/0xaa253ed19be202e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.471481:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be202e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efd8 expref: 64 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.471501:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b400/0xaa253ed19be202e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efd8 expref: 63 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.471512:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff962b832d0900) 00010000:00010000:0.0:1789117777.471529:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789117777.471533:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962baea9b400, rc 0) 00000100:00100000:0.0:1789117777.471599:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88679e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+63:11657:x1876025572135552:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 426us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117777.471613:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 130 00000100:00100000:3.0:1789117777.478889:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117777.479090:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572135808 00000100:00100000:0.0:1789117777.479103:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572135808 00000100:00100000:0.0:1789117777.479176:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 131 00000100:00100000:0.0:1789117777.479188:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86808b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+63:11657:x1876025572135808:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789117777.479326:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be202f0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.479348:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be202f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.479364:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be202f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789117777.479554:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:0.0:1789117777.479629:0:6519:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002a3c98bb reply state 000000008c972f60 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be202f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.479643:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be202f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.479651:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff962b832d0900) 00010000:00010000:0.0:1789117777.479654:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789117777.479658:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789117777.479765:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86808b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+65:11657:x1876025572135808:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 579us (887us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1789117777.479773:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 131 00000100:00100000:3.0:1789117777.496015:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117777.497380:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572135936 00000100:00100000:0.0:1789117777.497394:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572135936 00000100:00100000:0.0:1789117777.497519:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 132 00000100:00100000:0.0:1789117777.497531:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+65:11657:x1876025572135936:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789117777.497557:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117777.497586:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be202f7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0efdf expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.497651:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be202f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efdf expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.497668:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be202f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efdf expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.497687:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff962b832d0900) 00010000:00010000:0.0:1789117777.497690:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789117777.497694:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962baea9ba00, rc 0) 00000100:00100000:0.0:1789117777.497776:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+66:11657:x1876025572135936:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 247us (1772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117777.497783:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 132 00000100:00100000:1.0:1789117777.501749:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117777.502940:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572136064 00000100:00100000:0.0:1789117777.502955:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572136064 00000100:00100000:0.0:1789117777.503114:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 45 00000100:00100000:0.0:1789117777.503131:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8867a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2407:x1876025572136064:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1789117777.503398:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789117777.503962:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8867a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:2407:x1876025572136064:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 Request processed in 835us (2225us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789117777.503971:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 45 00000100:00100000:3.0:1789117777.508661:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117777.513422:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572136320 00000100:00100000:2.0:1789117777.513441:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572136320 00000100:00100000:2.0:1789117777.513688:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:2.0:1789117777.513701:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+66:11657:x1876025572136320:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789117777.522281:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+67:11657:x1876025572136320:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 8568us (13617us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1789117777.522296:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:3.0:1789117777.537167:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117777.537344:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572136576 00000100:00100000:2.0:1789117777.537353:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572136576 00000100:00100000:2.0:1789117777.537407:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 133 00000100:00100000:2.0:1789117777.537418:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+67:11657:x1876025572136576:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789117777.537564:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+67:11657:x1876025572136576:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 146us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117777.537571:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 133 00000100:00100000:1.0:1789117777.552572:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117777.553264:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572136704 00000100:00100000:2.0:1789117777.553275:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572136704 00000100:00100000:2.0:1789117777.553364:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 134 00000100:00100000:2.0:1789117777.553376:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88678b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+67:11657:x1876025572136704:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117777.553398:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117777.553420:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be202fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0efe6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.553508:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20305 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.553532:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20305 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.553543:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20305 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117777.553592:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789117777.553613:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20305 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.553640:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be202fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efe6 expref: 69 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.553674:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20305 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efe6 expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.553683:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff962b832d0900) 00010000:00010000:2.0:1789117777.553686:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789117777.553690:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69600, rc 0) 00000100:00100000:2.0:1789117777.553769:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88678b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+68:11657:x1876025572136704:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 394us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117777.553777:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 134 00000100:00100000:3.0:1789117777.562381:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117777.562590:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572136832 00000100:00100000:0.0:1789117777.562613:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572136832 00000100:00100000:0.0:1789117777.562782:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 46 00000100:00100000:0.0:1789117777.562796:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:2404:x1876025572136832:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789117777.562815:0:8833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117777.562840:0:8833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000990480ba/0xaa253ed19be2030c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0efed expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789117777.562869:0:8833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3c552, blocks: 0x0 00010000:00010000:0.0:1789117777.562888:0:8833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=429s v=(0 0) 00010000:00010000:0.0:1789117777.562892:0:8833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117777.562902:0:8833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000990480ba/0xaa253ed19be2030c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efed expref: 10 pid: 8833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.562920:0:8833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000990480ba/0xaa253ed19be2030c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efed expref: 10 pid: 8833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.562934:0:8833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f4c00, rc 0) 00000100:00100000:0.0:1789117777.562999:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+10:2404:x1876025572136832:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 206us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117777.563006:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 46 00000100:00100000:3.0:1789117777.567008:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117777.567171:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572137088 00000100:00100000:1.0:1789117777.567186:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572137088 00000100:00100000:1.0:1789117777.567253:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 135 00000100:00100000:1.0:1789117777.567263:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87e161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+68:11657:x1876025572137088:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789117777.567381:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87e161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+68:11657:x1876025572137088:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 118us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117777.567390:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 135 00000100:00100000:1.0:1789117777.573510:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117777.573626:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572137216 00000100:00100000:2.0:1789117777.573635:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572137216 00000100:00100000:2.0:1789117777.573701:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 47 00000100:00100000:2.0:1789117777.573712:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8867b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+10:11657:x1876025572137216:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117777.573732:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117777.573751:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000014b505c/0xaa253ed19be20313 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0eff4 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.573788:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000990480ba/0xaa253ed19be2030c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efed expref: 11 pid: 8833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.573797:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117777.573801:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117777.573806:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000014b505c/0xaa253ed19be20313 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eff4 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.573859:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000990480ba/0xaa253ed19be2030c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efed expref: 11 pid: 8833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.573872:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000990480ba/0xaa253ed19be2030c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efed expref: 11 pid: 8833 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117777.573887:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1876025593198592:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789117777.574028:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e46c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117777.579623:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117777.579666:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1876025593198592:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789117777.579704:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000014b505c/0xaa253ed19be20313 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eff4 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.579727:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69400, rc 0) 00000100:00100000:0.0:1789117777.579769:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572137344 00000100:00100000:0.0:1789117777.579776:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572137344 00000100:00100000:2.0:1789117777.579789:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8867b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+12:11657:x1876025572137216:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 6079us (6290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117777.579797:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 47 00010000:00010000:0.0:1789117777.579814:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000990480ba/0xaa253ed19be2030c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efed expref: 11 pid: 8833 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117777.579839:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 83 00000100:00100000:0.0:1789117777.579849:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+11:2407:x1876025572137344:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117777.579882:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117777.579912:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000990480ba/0xaa253ed19be2030c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efed expref: 11 pid: 8833 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.579924:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000990480ba/0xaa253ed19be2030c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efed expref: 11 pid: 8833 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.579947:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000990480ba/0xaa253ed19be2030c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efed expref: 11 pid: 8833 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.579961:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117777.579966:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117777.579974:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000014b505c/0xaa253ed19be20313 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eff4 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.579984:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000014b505c/0xaa253ed19be20313 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eff4 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.580022:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000014b505c/0xaa253ed19be20313 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eff4 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117777.580048:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8ded00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6504:1876025593198720:192.168.204.30@tcp:105: 00000100:00100000:0.0:1789117777.580172:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c14240 going to sleep for 11 seconds 00000100:00100000:0.0:1789117777.587341:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8ded00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6504:1876025593198720:192.168.204.30@tcp:105: 00010000:00010000:0.0:1789117777.587372:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117777.587448:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+10:2407:x1876025572137344:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 7599us (7832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117777.587459:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 83 00000100:00100000:1.0:1789117777.591388:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117777.591799:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572137472 00000100:00100000:0.0:1789117777.591809:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572137472 00002000:00100000:0.0:1789117777.591865:0:8441:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff962a88678f00 x1876025572137472/t0(0) o4->35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp:328/0 lens 504/0 e 0 to 0 dl 1789117788 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789117777.591876:0:8441:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962a88678f00 with x1876025572137472 ext(0->12) 00002000:00010000:0.0:1789117777.591882:0:8441:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff962a88678f00 00000100:00100000:0.0:1789117777.591914:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:0.0:1789117777.591924:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88678f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+10:2404:x1876025572137472:12345-192.168.204.30@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789117777.601552:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88678f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+12:2404:x1876025572137472:12345-192.168.204.30@tcp:4:lhsmtool_posix.0 Request processed in 9616us (10160us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789117777.601568:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 2 00002000:00100000:0.0:1789117777.601583:0:8441:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff962a88678f00 x1876025572137472/t4294967309(0) o4->35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp:328/0 lens 504/448 e 0 to 0 dl 1789117788 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789117777.601594:0:8441:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962a88678f00 with x1876025572137472 ext(0->12) 00002000:00010000:0.0:1789117777.601601:0:8441:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff962a88678f00 00000100:00100000:3.0:1789117777.613713:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117777.613947:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572137600 00000100:00100000:0.0:1789117777.613960:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572137600 00000100:00100000:0.0:1789117777.614044:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 136 00000100:00100000:0.0:1789117777.614100:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf83c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+68:11657:x1876025572137600:12345-192.168.204.30@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789117777.623888:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1789117777.623927:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:1.0:1789117777.623980:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1789117777.624018:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff962a87e4fcc0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1789117777.624104:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962bae4ad300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff962a87e4fb40 00000020:00080000:1.0:1789117777.624108:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962bae4adc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff962bbfabca00 00000004:00080000:1.0:1789117777.624143:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789117777.624175:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff962a86f3fcc0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1789117777.624178:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962a85f97000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff962a86f3fd80 00000020:00080000:1.0:1789117777.624180:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962a85f97500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff962a85fc8800 00010000:00010000:3.0:1789117777.625363:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20018 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625380:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20018 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625388:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20018 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625395:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117777.625400:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20018 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625408:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20018 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625447:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff962b832d0200) 00010000:00010000:3.0:1789117777.625450:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117777.625457:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20018 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625464:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20018 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625575:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be200c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625584:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be200c0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625590:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be200c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625596:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70da00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117777.625599:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be200c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625605:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be200c0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625613:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff962b832d0100) 00010000:00010000:3.0:1789117777.625616:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117777.625619:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be200c0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625625:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be200c0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625654:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be2013e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625660:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be2013e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625666:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be2013e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625672:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813da800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117777.625675:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be2013e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625682:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be2013e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625691:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff962b83a07900) 00010000:00010000:3.0:1789117777.625693:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117777.625696:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be2013e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625702:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be2013e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625714:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be20161 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625720:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be20161 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625826:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be20161 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625838:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117777.625841:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be20161 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625848:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be20161 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625857:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff962b83a07900) 00010000:00010000:3.0:1789117777.625859:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117777.625862:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be20161 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625868:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be20161 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.625885:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20233 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.626377:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20233 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.626385:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20233 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.626390:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117777.626394:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20233 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.626400:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20233 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789117777.626411:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00010000:00010000:3.0:1789117777.626422:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:3.0:1789117777.626425:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117777.626429:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20233 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.626435:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20233 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.626449:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be202f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.626455:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be202f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.626459:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be202f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.626464:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9bc00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117777.626467:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be202f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789117777.626491:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789117777.626511:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593198848:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789117777.626594:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be202f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117777.626597:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789117777.626606:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff962b832d0900) 00010000:00010000:3.0:1789117777.626609:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789117777.626613:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be202f0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.626618:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be202f0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117777.626708:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593198848 00000100:00100000:1.0:1789117777.626722:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593198848 00000100:00100000:1.0:1789117777.626977:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789117777.626987:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876025593198848:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789117777.627015:0:8433:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00000100:00100000:0.0:1789117777.630475:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf83c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+16:11657:x1876025572137600:12345-192.168.204.30@tcp:44:lhsmtool_posix.0 Request processed in 16412us (16763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117777.630490:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 136 00000100:00100000:0.0:1789117777.630694:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1789117777.630703:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6c3c90d/0xaa253ed19be2031a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117777.630724:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593198976:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789117777.630791:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117777.630831:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593198976 00000100:00100000:0.0:1789117777.630838:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593198976 00000100:00100000:0.0:1789117777.630886:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789117777.630898:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf775680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593198976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789117777.630923:0:8434:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:0.0:1789117777.630953:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3c550, atime: 0x6aa3c550, ctime: 0x6aa3c550, blocks: 0x8 00010000:00010000:0.0:1789117777.630960:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000459e3a3a/0xaa253ed19be20321 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.630971:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=429s v=(0 0) 00010000:00010000:0.0:1789117777.630975:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117777.630982:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000459e3a3a/0xaa253ed19be20321 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.630999:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000459e3a3a/0xaa253ed19be20321 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.631009:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000459e3a3a/0xaa253ed19be20321 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.631016:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000459e3a3a/0xaa253ed19be20321 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.631045:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789117777.631218:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf775680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1876025593198976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 322us (425us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789117777.631225:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:0.0:1789117777.631244:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117777.631251:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000459e3a3a/0xaa253ed19be20321 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.631259:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f5a00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789117777.631263:0:9523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000459e3a3a/0xaa253ed19be20321 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.631273:0:9523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000459e3a3a/0xaa253ed19be20321 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.631290:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000459e3a3a/0xaa253ed19be20321 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.631297:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000459e3a3a/0xaa253ed19be20321 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.631317:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117777.631320:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117777.631322:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789117777.631331:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117777.631370:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1789117777.631376:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967304 00000004:00080000:0.0:1789117777.631393:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff962a88627840, transno 4294967302 00000004:00080000:0.0:1789117777.631403:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967304 00000100:00100000:0.0:1789117777.631425:0:3647:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff962bbf8ded00 x1876025593198976/t4294967305(4294967305) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789117793 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789117777.631437:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff962bbf8ded00/2, rc 0, transno 4294967305 00000100:00100000:0.0:1789117777.631442:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593198976:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789117777.631583:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001cb51510/0xaa253ed19be200ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef4c expref: 11 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.631593:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789117777.631597:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789117777.631601:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6c3c90d/0xaa253ed19be2031a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.631644:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001cb51510/0xaa253ed19be200ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef4c expref: 11 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.631661:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001cb51510/0xaa253ed19be200ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef4c expref: 11 pid: 8434 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117777.631681:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a886783c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1876025593199104:192.168.204.30@tcp:104: 00000100:00100000:1.0:1789117777.634116:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86f3fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789117777.653927:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117777.653976:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117777.654092:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572137856 00000100:00100000:0.0:1789117777.654106:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572137856 00010000:00010000:0.0:1789117777.654174:0:9524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001cb51510/0xaa253ed19be200ce lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef4c expref: 12 pid: 8434 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117777.654221:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 84 00000100:00100000:0.0:1789117777.654232:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+12:2406:x1876025572137856:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117777.654249:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117777.654257:0:9524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001cb51510/0xaa253ed19be200ce lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef4c expref: 12 pid: 8434 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.654272:0:9524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001cb51510/0xaa253ed19be200ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef4c expref: 12 pid: 8434 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.654305:0:9524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789117777.654329:0:9524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789117777.654336:0:9524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6c3c90d/0xaa253ed19be2031a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.654348:0:9524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6c3c90d/0xaa253ed19be2031a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.654403:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117777.654458:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+12:2406:x1876025572137856:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 227us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117777.654466:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 84 00000100:00100000:3.0:1789117777.655488:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572137728 00000100:00100000:3.0:1789117777.655499:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572137728 00000100:00100000:3.0:1789117777.655559:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 50 00000100:00100000:3.0:1789117777.655569:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+12:2406:x1876025572137728:12345-192.168.204.30@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789117777.663989:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1789117777.664017:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00010000:00010000:1.0:1789117777.665000:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cb51510/0xaa253ed19be200ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef4c expref: 7 pid: 8434 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117777.665026:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a886783c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1876025593199104:192.168.204.30@tcp:104: 00010000:00010000:1.0:1789117777.665106:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f6c3c90d/0xaa253ed19be2031a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.665358:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f6c3c90d/0xaa253ed19be2031a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.665385:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6c3c90d/0xaa253ed19be2031a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.665398:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6c3c90d/0xaa253ed19be2031a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.665408:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6c3c90d/0xaa253ed19be2031a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.665435:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789117777.665678:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876025593198848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 38690us (39079us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789117777.665691:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789117777.665957:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1789117777.665963:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1789117777.665987:0:3645:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff962a87f6f840 x1876025593198848/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789117793 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789117777.666000:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff962a87f6f840/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789117777.666021:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593198848:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789117777.668783:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117777.668806:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6c3c90d/0xaa253ed19be2031a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.668822:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813daa00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117777.668827:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6c3c90d/0xaa253ed19be2031a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.668841:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6c3c90d/0xaa253ed19be2031a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.668870:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6c3c90d/0xaa253ed19be2031a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.668879:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6c3c90d/0xaa253ed19be2031a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.668932:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117777.668935:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117777.668937:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117777.670423:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572137728:12345-192.168.204.30@tcp:16:lhsmtool_posix.0 Request processed in 14843us (16434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117777.670438:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 50 00000100:00100000:2.0:1789117777.692277:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117777.692413:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572138112 00000100:00100000:0.0:1789117777.692424:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572138112 00000100:00100000:0.0:1789117777.692490:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 137 00000100:00100000:0.0:1789117777.692502:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+16:11657:x1876025572138112:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789117777.692558:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117777.692592:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20305 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efe6 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.692612:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff962b832d0900) 00010000:00010000:0.0:1789117777.692617:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117777.692648:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20328 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.692662:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20328 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.692686:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20328 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789117777.692830:0:6521:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000007e3dc9ef reply state 00000000bc84d6eb transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20328 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.692842:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20328 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.692849:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff962b832d0900) 00010000:00010000:0.0:1789117777.692852:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789117777.692854:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789117777.692957:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+17:11657:x1876025572138112:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 456us (690us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1789117777.692964:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 137 00000100:00100000:1.0:1789117777.698852:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117777.699009:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572138240 00000100:00100000:2.0:1789117777.699025:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572138240 00000100:00100000:2.0:1789117777.699126:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00100000:2.0:1789117777.699137:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a886783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2407:x1876025572138240:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789117777.699309:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789117777.699313:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789117777 00002000:00010000:2.0:1789117777.699316:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789117776 00002000:00010000:2.0:1789117777.699319:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789117778 -> 1789117777 00002000:00010000:2.0:1789117777.699322:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789117777.699390:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a886783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2407:x1876025572138240:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 Request processed in 255us (549us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789117777.699416:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00100000:2.0:1789117777.706259:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117777.706750:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572138496 00000100:00100000:0.0:1789117777.706762:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572138496 00000100:00100000:0.0:1789117777.706842:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 138 00000100:00100000:0.0:1789117777.706853:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+17:11657:x1876025572138496:12345-192.168.204.30@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789117777.707230:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2032f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.707248:0:14247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b400/0xaa253ed19be202e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efd8 expref: 17 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.707258:0:14247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2032f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.707366:0:14247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b400/0xaa253ed19be202e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efd8 expref: 17 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.707398:0:14247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b400/0xaa253ed19be202e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efd8 expref: 17 pid: 9533 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117777.707414:0:14247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf775a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14247:1876025593199232:192.168.204.30@tcp:104: 00000100:00100000:0.0:1789117777.707763:0:14247:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c140c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117777.713021:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117777.713251:0:14247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf775a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14247:1876025593199232:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117777.713280:0:14247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2032f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117777.715636:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572138624 00000100:00100000:1.0:1789117777.715651:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572138624 00010000:00010000:0.0:1789117777.720677:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b400/0xaa253ed19be202e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efd8 expref: 18 pid: 9533 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117777.720851:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 85 00000100:00100000:0.0:1789117777.720865:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88418f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+18:2406:x1876025572138624:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117777.720884:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117777.720891:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b400/0xaa253ed19be202e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efd8 expref: 18 pid: 9533 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.720906:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b400/0xaa253ed19be202e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efd8 expref: 18 pid: 9533 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.720933:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b400/0xaa253ed19be202e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efd8 expref: 18 pid: 9533 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.720950:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff962b832d0900) 00010000:00010000:0.0:1789117777.720968:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2032f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.720979:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2032f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.720987:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2032f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.721038:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117777.721167:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88418f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+17:2406:x1876025572138624:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 307us (8157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117777.721175:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 85 00010000:00010000:1.0:1789117777.721543:0:14247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2032f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.721551:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2032f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.721593:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2032f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.721600:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2032f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.721606:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2032f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.721612:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f5a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117777.721615:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2032f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.721623:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2032f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.721634:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff962b832d0900) 00010000:00010000:1.0:1789117777.721637:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789117777.721650:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2032f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.721657:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2032f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117777.721736:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+16:11657:x1876025572138496:12345-192.168.204.30@tcp:55:lhsmtool_posix.0 Request processed in 14884us (15485us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789117777.721746:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 138 00000100:00100000:3.0:1789117777.734703:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117777.736250:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572138752 00000100:00100000:2.0:1789117777.736263:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572138752 00000100:00100000:2.0:1789117777.736347:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 52 00000100:00100000:2.0:1789117777.736357:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2406:x1876025572138752:12345-192.168.204.30@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789117777.736402:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000007dbdf79/0xaa253ed19be20336 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.736421:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000014b505c/0xaa253ed19be20313 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eff4 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.736430:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789117777.736434:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789117777.736438:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007dbdf79/0xaa253ed19be20336 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.736485:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000014b505c/0xaa253ed19be20313 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eff4 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.736500:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000014b505c/0xaa253ed19be20313 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eff4 expref: 7 pid: 8437 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117777.736514:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1876025593199360:192.168.204.30@tcp:104: 00000100:00100000:3.0:1789117777.750521:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e46780 going to sleep for 11 seconds 00000100:00100000:3.0:1789117777.761485:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1876025593199360:192.168.204.30@tcp:104: 00010000:00010000:3.0:1789117777.761527:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000007dbdf79/0xaa253ed19be20336 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117777.762884:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117777.763089:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572138880 00000100:00100000:0.0:1789117777.763099:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572138880 00010000:00010000:0.0:1789117777.763152:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000014b505c/0xaa253ed19be20313 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eff4 expref: 8 pid: 8437 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117777.763209:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 86 00000100:00100000:0.0:1789117777.763222:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb0938850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2407:x1876025572138880:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117777.763242:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117777.763268:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000014b505c/0xaa253ed19be20313 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eff4 expref: 8 pid: 8437 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.763283:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000014b505c/0xaa253ed19be20313 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eff4 expref: 8 pid: 8437 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.763323:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000014b505c/0xaa253ed19be20313 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0eff4 expref: 8 pid: 8437 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.763360:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789117777.763365:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789117777.763371:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000007dbdf79/0xaa253ed19be20336 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.763381:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007dbdf79/0xaa253ed19be20336 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.763410:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117777.763475:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb0938850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2407:x1876025572138880:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 255us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117777.763483:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 86 00010000:00010000:3.0:1789117777.764157:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000007dbdf79/0xaa253ed19be20336 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.764170:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007dbdf79/0xaa253ed19be20336 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.764192:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000007dbdf79/0xaa253ed19be20336 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.764200:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007dbdf79/0xaa253ed19be20336 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.764217:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007dbdf79/0xaa253ed19be20336 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.764224:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789117777.764229:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007dbdf79/0xaa253ed19be20336 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.764238:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007dbdf79/0xaa253ed19be20336 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.764252:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007dbdf79/0xaa253ed19be20336 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.764260:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007dbdf79/0xaa253ed19be20336 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117777.764500:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572138752:12345-192.168.204.30@tcp:1:lhsmtool_posix.0 Request processed in 28143us (29806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117777.764510:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 52 00000100:00100000:3.0:1789117777.775822:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117777.775867:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117777.775904:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117777.775939:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117777.775960:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117777.776026:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572139008 00000100:00100000:2.0:1789117777.776087:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572139008 00000100:00100000:2.0:1789117777.776140:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 459 00000100:00100000:2.0:1789117777.776149:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572139008:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117777.776223:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572139008:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 75us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117777.776231:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 459 00000100:00100000:0.0:1789117777.776543:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572139264 00000100:00100000:0.0:1789117777.776548:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572139264 00000100:00100000:0.0:1789117777.776594:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 137 00000100:00100000:0.0:1789117777.776603:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572139264:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117777.776641:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572139264:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 40us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117777.776648:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 137 00000100:00100000:0.0:1789117777.776670:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572139520 00000100:00100000:0.0:1789117777.776673:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572139520 00000100:00100000:0.0:1789117777.776697:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572139136 00000100:00100000:0.0:1789117777.776700:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572139136 00000100:00100000:0.0:1789117777.776717:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572139392 00000100:00100000:0.0:1789117777.776720:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572139392 00000100:00100000:0.0:1789117777.776736:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 375 00000100:00100000:0.0:1789117777.776751:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572139520:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117777.776781:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572139520:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 31us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117777.776787:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 375 00000100:00100000:0.0:1789117777.776800:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 376 00000100:00100000:0.0:1789117777.776807:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572139136:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117777.776831:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572139136:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 24us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117777.776837:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 376 00000100:00100000:0.0:1789117777.776849:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 377 00000100:00100000:0.0:1789117777.776855:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572139392:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117777.776879:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572139392:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 24us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117777.776885:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 377 00000100:00080000:2.0:1789117777.778418:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789117777.778427:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789117777.778431:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789117777.795147:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117777.795247:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572139776 00000100:00100000:0.0:1789117777.795259:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572139776 00000100:00100000:0.0:1789117777.795335:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 139 00000100:00100000:0.0:1789117777.795346:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+16:11657:x1876025572139776:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789117777.795424:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2033d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.795442:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2022c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efa0 expref: 16 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.795451:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2033d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.795494:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2022c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efa0 expref: 16 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.795522:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2022c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efa0 expref: 16 pid: 9533 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117777.795537:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf775a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593199488:192.168.204.30@tcp:104: 00000100:00100000:0.0:1789117777.795615:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c14780 going to sleep for 11 seconds 00000100:00100000:0.0:1789117777.798961:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf775a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593199488:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117777.799000:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2033d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117777.800596:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117777.800701:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572139904 00000100:00100000:2.0:1789117777.800719:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572139904 00010000:00010000:2.0:1789117777.800758:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2022c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efa0 expref: 17 pid: 9533 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117777.800800:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 87 00000100:00100000:2.0:1789117777.800809:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+17:2406:x1876025572139904:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117777.800824:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117777.800831:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2022c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efa0 expref: 17 pid: 9533 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.800844:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2022c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efa0 expref: 17 pid: 9533 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.800867:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2022c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efa0 expref: 17 pid: 9533 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.800885:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:2.0:1789117777.800904:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be2028e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efc3 expref: 16 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.800915:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2033d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.800923:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2033d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.800931:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2033d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.800961:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117777.801023:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+16:2406:x1876025572139904:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 214us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117777.801040:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 87 00010000:00010000:3.0:1789117777.801557:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2033d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.801567:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2033d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.801774:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20344 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.801788:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be202f7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efdf expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.801797:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20344 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.801837:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be202f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efdf expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.801853:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be202f7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efdf expref: 16 pid: 6521 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117777.801869:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a885652c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593199616:192.168.204.30@tcp:104: 00000100:00100000:3.0:1789117777.801957:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4f480 going to sleep for 11 seconds 00000100:00100000:3.0:1789117777.812366:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117777.812540:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572140032 00000100:00100000:1.0:1789117777.812551:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572140032 00010000:00010000:1.0:1789117777.812596:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be202f7 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efdf expref: 17 pid: 6521 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117777.812648:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 88 00000100:00100000:1.0:1789117777.812661:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885670c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+17:2406:x1876025572140032:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117777.812679:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117777.812686:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be202f7 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efdf expref: 17 pid: 6521 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.812699:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be202f7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efdf expref: 17 pid: 6521 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.812732:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff962b832d0900) 00010000:00010000:1.0:1789117777.812738:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20344 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.812746:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20344 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.812769:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20344 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.812789:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117777.812851:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885670c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+17:2406:x1876025572140032:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 193us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117777.812859:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 88 00010000:00010000:0.0:1789117777.813377:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be202f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efdf expref: 16 pid: 6521 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117777.813395:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a885652c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593199616:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117777.813416:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20344 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.813425:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20344 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.813430:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20344 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789117777.813536:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1789117777.813660:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1789117777.813866:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1789117777.813951:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf775a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1876025593199744:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789117777.814007:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117777.814155:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8299e480 going to sleep for 11 seconds 00000100:00100000:2.0:1789117777.828809:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593199744 00000100:00100000:2.0:1789117777.828826:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593199744 00000100:00100000:2.0:1789117777.828903:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789117777.828915:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6521:x1876025593199744:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789117777.829423:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf775a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1876025593199744:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1789117777.829581:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1789117777.829679:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf775a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1876025593199872:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789117777.829722:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117777.829753:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84b30540 going to sleep for 11 seconds 00000100:00100000:3.0:1789117777.829788:0:6524:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1789117777.829798:0:6524:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1789117777.830140:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593199872 00000100:00100000:0.0:1789117777.830146:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593199872 00000100:00100000:3.0:1789117777.830287:0:14928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789117777.830298:0:14928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88573c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6521:x1876025593199872:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789117777.830458:0:14928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88573c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6521:x1876025593199872:12345-0@lo:1000:mdt00_002.0 Request processed in 163us (736us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789117777.830473:0:14928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789117777.830541:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6521:x1876025593199744:12345-0@lo:1000:mdt00_002.0 Request processed in 171us (15076us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117777.830551:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789117777.830636:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf775a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1876025593199872:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1789117777.830679:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20344 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.830690:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20344 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.830697:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20344 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.830703:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117777.830718:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20344 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.830727:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20344 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.830741:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff962b832d0900) 00010000:00010000:0.0:1789117777.830744:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789117777.830756:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20344 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.830762:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20344 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.830785:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20287 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.830790:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20287 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.830796:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20287 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.830801:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117777.830803:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20287 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.830809:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20287 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.830818:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:0.0:1789117777.830821:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789117777.830828:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be2028e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efc3 expref: 19 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.830841:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be2028e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efc3 expref: 19 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.830850:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be2028e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efc3 expref: 19 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.830892:0:6521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be2028e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efc3 expref: 19 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117777.830904:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88571680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593200000:192.168.204.30@tcp:105: 00000100:00100000:0.0:1789117777.830975:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf629600 going to sleep for 11 seconds 00000100:00100000:3.0:1789117777.840293:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117777.840446:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572140160 00000100:00100000:2.0:1789117777.840458:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572140160 00000100:00100000:2.0:1789117777.840535:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:2.0:1789117777.840548:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88564780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+20:11656:x1876025572140160:12345-192.168.204.30@tcp:49:lfs.0 00000100:00100000:2.0:1789117777.840732:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88564780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+20:11656:x1876025572140160:12345-192.168.204.30@tcp:49:lfs.0 Request processed in 187us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117777.840762:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:0.0:1789117777.840845:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88571680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593200000:192.168.204.30@tcp:105: 00010000:00010000:0.0:1789117777.840888:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20287 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.840900:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20287 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.840937:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2034b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.840951:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2034b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.840965:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2034b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.840975:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2034b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.840981:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2034b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.840989:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2034b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.841007:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117777.841012:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2034b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.841020:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2034b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.841051:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:0.0:1789117777.841073:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117777.841077:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2034b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.841084:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2034b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.841097:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2033d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.841104:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2033d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.841109:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2033d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.841114:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117777.841117:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2033d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.841123:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2033d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.841142:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:0.0:1789117777.841144:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789117777.841148:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2033d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.841154:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2033d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117777.841298:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+19:11657:x1876025572139776:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 45954us (46159us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1789117777.841325:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 139 00000020:00080000:0.0:1789117777.841330:0:6521:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789117777.842222:0:14501:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789117777.842228:0:14501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789117777.842938:0:14501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789117777.842949:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789117777.850336:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117777.850540:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572140416 00000100:00100000:2.0:1789117777.850551:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572140416 00000100:00100000:2.0:1789117777.850621:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 32 00000100:00100000:2.0:1789117777.850632:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962baeaa6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+19:11657:x1876025572140416:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789117777.850941:0:6522:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789117777.850973:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1789117777.851007:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20352 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.851023:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20352 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.851051:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20352 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.851205:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20352 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.851211:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20352 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.851217:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20352 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.851324:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789117777.851547:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962baeaa6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+21:11657:x1876025572140416:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 915us (1219us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1789117777.851556:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 32 00000020:00080000:2.0:1789117777.851561:0:6522:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789117777.852557:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117777.852569:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20352 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.852579:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789117777.852583:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20352 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.852592:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20352 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117777.852607:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff962b832d0900) 00010000:00010000:0.0:1789117777.852609:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789117777.852615:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20352 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117777.852622:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117777.852698:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572140672 00010000:00010000:0.0:1789117777.852700:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20352 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117777.852706:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572140672 00000100:00100000:2.0:1789117777.852860:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 140 00000100:00100000:2.0:1789117777.852871:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+21:11656:x1876025572140672:12345-192.168.204.30@tcp:58:lfs.0 00000040:00080000:2.0:1789117777.853044:0:14247:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1789117777.853132:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+21:11656:x1876025572140672:12345-192.168.204.30@tcp:58:lfs.0 Request processed in 263us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117777.853140:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 140 00010000:00010000:1.0:1789117777.855001:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117777.855011:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117777.855013:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117777.893275:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117777.928576:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117777.928692:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572140800 00000100:00100000:2.0:1789117777.928703:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572140800 00000100:00100000:2.0:1789117777.928777:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 141 00000100:00100000:2.0:1789117777.928787:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8867b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+21:11659:x1876025572140800:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789117777.928813:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117777.928834:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20359 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0effb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.928899:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be20360 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.928914:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be20360 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.928925:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be20360 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.928966:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20367 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.928974:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20367 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.928982:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20367 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.929144:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be2036e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.929158:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20279 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efbc expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.929168:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be2036e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.929209:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20279 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efbc expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117777.929223:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20279 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efbc expref: 22 pid: 6521 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117777.929239:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876025593200128:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789117777.929361:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e466c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117777.934452:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117777.934537:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572141056 00000100:00100000:3.0:1789117777.934547:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572141056 00000100:00100000:3.0:1789117777.934630:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:3.0:1789117777.934642:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88571680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+23:6643:x1876025572141056:12345-192.168.204.30@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789117777.936091:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876025593200128:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789117777.936134:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be2036e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117777.937460:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88571680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+24:6643:x1876025572141056:12345-192.168.204.30@tcp:35:ldlm_bl.0 Request processed in 2809us (3014us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1789117777.937480:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:3.0:1789117777.942217:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117777.942689:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572141184 00000100:00100000:1.0:1789117777.942717:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572141184 00010000:00010000:1.0:1789117777.942774:0:9524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20279 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efbc expref: 24 pid: 6521 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117777.942831:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 89 00000100:00100000:1.0:1789117777.942844:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88564780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+24:2407:x1876025572141184:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117777.942863:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117777.942872:0:9524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20279 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efbc expref: 24 pid: 6521 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.942887:0:9524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20279 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efbc expref: 24 pid: 6521 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.942916:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be20279 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efbc expref: 24 pid: 6521 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.942958:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:1.0:1789117777.942964:0:9524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be2036e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.942976:0:9524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be2036e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.942987:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be2036e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117777.943039:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117777.943151:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88564780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+23:2407:x1876025572141184:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 308us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117777.943160:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 89 00010000:00010000:3.0:1789117777.949884:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be2036e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.949907:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be2036e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117777.949975:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789117777.949980:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789117777.950004:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be2036e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.950023:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be2036e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.950043:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be20360 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.950050:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be20360 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.951799:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be20360 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.951807:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117777.951813:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be20360 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.951825:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be20360 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.951846:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:3.0:1789117777.951850:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117777.951856:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be20360 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.951863:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be20360 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.951883:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20367 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.951891:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20367 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.951897:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20367 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.951902:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117777.951905:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20367 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.951931:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20367 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.951940:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff962a87c24000) 00010000:00010000:3.0:1789117777.951943:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117777.951947:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20367 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.951953:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be20367 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.952022:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20359 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0effb expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.952049:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be2036e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0effb expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117777.952091:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:3.0:1789117777.952093:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789117777.952096:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b68c00, rc 0) 00000100:00100000:2.0:1789117777.952442:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8867b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+22:11659:x1876025572140800:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 23651us (23879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117777.952454:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 141 00000100:00100000:2.0:1789117778.790811:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789117778.790835:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593200256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789117778.790906:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117778.790976:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593200256 00000100:00100000:2.0:1789117778.790984:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593200256 00000100:00100000:2.0:1789117778.791040:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789117778.791049:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593200256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789117778.791109:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789117778.791158:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593200256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117778.791166:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789117778.791209:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593200256:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1789117778.853244:0:14501:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789117778.853254:0:14501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789117778.853286:0:14501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789117778.853293:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789117778.853466:0:14501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6da40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14501:1876025593200384:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789117778.853647:0:14501:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e46540 going to sleep for 11 seconds 00000100:00100000:1.0:1789117778.872764:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117778.872827:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572141312 00000100:00100000:1.0:1789117778.872837:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572141312 00000100:00100000:1.0:1789117778.872894:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 142 00000100:00100000:1.0:1789117778.872904:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8867a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+23:11670:x1876025572141312:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789117778.872939:0:6521:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789117778.873082:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8867a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+23:11670:x1876025572141312:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 179us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117778.873090:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 142 00000100:00080000:2.0:1789117778.874840:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117778.874912:0:14501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6da40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14501:1876025593200384:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789117778.878865:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117778.878901:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572141568 00000100:00100000:2.0:1789117778.878920:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572141568 00000100:00100000:2.0:1789117778.878973:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 143 00000100:00100000:2.0:1789117778.878983:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+22:11670:x1876025572141568:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117778.879005:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117778.879044:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be20375 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f002 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117778.879168:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be2037c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117778.879183:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be2037c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117778.879196:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be2037c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117778.879208:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789117778.879928:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be20375 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f002 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117778.879953:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be2037c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f002 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117778.879963:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:2.0:1789117778.879966:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789117778.879970:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69400, rc 0) 00000100:00100000:2.0:1789117778.880079:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+24:11670:x1876025572141568:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 1097us (1223us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1789117778.880087:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 143 00000100:00100000:3.0:1789117778.885801:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117778.885872:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572141824 00000100:00100000:2.0:1789117778.885882:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572141824 00000100:00100000:2.0:1789117778.885950:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 144 00000100:00100000:2.0:1789117778.885960:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+24:11670:x1876025572141824:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789117778.886090:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2038a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117778.886108:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2038a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117778.886119:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2038a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117778.886247:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2038a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117778.886254:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2038a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117778.886262:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2038a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117778.886268:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117778.886272:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2038a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117778.886279:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2038a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117778.886290:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:2.0:1789117778.886294:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789117778.886306:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2038a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117778.886740:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2038a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117778.886898:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+25:11670:x1876025572141824:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 938us (1107us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1789117778.886908:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 144 00000100:00100000:0.0:1789117778.897550:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117778.900128:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572141952 00000100:00100000:3.0:1789117778.900143:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572141952 00000100:00100000:3.0:1789117778.900226:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:3.0:1789117778.900237:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88418f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+25:2406:x1876025572141952:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117778.900254:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117778.900281:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be2037c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f002 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117778.900317:0:7470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:3.0:1789117778.900324:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117778.900388:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88418f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+24:2406:x1876025572141952:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 153us (2848us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117778.900395:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:0.0:1789117778.900598:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117778.901335:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572142208 00000100:00100000:3.0:1789117778.901343:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572142208 00000100:00100000:3.0:1789117778.901394:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 34 00000100:00100000:3.0:1789117778.901402:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1bbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+24:11670:x1876025572142208:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789117778.901848:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1bbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+25:11670:x1876025572142208:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 446us (1249us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1789117778.901857:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 34 00000040:00080000:2.0:1789117778.905418:0:14501:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789117778.905426:0:14501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789117778.909001:0:14501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789117778.909028:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789117778.918479:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789117779.326185:0:14966:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789117779.326198:0:14966:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789117779.326233:0:14966:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789117779.327765:0:14966:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789117779.669269:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117779.670636:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572142464 00000100:00100000:3.0:1789117779.670653:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572142464 00000100:00100000:3.0:1789117779.670736:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 145 00000100:00100000:3.0:1789117779.670748:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+25:11683:x1876025572142464:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1789117779.670780:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117779.670807:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20391 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f009 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117779.671711:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be20398 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117779.671735:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be20398 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117779.671766:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be20398 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117779.671783:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789117779.671955:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20391 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f009 expref: 28 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117779.671976:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be20398 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f009 expref: 27 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117779.671986:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:3.0:1789117779.671989:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789117779.672004:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92e00, rc 0) 00000100:00100000:3.0:1789117779.672124:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+27:11683:x1876025572142464:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 1378us (2874us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1789117779.672133:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 145 00000100:00100000:0.0:1789117779.682870:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117779.683009:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572142592 00000100:00100000:3.0:1789117779.683024:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572142592 00000100:00100000:3.0:1789117779.683126:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 146 00000100:00100000:3.0:1789117779.683138:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88627840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+27:11683:x1876025572142592:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:3.0:1789117779.683254:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be203a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117779.683281:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be203a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117779.683296:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be203a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117779.683347:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be203a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117779.683354:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be203a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117779.683361:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be203a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117779.683367:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117779.683372:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be203a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117779.683379:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be203a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117779.683392:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:3.0:1789117779.683395:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789117779.683401:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be203a6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117779.683407:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be203a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117779.683503:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88627840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+27:11683:x1876025572142592:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 366us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117779.683717:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 146 00000100:00100000:0.0:1789117779.832653:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117779.832898:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572142720 00000100:00100000:3.0:1789117779.832914:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572142720 00000100:00100000:3.0:1789117779.833032:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 53 00000100:00100000:3.0:1789117779.833105:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2407:x1876025572142720:12345-192.168.204.30@tcp:101:cat.0 00010000:00010000:3.0:1789117779.833131:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117779.833159:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003841785b/0xaa253ed19be203ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f010 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789117779.833194:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa3c551, atime: 0x6aa3c550, ctime: 0x6aa3c551, blocks: 0x8 00010000:00010000:3.0:1789117779.833223:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789117779.833229:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117779.833242:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003841785b/0xaa253ed19be203ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f010 expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117779.833266:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003841785b/0xaa253ed19be203ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f010 expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117779.833283:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92000, rc 0) 00000100:00100000:3.0:1789117779.833371:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2407:x1876025572142720:12345-192.168.204.30@tcp:101:cat.0 Request processed in 273us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117779.833380:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 53 00000100:00080000:2.0:1789117779.834616:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789117779.837425:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117779.844681:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572142848 00000100:00100000:1.0:1789117779.844715:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572142848 00002000:00100000:1.0:1789117779.844842:0:8442:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff962ba0718000 x1876025572142848/t0(0) o3->35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp:330/0 lens 488/0 e 0 to 0 dl 1789117790 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789117779.844891:0:8442:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962ba0718000 with x1876025572142848 ext(0->4095) 00002000:00010000:1.0:1789117779.845025:0:8442:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff962ba0718000 00000100:00100000:1.0:1789117779.845095:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:1.0:1789117779.845107:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2405:x1876025572142848:12345-192.168.204.30@tcp:3:cat.0 00000100:00100000:1.0:1789117779.845392:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2405:x1876025572142848:12345-192.168.204.30@tcp:3:cat.0 Request processed in 286us (7982us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789117779.845400:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 3 00002000:00100000:1.0:1789117779.845408:0:8442:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff962ba0718000 x1876025572142848/t0(0) o3->35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp:330/0 lens 488/4536 e 0 to 0 dl 1789117790 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789117779.845417:0:8442:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962ba0718000 with x1876025572142848 ext(0->4095) 00002000:00010000:1.0:1789117779.845421:0:8442:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff962ba0718000 00000040:00080000:0.0:1789117779.885456:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789117779.941481:0:14501:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789117779.941498:0:14501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789117779.941526:0:14501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789117779.941541:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789117779.941755:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117780.837603:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1b830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593200512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117780.837686:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117780.837857:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593200512 00000100:00100000:1.0:1789117780.837865:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593200512 00000100:00100000:0.0:1789117780.837874:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593200640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789117780.837931:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789117780.837944:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876025593200512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789117780.837985:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117780.838310:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789117780.838489:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117780.838508:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593200640 00000100:00100000:0.0:1789117780.838513:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593200640 00000100:00100000:0.0:1789117780.838546:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789117780.838553:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593200640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789117780.838631:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117780.838666:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593200640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117780.838673:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:0.0:1789117780.838692:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117780.838721:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593200640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789117780.841245:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876025593200512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3290us (3545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117780.841259:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789117780.844876:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1b830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593200512:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789117780.974114:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117781.349472:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789117781.349502:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593200768:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117781.349588:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117781.349666:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593200768 00000100:00100000:2.0:1789117781.349674:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593200768 00000100:00100000:2.0:1789117781.349718:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789117781.349745:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593200768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789117781.349780:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1789117781.349822:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593200768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117781.349829:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789117781.349875:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593200768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117781.350718:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8867a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593201152:0@lo:400:kworker.0 00000100:00100000:0.0:1789117781.350768:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117781.350796:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8852da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593201664:0@lo:400:kworker.0 00000100:00100000:0.0:1789117781.350819:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117781.350853:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789117781.350859:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a886792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593201024:0@lo:400:kworker.0 00000100:00100000:0.0:1789117781.350882:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117781.350899:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8852d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593201536:0@lo:400:kworker.0 00000100:00100000:0.0:1789117781.350929:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117781.350948:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8852e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593202048:0@lo:400:kworker.0 00000100:00100000:0.0:1789117781.350991:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117781.351023:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593201152 00000100:00100000:0.0:1789117781.351028:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593201152 00000100:00100000:0.0:1789117781.351090:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593201664 00000100:00100000:0.0:1789117781.351094:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593201664 00000100:00100000:0.0:1789117781.351115:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593201024 00000100:00100000:0.0:1789117781.351119:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593201024 00000100:00100000:0.0:1789117781.351131:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593201536 00000100:00100000:0.0:1789117781.351133:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593201536 00000100:00100000:0.0:1789117781.351149:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1789117781.351158:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593201152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117781.351201:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593201152:12345-0@lo:400:kworker.0 Request processed in 44us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117781.351208:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1789117781.351223:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1789117781.351230:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593201664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117781.351279:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593201664:12345-0@lo:400:kworker.0 Request processed in 50us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117781.351286:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1789117781.351297:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1789117781.351303:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593201024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117781.351340:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593201024:12345-0@lo:400:kworker.0 Request processed in 38us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117781.351346:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1789117781.351357:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1789117781.351364:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593201536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117781.351389:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593201536:12345-0@lo:400:kworker.0 Request processed in 27us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117781.351395:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1789117781.351415:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593202048 00000100:00100000:0.0:1789117781.351419:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593202048 00000100:00100000:0.0:1789117781.351444:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789117781.351450:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3645:x1876025593202048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117781.351480:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3645:x1876025593202048:12345-0@lo:400:kworker.0 Request processed in 30us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117781.351486:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:0.0:1789117781.351502:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789117781.351506:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789117781.351508:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117781.351532:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a886792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593201024:0@lo:400:kworker.0 00010000:00080000:0.0:1789117781.351544:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a8852d680 x1876025593201536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117781.351555:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8852d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593201536:0@lo:400:kworker.0 00000100:00100000:0.0:1789117781.351565:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8852e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593202048:0@lo:400:kworker.0 00000100:00100000:0.0:1789117781.351574:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8867a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593201152:0@lo:400:kworker.0 00000100:00100000:0.0:1789117781.351592:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8852da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593201664:0@lo:400:kworker.0 00000100:00100000:2.0:1789117781.354122:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8867bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593200896:0@lo:400:kworker.0 00000100:00100000:2.0:1789117781.354205:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117781.354269:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88678780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593201408:0@lo:400:kworker.0 00000100:00100000:2.0:1789117781.354297:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117781.354323:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8852de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593201920:0@lo:400:kworker.0 00000100:00100000:2.0:1789117781.354349:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117781.354386:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789117781.354393:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8867b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593201280:0@lo:400:kworker.0 00000100:00100000:2.0:1789117781.354416:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117781.354456:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8852ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876025593201792:0@lo:400:kworker.0 00000100:00100000:2.0:1789117781.354479:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117781.354511:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593201408 00000100:00100000:2.0:1789117781.354519:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593201408 00000100:00100000:2.0:1789117781.354592:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593201792 00000100:00100000:2.0:1789117781.354596:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593201792 00000100:00100000:2.0:1789117781.354616:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1789117781.354625:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593201408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117781.354681:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593201408:12345-0@lo:400:kworker.0 Request processed in 57us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117781.354707:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1789117781.354724:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1789117781.354730:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876025593201792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117781.354760:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876025593201792:12345-0@lo:400:kworker.0 Request processed in 30us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117781.354766:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00080000:2.0:1789117781.354785:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789117781.354789:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789117781.354818:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a8852ed00 x1876025593201792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117781.354833:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8852ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876025593201792:0@lo:400:kworker.0 00000100:00100000:2.0:1789117781.354845:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88678780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593201408:0@lo:400:kworker.0 00000100:00100000:0.0:1789117781.355696:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593200896 00000100:00100000:0.0:1789117781.355705:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593200896 00000100:00100000:0.0:1789117781.355760:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:0.0:1789117781.355769:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3647:x1876025593200896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117781.355824:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3647:x1876025593200896:12345-0@lo:400:kworker.0 Request processed in 57us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117781.355830:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:0.0:1789117781.355879:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8867bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593200896:0@lo:400:kworker.0 00000100:00100000:3.0:1789117781.356186:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593201920 00000100:00100000:3.0:1789117781.356191:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593201920 00000100:00100000:3.0:1789117781.356233:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789117781.356241:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593201920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117781.356400:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593201920:12345-0@lo:400:kworker.0 Request processed in 160us (2050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117781.356407:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:2.0:1789117781.356605:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117781.357124:0:14928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593201280 00000100:00100000:2.0:1789117781.357130:0:14928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593201280 00000100:00100000:2.0:1789117781.357177:0:14928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789117781.357185:0:14928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593201280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117781.357230:0:14928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593201280:12345-0@lo:400:kworker.0 Request processed in 47us (2813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117781.357237:0:14928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789117781.357523:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8867b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593201280:0@lo:400:kworker.0 00000100:00100000:0.0:1789117781.357538:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8852de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593201920:0@lo:400:kworker.0 00000100:00100000:3.0:1789117781.863814:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117781.863842:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593202176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117781.863922:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789117781.864130:0:9922:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 434147074130ns, next at 435147071054ns, rc = 0 00000100:00100000:0.0:1789117781.865450:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593202176 00000100:00100000:0.0:1789117781.865463:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593202176 00000100:00100000:0.0:1789117781.865527:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789117781.865539:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593202176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789117781.865578:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789117781.865661:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593202176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (1738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117781.865668:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789117781.865690:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789117781.865704:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593202304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117781.865742:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117781.865784:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593202304 00000100:00100000:0.0:1789117781.865787:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593202304 00000100:00100000:0.0:1789117781.865822:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789117781.865828:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1876025593202304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789117781.865838:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789117781.865863:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1876025593202304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117781.865869:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789117781.865905:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593202304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117781.865932:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593202176:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789117781.990963:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117782.880177:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117782.880231:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117782.880269:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117782.880315:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117782.880337:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117782.880353:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117782.880382:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117782.880419:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572143360 00000100:00100000:0.0:1789117782.880432:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572143360 00000100:00100000:1.0:1789117782.880573:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572143488 00000100:00100000:1.0:1789117782.880579:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572143488 00000100:00100000:1.0:1789117782.880643:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 140 00000100:00100000:1.0:1789117782.880656:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2407:x1876025572143488:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117782.880781:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2407:x1876025572143488:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 128us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117782.880790:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 140 00000100:00100000:2.0:1789117782.881006:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572143104 00000100:00100000:2.0:1789117782.881012:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572143104 00000100:00100000:2.0:1789117782.881095:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572143232 00000100:00100000:2.0:1789117782.881105:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572143232 00000100:00100000:2.0:1789117782.881123:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572143616 00000100:00100000:2.0:1789117782.881126:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572143616 00000100:00100000:2.0:1789117782.881139:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572143744 00000100:00100000:2.0:1789117782.881141:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572143744 00000100:00100000:2.0:1789117782.881156:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 384 00000100:00100000:2.0:1789117782.881163:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+27:2406:x1876025572143104:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117782.881206:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+27:2406:x1876025572143104:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 44us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117782.881213:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 384 00000100:00100000:2.0:1789117782.881227:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 385 00000100:00100000:2.0:1789117782.881233:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572143232:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117782.881256:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572143232:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 24us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117782.881262:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 385 00000100:00100000:2.0:1789117782.881272:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 386 00000100:00100000:2.0:1789117782.881278:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+5:2406:x1876025572143616:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117782.881299:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+5:2406:x1876025572143616:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 21us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117782.881305:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 386 00000100:00100000:2.0:1789117782.881315:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 387 00000100:00100000:2.0:1789117782.881321:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572143744:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117782.881344:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572143744:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 24us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117782.881351:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 387 00000100:00100000:3.0:1789117782.881355:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572142976 00000100:00100000:3.0:1789117782.881363:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572142976 00000100:00080000:2.0:1789117782.881388:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789117782.881394:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789117782.881398:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789117782.881401:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789117782.882469:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 461 00000100:00100000:3.0:1789117782.882485:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572142976:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117782.882555:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572142976:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 75us (2322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117782.882563:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 461 00000100:00100000:0.0:1789117782.883334:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 141 00000100:00100000:0.0:1789117782.883350:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572143360:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117782.883389:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572143360:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 48us (3120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117782.883395:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 141 00010000:00010000:1.0:1789117783.016816:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117783.909421:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593202432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789117783.909515:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117783.909611:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593202432 00000100:00100000:2.0:1789117783.909620:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593202432 00000100:00100000:2.0:1789117783.909678:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789117783.909690:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593202432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789117783.909729:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789117783.909795:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593202432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117783.909803:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789117783.909861:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593202432:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1789117783.917275:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000004:00080000:3.0:1789117783.917943:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000100:00100000:2.0:1789117783.918131:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593202560:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789117783.918245:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117783.918335:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593202560 00000100:00100000:2.0:1789117783.918345:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593202560 00000100:00100000:2.0:1789117783.918437:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789117783.918451:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3644:x1876025593202560:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789117783.918607:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789117783.918611:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1789117777 -> 1789117777 00002000:00010000:2.0:1789117783.918613:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 1789117776 -> 1789117776 00002000:00010000:2.0:1789117783.918616:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789117777 -> 1789117777 00002000:00010000:2.0:1789117783.918618:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789117783.918670:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3644:x1876025593202560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 223us (426us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789117783.918678:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1789117783.918700:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789117783.918735:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff962a87f6c780/2, rc 0, transno 4294967313 00000100:00100000:2.0:1789117783.918742:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593202560:0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1789117783.922383:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:3.0:1789117783.922430:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff962b8299e240 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1789117783.922436:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962b90353700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff962b8299e480 00000020:00080000:3.0:1789117783.922440:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962b90353600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff962a87861600 00000020:00080000:3.0:1789117783.922465:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:3.0:1789117783.922495:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20328 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117783.922507:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20328 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117783.922515:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20328 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117783.922534:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f5e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117783.922540:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20328 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117783.922551:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20328 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117783.922577:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff962b832d0900) 00010000:00010000:3.0:1789117783.922580:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117783.922586:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20328 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117783.922593:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20328 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789117783.922633:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1789117783.922715:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:2.0:1789117783.924164:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1789117783.924178:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:1.0:1789117784.037470:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117785.061925:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117785.947708:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117785.947893:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572143872 00000100:00100000:2.0:1789117785.947909:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572143872 00000100:00080000:0.0:1789117785.948080:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117785.948167:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 147 00000100:00100000:2.0:1789117785.948182:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8852c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+13:11344:x1876025572143872:12345-192.168.204.30@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789117785.948300:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8852c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+13:11344:x1876025572143872:12345-192.168.204.30@tcp:60:lhsmtool_posix.0 Request processed in 122us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117785.948308:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 147 00000100:00100000:1.0:1789117785.951978:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117785.952164:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572144000 00000100:00100000:2.0:1789117785.952176:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572144000 00000100:00100000:2.0:1789117785.952268:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 148 00000100:00100000:2.0:1789117785.952281:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8852f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:11344:x1876025572144000:12345-192.168.204.30@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789117785.952405:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8852f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:11344:x1876025572144000:12345-192.168.204.30@tcp:60:lhsmtool_posix.0 Request processed in 126us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117785.952413:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 148 00000100:00080000:0.0:1789117785.953196:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789117785.957931:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789117785.957959:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593202688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117785.958080:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117785.958311:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593202688 00000100:00100000:0.0:1789117785.958321:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593202688 00000100:00100000:0.0:1789117785.958438:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789117785.958452:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8852e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593202688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789117785.958483:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117785.958550:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8852e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593202688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117785.958559:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789117785.958603:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1789117785.958610:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff962bbf8ded00, transno 4294967305 00000100:00100000:0.0:1789117785.958629:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593202688:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789117785.959213:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789117785.961469:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117785.961612:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572144256 00000100:00100000:3.0:1789117785.961627:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572144256 00000100:00100000:3.0:1789117785.961705:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 35 00000100:00100000:3.0:1789117785.961717:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8852fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+13:11344:x1876025572144256:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789117785.962004:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8852fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+14:11344:x1876025572144256:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 288us (547us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1789117785.962012:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 35 00000100:00100000:3.0:1789117785.964893:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593202816:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789117785.964993:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117785.965273:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593202816 00000100:00100000:0.0:1789117785.965282:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593202816 00000100:00100000:0.0:1789117785.965378:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789117785.965392:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba07192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593202816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789117785.965424:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1789117785.965499:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117785.966153:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba07192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593202816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 762us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117785.966163:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789117785.966267:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593202816:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789117786.085741:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117786.365214:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117786.365545:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572144384 00000100:00100000:3.0:1789117786.365556:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572144384 00000100:00080000:1.0:1789117786.365708:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117786.367335:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 149 00000100:00100000:3.0:1789117786.367362:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8852d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:12144:x1876025572144384:12345-192.168.204.30@tcp:101:lsof.0 00010000:00010000:3.0:1789117786.367388:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117786.367423:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be203b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f017 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117786.367503:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be203bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117786.367519:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be203bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117786.367532:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be203bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117786.367587:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789117786.367590:0:9533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789117786.367670:0:9533:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be203bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117786.367700:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be203b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f017 expref: 7 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117786.367720:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be203bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f017 expref: 6 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117786.367729:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4af900) 00010000:00010000:3.0:1789117786.367739:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789117786.367744:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92a00, rc 0) 00000100:00100000:3.0:1789117786.367825:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8852d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+6:12144:x1876025572144384:12345-192.168.204.30@tcp:101:lsof.0 Request processed in 476us (2620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117786.367832:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 149 00000100:00100000:3.0:1789117786.470531:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117786.470559:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593202944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789117786.470644:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117786.470790:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593202944 00000100:00100000:2.0:1789117786.470799:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593202944 00000100:00100000:2.0:1789117786.470875:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789117786.470887:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593202944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789117786.471167:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1789117786.471224:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593202944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 340us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117786.471232:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789117786.471338:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593202944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117786.474804:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593203200:0@lo:400:kworker.0 00000100:00100000:0.0:1789117786.474910:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117786.474968:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593203712:0@lo:400:kworker.0 00000100:00100000:0.0:1789117786.474992:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117786.475011:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8867bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593204224:0@lo:400:kworker.0 00000100:00100000:0.0:1789117786.475032:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117786.475082:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789117786.475088:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593203072:0@lo:400:kworker.0 00000100:00100000:0.0:1789117786.475142:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117786.475166:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593203584:0@lo:400:kworker.0 00000100:00100000:0.0:1789117786.475213:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117786.475235:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8867b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593204096:0@lo:400:kworker.0 00000100:00100000:0.0:1789117786.475257:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117786.475290:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593204224 00000100:00100000:0.0:1789117786.475298:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593204224 00000100:00100000:0.0:1789117786.475353:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593204096 00000100:00100000:0.0:1789117786.475356:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593204096 00000100:00100000:0.0:1789117786.475383:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789117786.475392:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a886792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1876025593204224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117786.475445:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a886792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1876025593204224:12345-0@lo:400:kworker.0 Request processed in 54us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117786.475452:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789117786.475468:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789117786.475475:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593204096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117786.475500:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593204096:12345-0@lo:400:kworker.0 Request processed in 26us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117786.475507:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789117786.475526:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593203072 00000100:00100000:0.0:1789117786.475530:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593203072 00000100:00100000:0.0:1789117786.475553:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1789117786.475559:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593203072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117786.475584:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593203072:12345-0@lo:400:kworker.0 Request processed in 26us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117786.475590:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1789117786.475650:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593203072:0@lo:400:kworker.0 00000100:00100000:0.0:1789117786.475663:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8867b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593204096:0@lo:400:kworker.0 00000100:00100000:0.0:1789117786.475670:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1789117786.475675:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff962a87f6f840, transno 4294967310 00000004:00080000:0.0:1789117786.475685:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1789117786.475711:0:3645:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff962a87f6c780 x1876025593202560/t4294967313(4294967313) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789117799 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117786.475721:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8867bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593204224:0@lo:400:kworker.0 00000100:00100000:0.0:1789117786.475883:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593203200 00000100:00100000:0.0:1789117786.475888:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593203200 00000100:00100000:0.0:1789117786.475918:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593203712 00000100:00100000:0.0:1789117786.475922:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593203712 00000100:00100000:0.0:1789117786.475940:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593203584 00000100:00100000:0.0:1789117786.475943:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593203584 00000100:00100000:0.0:1789117786.475958:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1789117786.475965:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88678780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593203200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117786.476001:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88678780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593203200:12345-0@lo:400:kworker.0 Request processed in 37us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117786.476007:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1789117786.476021:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1789117786.476027:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8867a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593203712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117786.476080:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8867a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593203712:12345-0@lo:400:kworker.0 Request processed in 52us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117786.476086:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1789117786.476098:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1789117786.476104:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593203584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117786.476148:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593203584:12345-0@lo:400:kworker.0 Request processed in 44us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117786.476155:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1789117786.476181:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593203584:0@lo:400:kworker.0 00000100:00100000:0.0:1789117786.476191:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593203200:0@lo:400:kworker.0 00010000:00080000:0.0:1789117786.476203:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a887fbc00 x1876025593203712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117786.476212:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593203712:0@lo:400:kworker.0 00000100:00100000:3.0:1789117786.476329:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593203328:0@lo:400:kworker.0 00000100:00100000:3.0:1789117786.476369:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117786.476399:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593203840:0@lo:400:kworker.0 00000100:00100000:3.0:1789117786.476423:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117786.476454:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789117786.476461:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593203456:0@lo:400:kworker.0 00000100:00100000:3.0:1789117786.476491:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117786.476507:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593203968:0@lo:400:kworker.0 00000100:00100000:3.0:1789117786.476531:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117786.476557:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593203328 00000100:00100000:3.0:1789117786.476562:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593203328 00000100:00100000:3.0:1789117786.476588:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593203840 00000100:00100000:3.0:1789117786.476591:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593203840 00000100:00100000:3.0:1789117786.476607:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593203968 00000100:00100000:3.0:1789117786.476609:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593203968 00000100:00100000:3.0:1789117786.476624:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1789117786.476631:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593203328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117786.476670:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593203328:12345-0@lo:400:kworker.0 Request processed in 39us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117786.476684:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1789117786.476698:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1789117786.476705:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0718780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593203840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117786.476735:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0718780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593203840:12345-0@lo:400:kworker.0 Request processed in 31us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117786.476741:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1789117786.476754:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1789117786.476760:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0719680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593203968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117786.476786:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0719680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593203968:12345-0@lo:400:kworker.0 Request processed in 27us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117786.476792:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00010000:00080000:3.0:1789117786.476819:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a887fb480 x1876025593203968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117786.476831:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593203968:0@lo:400:kworker.0 00000100:00100000:3.0:1789117786.476843:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593203328:0@lo:400:kworker.0 00000100:00100000:3.0:1789117786.476852:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593203840:0@lo:400:kworker.0 00000100:00080000:1.0:1789117786.476939:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789117786.476944:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789117786.476947:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117786.477024:0:14928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593203456 00000100:00100000:2.0:1789117786.477029:0:14928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593203456 00000100:00100000:2.0:1789117786.477102:0:14928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789117786.477110:0:14928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae5df450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593203456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117786.477149:0:14928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae5df450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593203456:12345-0@lo:400:kworker.0 Request processed in 41us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117786.477156:0:14928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789117786.478081:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593203456:0@lo:400:kworker.0 00000100:00100000:1.0:1789117786.981392:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789117786.981421:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0719a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593204352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789117786.981511:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117786.981637:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593204352 00000100:00100000:3.0:1789117786.981646:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593204352 00000100:00100000:3.0:1789117786.981707:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789117786.981718:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8852e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593204352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789117786.981750:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789117786.981806:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8852e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593204352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117786.981831:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789117786.981893:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0719a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593204352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117786.982077:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593204480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117786.982107:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117786.982185:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593204480 00000100:00100000:2.0:1789117786.982190:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593204480 00000100:00100000:2.0:1789117786.982223:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789117786.982230:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0719a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876025593204480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789117786.982242:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789117786.982273:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0719a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876025593204480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117786.982280:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789117786.982356:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593204480:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789117787.110124:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117788.013234:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117788.013288:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117788.013332:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117788.013358:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117788.013378:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117788.013399:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117788.013535:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117788.013575:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572145024 00000100:00100000:3.0:1789117788.013586:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572145024 00000100:00100000:3.0:1789117788.013651:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572144896 00000100:00100000:3.0:1789117788.013654:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572144896 00000100:00100000:3.0:1789117788.013682:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 144 00000100:00100000:3.0:1789117788.013698:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0719e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2405:x1876025572145024:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117788.013785:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0719e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2405:x1876025572145024:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 92us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117788.013793:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 144 00000100:00100000:3.0:1789117788.013814:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 145 00000100:00100000:3.0:1789117788.013821:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2405:x1876025572144896:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117788.013864:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2405:x1876025572144896:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 43us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117788.013883:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 145 00000100:00080000:3.0:1789117788.013906:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789117788.013911:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789117788.014036:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572144768 00000100:00100000:3.0:1789117788.014040:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572144768 00000100:00100000:3.0:1789117788.014113:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572145280 00000100:00100000:3.0:1789117788.014116:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572145280 00000100:00100000:3.0:1789117788.014128:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572144640 00000100:00100000:3.0:1789117788.014130:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572144640 00000100:00100000:3.0:1789117788.014143:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572145152 00000100:00100000:3.0:1789117788.014146:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572145152 00000100:00100000:3.0:1789117788.014160:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 394 00000100:00100000:3.0:1789117788.014166:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2405:x1876025572144768:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117788.014199:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2405:x1876025572144768:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 33us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117788.014206:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 394 00000100:00100000:3.0:1789117788.014219:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 395 00000100:00100000:3.0:1789117788.014225:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572145280:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117788.014305:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572145280:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 80us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117788.014312:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 395 00000100:00100000:3.0:1789117788.014326:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 396 00000100:00100000:3.0:1789117788.014332:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0718b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+14:2405:x1876025572144640:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117788.014361:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0718b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+14:2405:x1876025572144640:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 29us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117788.014368:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 396 00000100:00100000:3.0:1789117788.014388:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 397 00000100:00100000:3.0:1789117788.014395:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0718f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100c793d-0063-4934-90f0-b04fc41ff903+6:2405:x1876025572145152:12345-192.168.204.30@tcp:400:kworker.0 00000100:00080000:0.0:1789117788.014707:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789117788.014712:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789117788.014891:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572144512 00000100:00100000:2.0:1789117788.014896:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572144512 00000100:00100000:2.0:1789117788.014940:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 463 00000100:00100000:2.0:1789117788.014958:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2405:x1876025572144512:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117788.015001:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2405:x1876025572144512:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 53us (1779us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117788.015008:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 463 00000100:00100000:3.0:1789117788.017915:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0718f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100c793d-0063-4934-90f0-b04fc41ff903+6:2405:x1876025572145152:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 26us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117788.017935:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 397 00010000:00010000:2.0:1789117788.133771:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117789.032796:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789117789.032831:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba07183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593204608:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789117789.032903:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117789.033011:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593204608 00000100:00100000:3.0:1789117789.033020:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593204608 00000100:00100000:3.0:1789117789.034455:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789117789.034478:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593204608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789117789.034516:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789117789.034593:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593204608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (1689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117789.034679:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba07183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593204608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789117789.040804:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000040:00080000:0.0:1789117789.093785:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789117789.159277:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789117789.163869:0:14501:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789117789.163879:0:14501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789117789.170277:0:14501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1789117789.170292:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1789117789.175125:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1789117789.175140:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1789117789.175477:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1789117789.175491:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:3.0:1789117789.555845:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:02000400:1.0:1789117789.679998:0:15165:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 05:09:48 (1789117788) 00010000:00010000:1.0:1789117790.186302:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117791.077770:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf8dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593204864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789117791.077818:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117791.077841:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593204736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117791.077999:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117791.078101:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117791.078150:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593204736 00000100:00100000:2.0:1789117791.078162:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593204736 00000100:00100000:1.0:1789117791.078175:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593204864 00000100:00100000:1.0:1789117791.078180:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593204864 00000100:00080000:0.0:1789117791.078236:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789117791.078244:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789117791.078272:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593204736:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117791.078313:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00002000:00000024:1.0:1789117791.078315:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117791.078322:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593204864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789117791.078332:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117791.078367:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593204736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117791.078372:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593204864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117791.078375:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789117791.078379:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789117791.078652:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593204736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117791.078695:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf8dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593204864:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789117791.205389:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117791.220025:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117791.224478:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572145536 00000100:00100000:0.0:1789117791.224493:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572145536 00000100:00100000:0.0:1789117791.224587:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 150 00000100:00100000:0.0:1789117791.224614:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+13:12412:x1876025572145536:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789117791.224653:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117791.224683:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be203c2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f01e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117791.224755:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be203c9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117791.224771:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be203c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117791.224795:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be203c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117791.224811:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be203d0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117791.224819:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be203d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117791.224825:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be203d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117791.225367:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be203d7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117791.225378:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be203d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117791.225386:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be203d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117791.225397:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789117791.225587:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be203c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789117791.225699:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789117791.225793:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be203c9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117791.225800:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be203c9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117791.225807:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f5a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117791.225811:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be203c9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117791.225819:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be203c9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117791.225831:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff962b832c8f00) 00010000:00010000:0.0:1789117791.225834:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117791.225839:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be203c9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117791.225845:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be203c9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117791.225860:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be203d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117791.225866:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be203d0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117791.225871:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be203d0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117791.225886:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f5e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117791.225889:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be203d0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117791.225895:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be203d0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117791.225903:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff962b832d0100) 00010000:00010000:0.0:1789117791.226035:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117791.226039:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be203d0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117791.226045:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be203d0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117791.226385:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be203c2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f01e expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117791.226402:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be203d7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f01e expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117791.226409:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff962bbe7ec500) 00010000:00010000:0.0:1789117791.226412:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117791.226414:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f4c00, rc 0) 00000100:00100000:0.0:1789117791.227169:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+15:12412:x1876025572145536:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 2558us (7260us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789117791.227180:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 150 00000100:00100000:2.0:1789117791.244454:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117791.244563:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117791.246237:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572145792 00000100:00100000:1.0:1789117791.246250:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572145792 00000100:00100000:1.0:1789117791.246335:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:1.0:1789117791.246345:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8ded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+15:2404:x1876025572145792:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117791.246370:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117791.246397:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be203d7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f01e expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117791.246421:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff962bbe7ec500) 00010000:00010000:1.0:1789117791.246426:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117791.246506:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8ded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+14:2404:x1876025572145792:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 162us (1943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117791.246518:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:3.0:1789117791.247563:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572145664 00000100:00100000:3.0:1789117791.247573:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572145664 00000100:00100000:3.0:1789117791.247636:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 151 00000100:00100000:3.0:1789117791.247644:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+14:12412:x1876025572145664:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789117791.247741:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+14:12412:x1876025572145664:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 Request processed in 98us (3299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117791.247748:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 151 00000100:00100000:2.0:1789117791.252748:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117791.253014:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572145920 00000100:00100000:3.0:1789117791.253029:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572145920 00000100:00080000:0.0:1789117791.253337:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789117791.253732:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 152 00000100:00100000:2.0:1789117791.253753:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:12412:x1876025572145920:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789117791.254047:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:12412:x1876025572145920:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 Request processed in 301us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117791.254184:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 152 00000100:00100000:0.0:1789117791.589451:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593205376:0@lo:400:kworker.0 00000100:00100000:0.0:1789117791.589574:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117791.589653:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593205888:0@lo:400:kworker.0 00000100:00100000:0.0:1789117791.589690:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117791.589734:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789117791.589742:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593204992:0@lo:400:kworker.0 00000100:00100000:2.0:1789117791.589926:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593205376 00000100:00100000:2.0:1789117791.589936:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593205376 00000100:00100000:2.0:1789117791.590001:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593205888 00000100:00100000:2.0:1789117791.590005:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593205888 00000100:00100000:2.0:1789117791.590041:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1789117791.590051:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593205376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117791.590422:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1789117791.590434:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593205888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117791.590525:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593205248:0@lo:400:kworker.0 00000100:00100000:2.0:1789117791.594373:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593205376:12345-0@lo:400:kworker.0 Request processed in 4307us (4785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117791.594399:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1789117791.594532:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789117791.594549:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593206400:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117791.594597:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117791.595257:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117791.595310:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593205504:0@lo:400:kworker.0 00000100:00100000:0.0:1789117791.595355:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117791.595378:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593206016:0@lo:400:kworker.0 00000100:00100000:0.0:1789117791.595407:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117791.595465:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593205376:0@lo:400:kworker.0 00000100:00100000:0.0:1789117791.595507:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593205120:0@lo:400:kworker.0 00000100:00100000:0.0:1789117791.595534:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117791.595554:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593205632:0@lo:400:kworker.0 00000100:00100000:0.0:1789117791.595576:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117791.595586:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593206144:0@lo:400:kworker.0 00000100:00100000:0.0:1789117791.595610:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117791.595675:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593206016 00000100:00100000:0.0:1789117791.595682:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593206016 00000100:00100000:0.0:1789117791.595752:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593205120 00000100:00100000:0.0:1789117791.595755:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593205120 00000100:00100000:0.0:1789117791.595779:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593205632 00000100:00100000:0.0:1789117791.595782:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593205632 00000100:00100000:0.0:1789117791.595807:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1789117791.595820:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593206016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117791.595999:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593206400 00000100:00100000:2.0:1789117791.596005:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593206400 00000100:00100000:2.0:1789117791.596043:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593205504 00000100:00100000:2.0:1789117791.596045:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593205504 00000100:00100000:2.0:1789117791.596074:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789117791.596082:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593206400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789117791.596133:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1789117791.596201:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593206400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117791.596209:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789117791.596228:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789117791.596236:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593205504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117791.596274:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593205504:12345-0@lo:400:kworker.0 Request processed in 39us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117791.596282:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789117791.596317:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1789117791.596324:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593205120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117791.596359:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593205120:12345-0@lo:400:kworker.0 Request processed in 36us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117791.596365:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1789117791.596395:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1789117791.596401:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593205632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117791.596432:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593205632:12345-0@lo:400:kworker.0 Request processed in 32us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117791.596439:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1789117791.596476:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593205504:0@lo:400:kworker.0 00000100:00100000:2.0:1789117791.596507:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593205120:0@lo:400:kworker.0 00000100:00100000:2.0:1789117791.596516:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593205632:0@lo:400:kworker.0 00000100:00100000:2.0:1789117791.596551:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593206400:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117791.597133:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593206016:12345-0@lo:400:kworker.0 Request processed in 1313us (1722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117791.597141:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1789117791.597171:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593204992 00000100:00100000:0.0:1789117791.597178:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593204992 00000100:00100000:0.0:1789117791.597213:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:0.0:1789117791.597220:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3646:x1876025593204992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117791.597257:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3646:x1876025593204992:12345-0@lo:400:kworker.0 Request processed in 38us (2006us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117791.597264:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:0.0:1789117791.604661:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593206144 00000100:00100000:0.0:1789117791.604677:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593206144 00000100:00100000:0.0:1789117791.604755:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789117791.604781:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593206144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117791.604898:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593206144:12345-0@lo:400:kworker.0 Request processed in 134us (9285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117791.604906:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:0.0:1789117791.604936:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789117791.604941:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789117791.604944:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117791.607216:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593205888:12345-0@lo:400:kworker.0 Request processed in 16775us (17514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117791.607229:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1789117791.607323:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593204992:0@lo:400:kworker.0 00010000:00080000:3.0:1789117791.607341:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a887dd2c0 x1876025593206016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117791.607353:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593206016:0@lo:400:kworker.0 00000100:00100000:3.0:1789117791.607366:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593205888:0@lo:400:kworker.0 00000100:00100000:3.0:1789117791.607498:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593206144:0@lo:400:kworker.0 00000100:00100000:1.0:1789117791.607795:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117791.607839:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593205760:0@lo:400:kworker.0 00000100:00100000:1.0:1789117791.607870:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117791.607906:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593206272:0@lo:400:kworker.0 00000100:00100000:1.0:1789117791.607933:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117791.607989:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593206272 00000100:00100000:1.0:1789117791.607996:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593206272 00000100:00100000:1.0:1789117791.608049:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789117791.608083:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8852c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593206272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117791.608132:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8852c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593206272:12345-0@lo:400:kworker.0 Request processed in 51us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117791.608140:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1789117791.608159:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789117791.608180:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1789117791.608185:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff962a87f6c780, transno 4294967313 00000100:00100000:1.0:1789117791.608196:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593206272:0@lo:400:kworker.0 00000100:00100000:0.0:1789117791.608551:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593205248 00000100:00100000:0.0:1789117791.608557:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593205248 00000100:00100000:0.0:1789117791.608598:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789117791.608608:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8852f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593205248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117791.608670:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8852f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593205248:12345-0@lo:400:kworker.0 Request processed in 53us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117791.608677:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789117791.608927:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593205760 00000100:00100000:3.0:1789117791.608932:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593205760 00000100:00100000:3.0:1789117791.608976:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1789117791.608984:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8852c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593205760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117791.609023:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8852c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593205760:12345-0@lo:400:kworker.0 Request processed in 41us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117791.609039:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00080000:0.0:1789117791.609197:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789117791.609285:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593205248:0@lo:400:kworker.0 00010000:00080000:1.0:1789117791.609300:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a887de580 x1876025593205760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117791.609310:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593205760:0@lo:400:kworker.0 00000100:00100000:3.0:1789117792.101392:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593206528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117792.101496:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117792.102081:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593206528 00000100:00100000:1.0:1789117792.102093:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593206528 00000100:00100000:1.0:1789117792.102158:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789117792.102171:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593206528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789117792.102223:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789117792.102292:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593206528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117792.102302:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789117792.102361:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593206528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117792.104241:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593206656:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117792.104326:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117792.104504:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593206656 00000100:00100000:0.0:1789117792.104513:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593206656 00000100:00100000:0.0:1789117792.104575:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789117792.104586:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593206656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789117792.104617:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789117792.104676:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593206656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117792.104687:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789117792.104741:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593206656:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1789117792.166102:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789117792.229313:0:14501:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789117792.229327:0:14501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789117792.229847:0:14501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1789117792.229866:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789117792.230432:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117793.125903:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117793.126034:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572146048 00000100:00100000:3.0:1789117793.126048:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572146048 00000100:00100000:3.0:1789117793.128267:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117793.130653:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117793.130708:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117793.130727:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117793.130763:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117793.130795:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117793.130832:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572146176 00000100:00100000:1.0:1789117793.130848:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572146176 00000100:00100000:1.0:1789117793.130930:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572146688 00000100:00100000:1.0:1789117793.130934:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572146688 00000100:00100000:1.0:1789117793.130956:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572146304 00000100:00100000:1.0:1789117793.130959:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572146304 00000100:00100000:1.0:1789117793.130975:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572146816 00000100:00100000:1.0:1789117793.130978:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572146816 00000100:00100000:1.0:1789117793.131000:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 404 00000100:00100000:1.0:1789117793.131012:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+14:2406:x1876025572146176:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117793.131633:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 465 00000100:00100000:2.0:1789117793.131645:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2406:x1876025572146048:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117793.131788:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 405 00000100:00100000:0.0:1789117793.131804:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8852cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+6:2407:x1876025572146688:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117793.131866:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+14:2406:x1876025572146176:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 855us (3610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117793.131878:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 404 00000100:00100000:1.0:1789117793.131909:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 406 00000100:00100000:1.0:1789117793.131919:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8852de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572146304:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117793.135214:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2406:x1876025572146048:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 3548us (9300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117793.135233:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 465 00000100:00100000:0.0:1789117793.136069:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8852cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+6:2407:x1876025572146688:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 4248us (5336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117793.136083:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 405 00000100:00100000:0.0:1789117793.136118:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 407 00000100:00100000:0.0:1789117793.136135:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8852da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572146816:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117793.136232:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8852da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572146816:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 106us (5435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117793.136239:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 407 00000100:00100000:0.0:1789117793.136289:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572146432 00000100:00100000:0.0:1789117793.136301:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572146432 00000100:00100000:0.0:1789117793.136698:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572146560 00000100:00100000:0.0:1789117793.136704:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572146560 00000100:00100000:0.0:1789117793.136731:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 148 00000100:00100000:0.0:1789117793.136751:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8852cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572146432:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117793.136785:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8852cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572146432:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 48us (6147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117793.136792:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 148 00000100:00100000:0.0:1789117793.136806:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 149 00000100:00100000:0.0:1789117793.136813:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8852ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2407:x1876025572146560:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117793.136838:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8852ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2407:x1876025572146560:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 26us (6075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117793.136843:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 149 00000100:00080000:0.0:1789117793.136865:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789117793.136869:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789117793.136872:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789117793.136875:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117793.144239:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8852de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572146304:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 12303us (13491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117793.144256:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 406 00010000:00010000:2.0:1789117793.258934:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117793.848269:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117793.848375:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572146944 00000100:00100000:2.0:1789117793.848391:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572146944 00000100:00100000:2.0:1789117793.848487:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 153 00000100:00100000:2.0:1789117793.848500:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+14:12454:x1876025572146944:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789117793.848524:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117793.848555:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be203e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f025 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117793.848690:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be203ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117793.848708:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be203ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117793.848737:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be203ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117793.848757:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be203f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117793.848765:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be203f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117793.848773:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be203f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117793.848999:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be203ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117793.849007:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be203ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117793.849014:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be203ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117793.849020:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117793.849026:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be203ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117793.849043:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be203ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117793.849144:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4af900) 00010000:00010000:2.0:1789117793.849148:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117793.849154:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be203ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117793.849160:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be203ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117793.849177:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be203f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117793.849185:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be203f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117793.849191:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be203f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117793.849197:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117793.849201:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be203f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117793.849206:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be203f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117793.849213:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff962b900dbb00) 00010000:00010000:2.0:1789117793.849216:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117793.849218:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be203f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117793.849234:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be203f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117793.849279:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be203e5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f025 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117793.849292:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4af900) 00010000:00010000:2.0:1789117793.849294:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117793.849298:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be203e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f025 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117793.849307:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69600, rc 0) 00000100:00100000:2.0:1789117793.849519:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+14:12454:x1876025572146944:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 1021us (1269us total) trans 0 rc 301/301 00000100:00100000:2.0:1789117793.849527:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 153 00000100:00100000:1.0:1789117793.866116:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117793.873436:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572147200 00000100:00100000:1.0:1789117793.873463:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572147200 00000100:00100000:1.0:1789117793.873578:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 154 00000100:00100000:1.0:1789117793.873593:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8852d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+14:12454:x1876025572147200:12345-192.168.204.30@tcp:36:lfs.0 00010000:00010000:1.0:1789117793.873707:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117793.873756:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be1fd39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee49 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117793.873793:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4af900) 00010000:00010000:1.0:1789117793.873800:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789117793.874294:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be203fa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117793.874315:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be203bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f017 expref: 5 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117793.874327:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be203fa lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117793.874378:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be203bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f017 expref: 5 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117793.874400:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be203bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f017 expref: 5 pid: 9533 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117793.874420:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8852e940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593206784:192.168.204.30@tcp:104: 00000100:00100000:1.0:1789117793.882589:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c14780 going to sleep for 11 seconds 00000100:00100000:0.0:1789117793.882892:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117793.883032:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8852e940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593206784:192.168.204.30@tcp:104: 00010000:00010000:1.0:1789117793.883090:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be203fa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117793.883201:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572147328 00000100:00100000:3.0:1789117793.883211:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572147328 00010000:00010000:3.0:1789117793.883256:0:7470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be203bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f017 expref: 6 pid: 9533 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117793.883378:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 90 00000100:00100000:3.0:1789117793.883390:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:100c793d-0063-4934-90f0-b04fc41ff903+6:2407:x1876025572147328:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117793.883412:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117793.883421:0:7470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be203bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f017 expref: 6 pid: 9533 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117793.883436:0:7470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be203bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f017 expref: 6 pid: 9533 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117793.883466:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be203bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f017 expref: 6 pid: 9533 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117793.883484:0:7470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4af900) 00010000:00010000:3.0:1789117793.883494:0:7470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be203fa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117793.883504:0:7470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be203fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117793.883513:0:7470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be203fa lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117793.883537:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789117793.883714:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be203fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117793.883740:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be203fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117793.883841:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20401 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117793.883852:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20401 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117793.883860:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20401 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117793.884862:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572147328:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 1365us (1872us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117793.884876:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 90 00010000:00010000:1.0:1789117793.887229:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20408 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117793.887271:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20408 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117793.887287:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20408 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789117793.887307:0:6521:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c7b57a16 reply state 00000000f0e584fb transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20408 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117793.887318:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20408 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117793.887325:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:1.0:1789117793.887328:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789117793.887333:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789117793.887341:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789117793.887357:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be203fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117793.887363:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be203fa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117793.887370:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be203fa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117793.887377:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117793.887382:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be203fa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117793.887390:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be203fa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117793.887402:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4af900) 00010000:00010000:1.0:1789117793.887405:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117793.887409:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be203fa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117793.887416:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be203fa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789117793.887436:0:6521:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c7b57a16 reply state 00000000f0e584fb transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20401 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117793.887445:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20401 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117793.887451:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff962b84d70900) 00010000:00010000:1.0:1789117793.887453:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789117793.887460:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789117793.887577:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8852d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+15:12454:x1876025572147200:12345-192.168.204.30@tcp:36:lfs.0 Request processed in 13981us (21464us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1789117793.887588:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 154 00000100:00100000:0.0:1789117793.995406:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117793.995491:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572147456 00000100:00100000:3.0:1789117793.995501:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572147456 00000100:00100000:3.0:1789117793.995575:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 155 00000100:00100000:3.0:1789117793.995588:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+15:12462:x1876025572147456:12345-192.168.204.30@tcp:101:lctl.0 00010000:00010000:3.0:1789117793.995633:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117793.995667:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be2040f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f02c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117793.995765:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20416 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117793.995781:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20416 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117793.995797:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20416 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117793.995861:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789117793.995882:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789117793.995913:0:6519:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20416 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117793.995945:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be2040f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f02c expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117793.995966:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20416 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f02c expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117793.995976:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4aeb00) 00010000:00010000:3.0:1789117793.995979:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789117793.995984:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92200, rc 0) 00000100:00100000:3.0:1789117793.996101:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+16:12462:x1876025572147456:12345-192.168.204.30@tcp:101:lctl.0 Request processed in 515us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117793.996109:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 155 00000100:00100000:2.0:1789117794.073178:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117794.079007:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572147584 00000100:00100000:0.0:1789117794.079024:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572147584 00000100:00100000:1.0:1789117794.085964:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 156 00000100:00100000:1.0:1789117794.085984:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87888b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+16:12468:x1876025572147584:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:1.0:1789117794.086014:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117794.086043:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be2041d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f033 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.086153:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20424 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.086446:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20424 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.086466:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20424 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.086482:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2042b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.086491:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2042b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.086499:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2042b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.086620:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be20432 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.086630:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be20432 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.086662:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be20432 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117794.086879:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789117794.086884:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789117794.086926:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be20432 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.086944:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20424 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.086951:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20424 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.086958:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20424 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.086965:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dbe00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117794.086970:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20424 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.086980:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20424 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.086995:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4aeb00) 00010000:00010000:1.0:1789117794.086999:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117794.087007:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20424 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.087015:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20424 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.087045:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2042b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.087051:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2042b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.087129:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2042b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.087134:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dba00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117794.087137:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2042b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.087142:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2042b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.087150:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff962b84d70900) 00010000:00010000:1.0:1789117794.087153:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117794.087156:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2042b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.087800:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be2042b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.087867:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be2041d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f033 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.087884:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be20432 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f033 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.087908:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:1.0:1789117794.087911:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789117794.087914:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813da800, rc 0) 00000100:00100000:1.0:1789117794.088125:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87888b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+17:12468:x1876025572147584:12345-192.168.204.30@tcp:101:bash.0 Request processed in 2146us (14960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117794.088135:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 156 00000100:00100000:2.0:1789117794.092169:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117794.092267:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572147840 00000100:00100000:1.0:1789117794.092279:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572147840 00000100:00100000:1.0:1789117794.092341:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 157 00000100:00100000:1.0:1789117794.092353:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87889a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+17:12468:x1876025572147840:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:1.0:1789117794.092378:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117794.092405:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20439 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f03a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.092544:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be20440 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.092561:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be20440 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.092574:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be20440 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.092655:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be20447 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.092665:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be20447 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.092701:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be20447 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789117794.093141:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1789117794.093286:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be2044e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.093297:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be2044e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.093306:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be2044e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.093343:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be20440 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.093351:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be20440 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.093358:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be20440 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.093364:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70da00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117794.093368:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be20440 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.093375:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be20440 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.093388:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:1.0:1789117794.093391:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117794.093405:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be20440 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.093412:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be20440 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789117794.093428:0:6521:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004fa5b47d reply state 00000000ab9598f2 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be20447 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.093438:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be20447 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.093445:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff962b84d70e00) 00010000:00010000:1.0:1789117794.093447:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789117794.093449:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789117794.093480:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20439 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f03a expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.093497:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be2044e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f03a expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.093504:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962b84d70500) 00010000:00010000:1.0:1789117794.093506:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117794.093508:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70ca00, rc 0) 00000100:00100000:1.0:1789117794.093610:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87889a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+20:12468:x1876025572147840:12345-192.168.204.30@tcp:101:bash.0 Request processed in 1258us (1454us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1789117794.093621:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 157 00000100:00100000:0.0:1789117794.098318:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117794.103321:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572147968 00000100:00100000:1.0:1789117794.103339:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572147968 00000100:00100000:1.0:1789117794.103417:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 55 00000100:00100000:1.0:1789117794.103429:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572147968:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:1.0:1789117794.103473:0:8833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117794.103497:0:8833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098e52426/0xaa253ed19be2045c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f041 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789117794.103525:0:8833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789117794.103549:0:8833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1789117794.103555:0:8833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117794.103572:0:8833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098e52426/0xaa253ed19be2045c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f041 expref: 6 pid: 8833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.103594:0:8833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000098e52426/0xaa253ed19be2045c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f041 expref: 6 pid: 8833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.103609:0:8833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70c800, rc 0) 00000100:00100000:1.0:1789117794.103696:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2406:x1876025572147968:12345-192.168.204.30@tcp:101:bash.0 Request processed in 269us (5390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117794.103703:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 55 00000100:00100000:2.0:1789117794.110526:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117794.110657:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572148096 00000100:00100000:0.0:1789117794.110679:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572148096 00000100:00100000:0.0:1789117794.110796:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 56 00000100:00100000:0.0:1789117794.110809:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87dbf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:12468:x1876025572148096:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:0.0:1789117794.110849:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117794.110874:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be20463 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f048 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117794.111033:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000098e52426/0xaa253ed19be2045c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f041 expref: 7 pid: 8833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117794.111048:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117794.111101:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117794.111108:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be20463 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f048 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117794.111144:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000098e52426/0xaa253ed19be2045c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f041 expref: 7 pid: 8833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117794.111159:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000098e52426/0xaa253ed19be2045c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f041 expref: 7 pid: 8833 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117794.111177:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887df0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8434:1876025593206912:192.168.204.30@tcp:104: 00000100:00100000:0.0:1789117794.111749:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb600 going to sleep for 11 seconds 00000100:00100000:0.0:1789117794.116426:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887df0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8434:1876025593206912:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117794.116478:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be20463 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f048 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117794.116504:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f4c00, rc 0) 00000100:00100000:0.0:1789117794.116600:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87dbf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:12468:x1876025572148096:12345-192.168.204.30@tcp:101:bash.0 Request processed in 5793us (6087us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117794.116610:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 56 00000100:00100000:3.0:1789117794.130642:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117794.130806:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572148224 00000100:00100000:2.0:1789117794.130820:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572148224 00010000:00010000:2.0:1789117794.130878:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000098e52426/0xaa253ed19be2045c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f041 expref: 7 pid: 8833 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117794.130934:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 91 00000100:00100000:2.0:1789117794.130945:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb093b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2407:x1876025572148224:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117794.130965:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117794.131019:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000098e52426/0xaa253ed19be2045c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f041 expref: 7 pid: 8833 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.131034:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000098e52426/0xaa253ed19be2045c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f041 expref: 7 pid: 8833 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.131109:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098e52426/0xaa253ed19be2045c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f041 expref: 7 pid: 8833 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.131131:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117794.131137:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117794.131147:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be20463 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f048 expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.131157:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be20463 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f048 expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.131220:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be20463 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f048 expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117794.131238:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7df0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6504:1876025593207040:192.168.204.30@tcp:105: 00000100:00100000:2.0:1789117794.131343:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a88489cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117794.138506:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7df0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6504:1876025593207040:192.168.204.30@tcp:105: 00010000:00010000:0.0:1789117794.138542:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117794.138626:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb093b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2407:x1876025572148224:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 7682us (8001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117794.138639:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 91 00000100:00100000:3.0:1789117794.138970:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117794.139208:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572148480 00000100:00100000:1.0:1789117794.139216:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572148480 00000100:00100000:1.0:1789117794.139273:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:1.0:1789117794.139283:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+20:12468:x1876025572148480:12345-192.168.204.30@tcp:35:bash.0 00000100:00100000:1.0:1789117794.139572:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+21:12468:x1876025572148480:12345-192.168.204.30@tcp:35:bash.0 Request processed in 289us (604us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1789117794.139579:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:0.0:1789117794.150133:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87ef70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593207168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789117794.150527:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117794.150711:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593207168 00000100:00100000:3.0:1789117794.150729:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593207168 00000100:00100000:3.0:1789117794.150855:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789117794.150868:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593207168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789117794.150906:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789117794.150970:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593207168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117794.150978:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789117794.151542:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87ef70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593207168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789117794.270792:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117794.270930:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572148736 00000100:00100000:0.0:1789117794.270944:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572148736 00000100:00100000:0.0:1789117794.271034:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 158 00000100:00100000:0.0:1789117794.271046:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+21:12478:x1876025572148736:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1789117794.271115:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117794.271139:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2046a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f04f expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117794.271753:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789117794.271984:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2046a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f04f expref: 23 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117794.272003:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4aeb00) 00010000:00010000:0.0:1789117794.272006:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789117794.272013:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2046a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f04f expref: 23 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117794.272100:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f5e00, rc 0) 00000100:00100000:0.0:1789117794.272175:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+22:12478:x1876025572148736:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 1130us (1395us total) trans 4294967421 rc 301/301 00000100:00100000:0.0:1789117794.272184:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 158 00000100:00100000:0.0:1789117794.276796:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00010000:00010000:3.0:1789117794.277638:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117794.277869:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572148992 00000100:00100000:1.0:1789117794.277882:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572148992 00000100:00100000:1.0:1789117794.277947:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00100000:1.0:1789117794.277958:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+22:12478:x1876025572148992:12345-192.168.204.30@tcp:35:lfs.0 00000001:00080000:2.0:1789117794.282017:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967421 is committed 00010000:00010000:3.0:1789117794.282141:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20401 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.282166:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20401 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.282176:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20401 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.282183:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813daa00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117794.282189:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20401 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.282207:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20401 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.282231:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff962b84d70900) 00010000:00010000:3.0:1789117794.282235:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117794.282242:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20401 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.282265:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20401 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.282299:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20408 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.282584:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20408 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.282595:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20408 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.282619:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117794.282622:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20408 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.282628:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20408 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.282637:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:3.0:1789117794.282639:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117794.282643:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20408 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.282649:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20408 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.282669:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be20447 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.282675:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be20447 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.282680:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be20447 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.282685:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117794.282688:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be20447 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.282693:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be20447 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.282713:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff962b84d70e00) 00010000:00010000:3.0:1789117794.282726:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117794.282730:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be20447 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.282736:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be20447 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117794.283624:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+16:12478:x1876025572148992:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 5658us (6835us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1789117794.283637:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00100000:1.0:1789117794.383807:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117794.383944:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572149120 00000100:00100000:2.0:1789117794.383954:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572149120 00000100:00100000:2.0:1789117794.384051:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 159 00000100:00100000:2.0:1789117794.384084:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8852e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+16:12484:x1876025572149120:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789117794.384117:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117794.384140:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20478 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f056 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.384218:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2047f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.384233:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2047f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.384246:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2047f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117794.384496:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789117794.384501:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789117794.384524:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2047f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.384559:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be20478 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f056 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.384582:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2047f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f056 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.384602:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:2.0:1789117794.384605:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789117794.384609:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69800, rc 0) 00000100:00100000:2.0:1789117794.384696:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8852e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+17:12484:x1876025572149120:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 613us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117794.384704:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 159 00000100:00100000:3.0:1789117794.390774:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117794.391171:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572149376 00000100:00100000:1.0:1789117794.391186:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572149376 00000100:00100000:1.0:1789117794.391252:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 160 00000100:00100000:1.0:1789117794.391263:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+17:12484:x1876025572149376:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1789117794.391284:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117794.391307:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be20486 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f05d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.391462:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be2048d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.391481:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be2048d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.391496:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be2048d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117794.391509:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789117794.391888:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be20486 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f05d expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.391934:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be2048d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f05d expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.391943:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962b84d70500) 00010000:00010000:1.0:1789117794.391947:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117794.391950:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70c200, rc 0) 00000100:00100000:1.0:1789117794.392040:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+19:12484:x1876025572149376:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 778us (1277us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1789117794.392048:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 160 00000100:00100000:2.0:1789117794.397946:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117794.397999:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117794.398104:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572149632 00000100:00100000:1.0:1789117794.398118:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572149632 00000100:00100000:1.0:1789117794.398187:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 161 00000100:00100000:1.0:1789117794.398205:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+19:12484:x1876025572149632:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1789117794.398231:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117794.398256:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be2049b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f064 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.398412:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be204a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.398427:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be204a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.398442:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be204a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117794.398459:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789117794.398584:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be2049b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f064 expref: 22 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.398609:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be204a2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f064 expref: 21 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.398620:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962b84d70500) 00010000:00010000:1.0:1789117794.398623:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789117794.398627:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70c800, rc 0) 00000100:00100000:1.0:1789117794.398906:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+21:12484:x1876025572149632:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 702us (969us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1789117794.398913:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 161 00000100:00100000:3.0:1789117794.399390:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572149760 00000100:00100000:3.0:1789117794.399398:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572149760 00000100:00100000:3.0:1789117794.399450:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:3.0:1789117794.399459:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd17c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+21:2405:x1876025572149760:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117794.399471:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117794.399490:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be2048d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f05d expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.399507:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962b84d70500) 00010000:00010000:3.0:1789117794.399511:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117794.399538:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd17c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+20:2405:x1876025572149760:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 81us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117794.399545:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:2.0:1789117794.413327:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117794.413431:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572149888 00000100:00100000:1.0:1789117794.413445:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572149888 00000100:00100000:1.0:1789117794.413517:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 57 00000100:00100000:1.0:1789117794.413526:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2407:x1876025572149888:12345-192.168.204.30@tcp:1:lfs.0 00010000:00010000:1.0:1789117794.413584:0:8833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4322e5/0xaa253ed19be204b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.413613:0:8833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be20463 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f048 expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.413622:0:8833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117794.413627:0:8833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789117794.413632:0:8833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4322e5/0xaa253ed19be204b0 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.413675:0:8833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be20463 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f048 expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.413704:0:8833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be20463 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f048 expref: 6 pid: 8434 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117794.413729:0:8833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8852f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8833:1876025593207296:192.168.204.30@tcp:104: 00000100:00100000:1.0:1789117794.413961:0:8833:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c143c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117794.422957:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117794.423140:0:8833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8852f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8833:1876025593207296:192.168.204.30@tcp:104: 00010000:00010000:1.0:1789117794.423182:0:8833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb4322e5/0xaa253ed19be204b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117794.424528:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572150016 00000100:00100000:2.0:1789117794.424547:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572150016 00002000:00100000:2.0:1789117794.424628:0:8442:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff962a887dfc00 x1876025572150016/t0(0) o4->35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp:345/0 lens 504/0 e 0 to 0 dl 1789117805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789117794.424640:0:8442:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962a887dfc00 with x1876025572150016 ext(0->12) 00010000:00010000:2.0:1789117794.424665:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be20463 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f048 expref: 7 pid: 8434 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.424686:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be20463 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f048 expref: 7 pid: 8434 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789117794.424695:0:8442:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff962a887dfc00 00000100:00100000:2.0:1789117794.424834:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:2.0:1789117794.424848:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2406:x1876025572150016:12345-192.168.204.30@tcp:4:lfs.0 00000100:00100000:2.0:1789117794.426214:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:2406:x1876025572150016:12345-192.168.204.30@tcp:4:lfs.0 Request processed in 1358us (3256us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789117794.426227:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 2 00002000:00100000:2.0:1789117794.426238:0:8442:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff962a887dfc00 x1876025572150016/t4294967306(0) o4->35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp:345/0 lens 504/448 e 0 to 0 dl 1789117805 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789117794.426248:0:8442:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962a887dfc00 with x1876025572150016 ext(0->12) 00010000:00010000:2.0:1789117794.426258:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be20463 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f048 expref: 9 pid: 8434 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.426291:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be20463 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f048 expref: 9 pid: 8434 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789117794.426300:0:8442:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff962a887dfc00 00000100:00100000:2.0:1789117794.435972:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117794.436048:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572150144 00000100:00100000:3.0:1789117794.436104:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572150144 00010000:00010000:3.0:1789117794.436354:0:7470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be20463 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f048 expref: 9 pid: 8434 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117794.436913:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 92 00000100:00100000:1.0:1789117794.436929:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88564780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:2404:x1876025572150144:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117794.436950:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789117794.436975:0:9524:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789117794.436979:0:9524:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789117794 00002000:00010000:1.0:1789117794.436982:0:9524:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789117795 00002000:00010000:1.0:1789117794.436984:0:9524:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789117794 00002000:00010000:1.0:1789117794.436987:0:9524:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789117794.436995:0:9524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be20463 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f048 expref: 9 pid: 8434 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.437014:0:9524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be20463 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f048 expref: 9 pid: 8434 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.437079:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000990480ba/0xaa253ed19be20463 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f048 expref: 9 pid: 8434 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.437101:0:9524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789117794.437107:0:9524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789117794.437113:0:9524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb4322e5/0xaa253ed19be204b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.437123:0:9524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4322e5/0xaa253ed19be204b0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.437957:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117794.438045:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88564780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2404:x1876025572150144:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 1117us (2086us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117794.438111:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 92 00010000:00010000:0.0:1789117794.438724:0:8833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb4322e5/0xaa253ed19be204b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117794.438739:0:8833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb4322e5/0xaa253ed19be204b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117794.440027:0:8833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4322e5/0xaa253ed19be204b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117794.440048:0:8833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4322e5/0xaa253ed19be204b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117794.440072:0:8833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb4322e5/0xaa253ed19be204b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117794.440080:0:8833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70da00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789117794.440087:0:8833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4322e5/0xaa253ed19be204b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117794.440124:0:8833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4322e5/0xaa253ed19be204b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117794.440153:0:8833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb4322e5/0xaa253ed19be204b0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117794.440161:0:8833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb4322e5/0xaa253ed19be204b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117794.441874:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2407:x1876025572149888:12345-192.168.204.30@tcp:1:lfs.0 Request processed in 28335us (28549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117794.441888:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 57 00000100:00100000:2.0:1789117794.448118:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117794.448439:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572150400 00000100:00100000:3.0:1789117794.448452:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572150400 00000100:00100000:3.0:1789117794.448536:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 38 00000100:00100000:3.0:1789117794.448550:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962baeaa7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+20:12484:x1876025572150400:12345-192.168.204.30@tcp:35:lfs.0 00000004:00010000:3.0:1789117794.448642:0:6522:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be204a2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f064 expref: 20 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789117794.449029:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1789117794.449089:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1789117794.450015:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:3.0:1789117794.450086:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be204b7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.450107:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be2044e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f03a expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.450117:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be204b7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.450170:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be2044e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f03a expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.450187:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be2044e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f03a expref: 24 pid: 6521 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117794.450209:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1b80b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1876025593207424:192.168.204.30@tcp:104: 00000100:00100000:3.0:1789117794.450624:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf8390c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117794.454582:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117794.454851:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572150528 00000100:00100000:2.0:1789117794.454862:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572150528 00010000:00010000:2.0:1789117794.454911:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be2044e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f03a expref: 25 pid: 6521 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117794.454968:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 93 00000100:00100000:2.0:1789117794.454983:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8852f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+25:2407:x1876025572150528:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117794.455013:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117794.455021:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be2044e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f03a expref: 25 pid: 6521 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.455036:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be2044e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f03a expref: 25 pid: 6521 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.455089:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962b84d70500) 00010000:00010000:2.0:1789117794.455095:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be204b7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.455106:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be204b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.455137:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be204b7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.455164:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117794.455247:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8852f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+25:2407:x1876025572150528:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 267us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117794.455256:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 93 00010000:00010000:3.0:1789117794.456133:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be2044e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f03a expref: 24 pid: 6521 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117794.456161:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1b80b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1876025593207424:192.168.204.30@tcp:104: 00010000:00010000:3.0:1789117794.456735:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be204b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.456751:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be204b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.456758:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be204b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789117794.457219:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1789117794.457366:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1789117794.457483:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1b80b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1876025593207552:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789117794.457560:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117794.457610:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf839300 going to sleep for 11 seconds 00000100:00100000:1.0:1789117794.458135:0:14928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593207552 00000100:00100000:1.0:1789117794.458143:0:14928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593207552 00000100:00100000:1.0:1789117794.458221:0:14928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789117794.458234:0:14928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1b830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6522:x1876025593207552:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789117794.458360:0:14928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1b830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6522:x1876025593207552:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 129us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117794.458370:0:14928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:0.0:1789117794.458999:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789117794.459291:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1b80b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1876025593207552:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789117794.459468:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1789117794.459536:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1b80b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1876025593207680:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789117794.459907:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117794.459944:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf839780 going to sleep for 11 seconds 00000100:00100000:0.0:1789117794.460029:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593207680 00000100:00100000:0.0:1789117794.460036:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593207680 00000100:00100000:0.0:1789117794.460123:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789117794.460132:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1876025593207680:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789117794.460329:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6522:x1876025593207680:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 197us (422us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789117794.460337:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789117794.460630:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1b80b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1876025593207680:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789117794.460925:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1789117794.460975:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be204b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.460987:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be204b7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.461015:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be204b7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.461023:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117794.461029:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be204b7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.461038:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be204b7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.461091:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962b84d70500) 00010000:00010000:3.0:1789117794.461096:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789117794.461104:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be204b7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117794.461112:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be204b7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789117794.461453:0:6522:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789117794.461532:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1789117794.461546:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 446744490640ns, next at 447744487567ns, rc = 0 00000001:00080000:3.0:1789117794.461553:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1789117794.461584:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962b84d70500) 00010000:00010000:3.0:1789117794.462964:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789117794.462985:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be204a2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f064 expref: 28 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117794.464921:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962baeaa7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+27:12484:x1876025572150400:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 16362us (16853us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1789117794.464936:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 38 00000020:00080000:2.0:1789117794.464943:0:6522:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789117794.471789:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117794.471998:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572150656 00000100:00100000:2.0:1789117794.472013:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572150656 00000100:00100000:2.0:1789117794.472213:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 162 00000100:00100000:2.0:1789117794.472225:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8852fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+27:12484:x1876025572150656:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789117794.472255:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117794.472281:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be204be lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f06b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.472342:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be204be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f06b expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.472358:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be204be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f06b expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.472377:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:2.0:1789117794.472381:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789117794.472406:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b89b69000, rc 0) 00000100:00100000:2.0:1789117794.472489:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8852fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+28:12484:x1876025572150656:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 266us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117794.472497:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 162 00000100:00100000:0.0:1789117794.477549:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117794.477806:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572150912 00000100:00100000:1.0:1789117794.477847:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572150912 00000100:00100000:1.0:1789117794.477907:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:1.0:1789117794.477917:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+28:12484:x1876025572150912:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:1.0:1789117794.478304:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+29:12484:x1876025572150912:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 388us (766us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1789117794.478313:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:3.0:1789117794.626483:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117794.627137:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572151168 00000100:00100000:1.0:1789117794.627149:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572151168 00000100:00100000:1.0:1789117794.627217:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 163 00000100:00100000:1.0:1789117794.627228:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+29:12494:x1876025572151168:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1789117794.627255:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117794.627279:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be204c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f072 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117794.627382:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789117794.627489:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be204c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f072 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.627503:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4aeb00) 00010000:00010000:1.0:1789117794.627507:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789117794.627512:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be204c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f072 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.627530:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70c200, rc 0) 00000100:00100000:1.0:1789117794.628172:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+30:12494:x1876025572151168:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 942us (1697us total) trans 4294967435 rc 301/301 00000100:00100000:1.0:1789117794.628180:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 163 00000100:00100000:3.0:1789117794.635168:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117794.635597:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572151296 00000100:00100000:1.0:1789117794.635610:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572151296 00000100:00100000:1.0:1789117794.635684:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 164 00000100:00100000:1.0:1789117794.635696:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+30:12494:x1876025572151296:12345-192.168.204.30@tcp:34:lfs.0 00010000:00010000:1.0:1789117794.635879:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be204d3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.635896:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be204d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.635907:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be204d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.635923:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be204da lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.635930:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be204da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.635936:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be204da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.636005:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be204e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.636014:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be204e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.636021:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be204e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789117794.636093:0:9533:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be204e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.636116:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be204d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.636122:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be204d3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.636128:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be204d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.636133:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117794.636137:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be204d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.636144:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be204d3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.636155:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:1.0:1789117794.636158:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117794.636163:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be204d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.636169:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be204d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.636181:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be204da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.636186:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be204da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.636191:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be204da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.636202:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117794.636205:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be204da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.636210:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be204da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.636217:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff962b84d70f00) 00010000:00010000:1.0:1789117794.636219:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117794.636222:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be204da lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.636227:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be204da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.636240:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be204e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.636246:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be204e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.637445:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be204e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.637459:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70ca00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117794.637463:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be204e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.637471:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be204e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.637499:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:1.0:1789117794.637502:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117794.637507:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be204e1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117794.637513:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be204e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117794.637633:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+30:12494:x1876025572151296:12345-192.168.204.30@tcp:34:lfs.0 Request processed in 1936us (2474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117794.637642:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 164 00000100:00100000:0.0:1789117794.642293:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117794.642395:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572151552 00000100:00100000:1.0:1789117794.642407:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572151552 00000100:00100000:1.0:1789117794.642469:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 40 00000100:00100000:1.0:1789117794.642480:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+30:12494:x1876025572151552:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:1.0:1789117794.643099:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+31:12494:x1876025572151552:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 576us (773us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1789117794.643109:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 40 00000100:00100000:3.0:1789117794.718594:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117794.718842:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572151808 00000100:00100000:2.0:1789117794.718858:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572151808 00000100:00100000:2.0:1789117794.718942:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 165 00000100:00100000:2.0:1789117794.718954:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+31:12497:x1876025572151808:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789117794.718985:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117794.719014:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be204e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f079 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.719183:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be204ef lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.719206:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be204ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.719225:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be204ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.719244:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be204f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.719264:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be204f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.719271:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be204f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.719441:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be204fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.719456:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be204fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.719463:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be204fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117794.719479:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789117794.719577:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be204ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.719585:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be204ef lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.719593:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be204ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.719598:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117794.719603:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be204ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.719610:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be204ef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.719623:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:2.0:1789117794.719627:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117794.719632:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be204ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.719639:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69600/0xaa253ed19be204ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.719665:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be204f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.719676:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be204f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.719683:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be204f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.719688:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b69a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117794.719692:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be204f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.719698:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be204f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.719714:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff962a87c24800) 00010000:00010000:2.0:1789117794.719717:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117794.719720:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be204f6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.719725:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69a00/0xaa253ed19be204f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.719775:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69400/0xaa253ed19be204e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f079 expref: 34 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.719789:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be204fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f079 expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117794.719796:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:2.0:1789117794.719799:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789117794.719807:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f2000, rc 0) 00000100:00100000:2.0:1789117794.719880:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+33:12497:x1876025572151808:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 928us (1309us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789117794.719888:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 165 00000100:00100000:3.0:1789117794.725006:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117794.730797:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572151936 00000100:00100000:1.0:1789117794.730816:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572151936 00000100:00100000:0.0:1789117794.743104:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 166 00000100:00100000:0.0:1789117794.743120:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+33:12497:x1876025572151936:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:0.0:1789117794.744355:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2050b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117794.744381:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2050b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117794.744396:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2050b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117794.744444:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2050b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117794.744452:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2050b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117794.744459:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2050b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117794.744465:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117794.744470:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2050b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117794.744478:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2050b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117794.744490:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:0.0:1789117794.744493:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789117794.744499:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2050b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117794.744506:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2050b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117794.744677:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+33:12497:x1876025572151936:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 1557us (19680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117794.744687:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 166 00000100:00100000:1.0:1789117794.754495:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117794.754640:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572152192 00000100:00100000:3.0:1789117794.754652:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572152192 00000100:00100000:3.0:1789117794.754732:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 41 00000100:00100000:3.0:1789117794.754745:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba07183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+33:12497:x1876025572152192:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:3.0:1789117794.755445:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba07183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+34:12497:x1876025572152192:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 699us (957us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789117794.755455:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 41 00000100:00100000:3.0:1789117795.178948:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117795.180592:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572152448 00000100:00100000:1.0:1789117795.180609:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572152448 00000100:00080000:0.0:1789117795.180893:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117795.180964:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 167 00000100:00100000:1.0:1789117795.180979:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+34:12528:x1876025572152448:12345-192.168.204.30@tcp:101:cat.0 00010000:00010000:1.0:1789117795.181005:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117795.181029:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be20512 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f080 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.181194:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be20519 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.181210:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be20519 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.181224:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be20519 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117795.181236:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789117795.181348:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be20512 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f080 expref: 37 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.181369:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be20519 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f080 expref: 36 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.181379:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:1.0:1789117795.181383:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117795.181387:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70da00, rc 0) 00000100:00100000:1.0:1789117795.181458:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+36:12528:x1876025572152448:12345-192.168.204.30@tcp:101:cat.0 Request processed in 484us (2529us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789117795.181467:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 167 00000100:00100000:1.0:1789117795.202236:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117795.202294:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117795.202750:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572152832 00000100:00100000:0.0:1789117795.202767:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572152832 00000100:00100000:0.0:1789117795.202892:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:0.0:1789117795.202907:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88418000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+36:2404:x1876025572152832:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117795.202937:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117795.202985:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be20519 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f080 expref: 36 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.203015:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:0.0:1789117795.203022:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117795.203138:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88418000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+35:2404:x1876025572152832:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 235us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117795.203148:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:3.0:1789117795.205457:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572152704 00000100:00100000:3.0:1789117795.205479:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572152704 00000100:00100000:3.0:1789117795.205577:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 42 00000100:00100000:3.0:1789117795.205590:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88418f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+35:12528:x1876025572152704:12345-192.168.204.30@tcp:35:cat.0 00000100:00100000:3.0:1789117795.207129:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88418f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+36:12528:x1876025572152704:12345-192.168.204.30@tcp:35:cat.0 Request processed in 1527us (4894us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1789117795.207147:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 42 00000100:00100000:2.0:1789117795.294161:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117795.301901:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572153088 00000100:00100000:0.0:1789117795.301924:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572153088 00000100:00100000:0.0:1789117795.302044:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 168 00000100:00100000:0.0:1789117795.302078:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+36:12535:x1876025572153088:12345-192.168.204.30@tcp:101:dd.0 00010000:00010000:0.0:1789117795.302119:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117795.302124:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789117795.302165:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69800/0xaa253ed19be2047f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f056 expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.302221:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:0.0:1789117795.302228:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117795.302252:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be20527 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f087 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.302408:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2052e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.302425:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be204fd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f079 expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.302434:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2052e lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.305300:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be204fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f079 expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.305329:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be204fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f079 expref: 36 pid: 6520 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117795.305353:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887df840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593207808:192.168.204.30@tcp:104: 00000100:00100000:0.0:1789117795.305511:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb300 going to sleep for 11 seconds 00010000:00010000:2.0:1789117795.305928:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117795.322301:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117795.327186:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887df840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593207808:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117795.327224:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2052e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117795.327379:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572153216 00000100:00100000:1.0:1789117795.327387:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572153216 00010000:00010000:1.0:1789117795.327436:0:9524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be204fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f079 expref: 37 pid: 6520 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117795.327517:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 94 00000100:00100000:1.0:1789117795.327527:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88565e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+37:2407:x1876025572153216:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117795.327547:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117795.327554:0:9524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be204fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f079 expref: 37 pid: 6520 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.327567:0:9524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be204fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f079 expref: 37 pid: 6520 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.327590:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be204fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f079 expref: 37 pid: 6520 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.327606:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:1.0:1789117795.327611:0:9524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2052e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.327620:0:9524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2052e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.327628:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2052e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.327656:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117795.327750:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88565e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+36:2407:x1876025572153216:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 223us (5466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117795.327758:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 94 00010000:00010000:0.0:1789117795.328093:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2052e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.328108:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2052e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117795.328140:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789117795.328268:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be20527 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f087 expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.328285:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2052e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f087 expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.328292:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:0.0:1789117795.328296:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789117795.328298:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f5e00, rc 0) 00000100:00100000:0.0:1789117795.328326:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+36:12535:x1876025572153088:12345-192.168.204.30@tcp:101:dd.0 Request processed in 26272us (34188us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1789117795.328333:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 168 00000100:00100000:1.0:1789117795.337300:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117795.337509:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572153344 00000100:00100000:0.0:1789117795.337522:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572153344 00000100:00100000:0.0:1789117795.337604:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 169 00000100:00100000:0.0:1789117795.337618:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+36:12535:x1876025572153344:12345-192.168.204.30@tcp:101:dd.0 00010000:00010000:0.0:1789117795.337651:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117795.337680:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2053c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f08e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.337742:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20543 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.337770:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20543 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.337787:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20543 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.337925:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2053c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f08e expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.337946:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20543 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f08e expref: 37 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.337956:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:0.0:1789117795.337959:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789117795.337963:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f4400, rc 0) 00000100:00100000:0.0:1789117795.338111:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+37:12535:x1876025572153344:12345-192.168.204.30@tcp:101:dd.0 Request processed in 497us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117795.338386:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 169 00000100:00100000:3.0:1789117795.343378:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117795.344015:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572153600 00000100:00100000:1.0:1789117795.344029:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572153600 00000100:00100000:1.0:1789117795.344355:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 170 00000100:00100000:1.0:1789117795.344368:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+37:12535:x1876025572153600:12345-192.168.204.30@tcp:36:dd.0 00010000:00010000:1.0:1789117795.344678:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be2054a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.344711:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be2054a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.344727:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be2054a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789117795.344791:0:9533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1789117795.344818:0:9533:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000903669ad reply state 00000000f3afa5a9 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be2054a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.344832:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be2054a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.344839:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:1.0:1789117795.344842:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789117795.344846:0:9533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789117795.345016:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+40:12535:x1876025572153600:12345-192.168.204.30@tcp:36:dd.0 Request processed in 650us (1656us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1789117795.345025:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 170 00000020:00080000:1.0:1789117795.345030:0:9533:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789117795.667832:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117795.667946:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572153728 00000100:00100000:0.0:1789117795.667956:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572153728 00000100:00100000:0.0:1789117795.668037:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 171 00000100:00100000:0.0:1789117795.668051:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1bbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+40:12549:x1876025572153728:12345-192.168.204.30@tcp:101:stat.0 00010000:00010000:0.0:1789117795.668131:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117795.668156:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be20551 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f095 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.668672:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20558 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.668724:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20558 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.668741:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20558 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.668761:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2055f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.668768:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2055f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.668775:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2055f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.668864:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20566 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.668877:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2052e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f087 expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.668885:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20566 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.668924:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2052e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f087 expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.668943:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2052e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f087 expref: 41 pid: 6521 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117795.668974:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887df840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593207936:192.168.204.30@tcp:104: 00000100:00100000:0.0:1789117795.669657:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb300 going to sleep for 11 seconds 00000100:00100000:2.0:1789117795.699112:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117795.700518:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887df840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593207936:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117795.700558:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20566 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117795.701084:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572153984 00000100:00100000:1.0:1789117795.701093:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572153984 00000100:00100000:1.0:1789117795.701180:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 43 00000100:00100000:1.0:1789117795.701204:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88566940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+42:6178:x1876025572153984:12345-192.168.204.30@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789117795.701521:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88566940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+43:6178:x1876025572153984:12345-192.168.204.30@tcp:35:ldlm_bl.0 Request processed in 317us (2468us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1789117795.701529:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 43 00000100:00100000:2.0:1789117795.706905:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117795.707686:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572154112 00000100:00100000:1.0:1789117795.707710:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572154112 00010000:00010000:1.0:1789117795.707767:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2052e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f087 expref: 43 pid: 6521 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117795.707818:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 95 00000100:00100000:1.0:1789117795.707830:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+43:2406:x1876025572154112:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117795.707850:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117795.707858:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2052e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f087 expref: 43 pid: 6521 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.707874:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2052e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f087 expref: 43 pid: 6521 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.707902:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2052e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f087 expref: 43 pid: 6521 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.707923:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:1.0:1789117795.707929:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20566 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.707941:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20566 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.707974:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20566 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.708017:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117795.708221:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+42:2406:x1876025572154112:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 392us (1326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117795.708231:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 95 00010000:00010000:2.0:1789117795.708531:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20566 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117795.708541:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20566 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117795.708607:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789117795.708613:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789117795.708648:0:6521:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20566 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117795.708668:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20566 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117795.708682:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20558 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117795.708699:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20558 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117795.708707:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20558 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117795.708726:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117795.708732:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20558 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117795.708741:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20558 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117795.708753:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:2.0:1789117795.708755:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117795.708761:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20558 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117795.708768:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20558 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117795.708783:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2055f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117795.708789:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2055f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117795.708795:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2055f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117795.708800:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117795.708802:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2055f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117795.708808:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2055f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117795.708834:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff962b832d0f00) 00010000:00010000:2.0:1789117795.708837:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117795.708840:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2055f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117795.708846:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be2055f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117795.708893:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be20551 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f095 expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117795.708910:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20566 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f095 expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117795.708919:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:2.0:1789117795.708921:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789117795.708923:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f4200, rc 0) 00000100:00100000:2.0:1789117795.709297:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1bbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+41:12549:x1876025572153728:12345-192.168.204.30@tcp:101:stat.0 Request processed in 41247us (41478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117795.709307:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 171 00000100:00100000:2.0:1789117795.815577:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117795.816487:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572154368 00000100:00100000:1.0:1789117795.816505:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572154368 00000100:00100000:1.0:1789117795.816665:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 172 00000100:00100000:1.0:1789117795.816681:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+41:12555:x1876025572154368:12345-192.168.204.30@tcp:36:truncate.0 00010000:00010000:1.0:1789117795.816775:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117795.816814:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20566 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f095 expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.816845:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:1.0:1789117795.816852:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789117795.817116:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be2056d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.817140:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be2056d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.817152:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be2056d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789117795.817397:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:1.0:1789117795.817420:0:6520:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000017cc8ad7 reply state 000000007d783d62 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be2056d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.817445:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be2056d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117795.817451:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:1.0:1789117795.817453:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789117795.817456:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789117795.817729:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+43:12555:x1876025572154368:12345-192.168.204.30@tcp:36:truncate.0 Request processed in 1050us (2170us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1789117795.817738:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 172 00000020:00080000:1.0:1789117795.817743:0:6520:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789117795.981323:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117795.981525:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572154496 00000100:00100000:0.0:1789117795.981535:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572154496 00000100:00100000:0.0:1789117795.981601:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 173 00000100:00100000:0.0:1789117795.981613:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1bbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+43:12569:x1876025572154496:12345-192.168.204.30@tcp:101:stat.0 00010000:00010000:0.0:1789117795.981636:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117795.981660:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20574 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f09c expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.981738:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2057b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.981753:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2057b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.981763:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2057b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.981778:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20582 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.981785:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20582 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.981806:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20582 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.981879:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20589 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.981888:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20589 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.981895:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20589 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117795.981935:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1789117795.981940:0:9533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789117795.981960:0:9533:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20589 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.981975:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20589 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.981984:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2057b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.981991:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2057b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.981998:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2057b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.982005:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f5a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117795.982010:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2057b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.982025:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2057b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.982039:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:0.0:1789117795.982042:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117795.982048:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2057b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.982091:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be2057b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.983113:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20582 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.983128:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20582 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.983135:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20582 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.983140:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117795.983144:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20582 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.983150:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20582 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.983162:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff962b832d0400) 00010000:00010000:0.0:1789117795.983165:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117795.983169:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20582 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.983191:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20582 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.983237:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20574 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f09c expref: 45 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.984177:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20589 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f09c expref: 44 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117795.984192:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:0.0:1789117795.984195:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117795.984198:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f4c00, rc 0) 00000100:00100000:0.0:1789117795.984697:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1bbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+44:12569:x1876025572154496:12345-192.168.204.30@tcp:101:stat.0 Request processed in 3071us (3370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117795.984706:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 173 00000100:00100000:3.0:1789117796.107215:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117796.107408:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572154752 00000100:00100000:2.0:1789117796.107418:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572154752 00000100:00100000:2.0:1789117796.107471:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 174 00000100:00100000:2.0:1789117796.107482:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+44:12579:x1876025572154752:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789117796.107503:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117796.107526:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2600/0xaa253ed19be20590 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f0a3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117796.107653:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789117796.107768:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2600/0xaa253ed19be20590 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0a3 expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.107782:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4aeb00) 00010000:00010000:2.0:1789117796.107785:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789117796.107790:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2600/0xaa253ed19be20590 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0a3 expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.107804:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f2600, rc 0) 00000100:00100000:2.0:1789117796.107869:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+45:12579:x1876025572154752:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 390us (666us total) trans 4294967447 rc 301/301 00000100:00100000:2.0:1789117796.107877:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 174 00000100:00100000:2.0:1789117796.111701:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117796.112009:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572155008 00000100:00100000:1.0:1789117796.112020:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572155008 00000100:00100000:1.0:1789117796.112208:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 44 00000100:00100000:1.0:1789117796.112221:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962baeaa4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+45:12579:x1876025572155008:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:1.0:1789117796.113223:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962baeaa4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+46:12579:x1876025572155008:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 996us (1534us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1789117796.113237:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 44 00000004:00080000:0.0:1789117796.204138:0:8831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 448487079795ns, next at 449487076724ns, rc = 0 00000100:00100000:1.0:1789117796.204194:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789117796.204221:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593208064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117796.204316:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117796.204437:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593208192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789117796.204464:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117796.204558:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593208064 00000100:00100000:2.0:1789117796.204566:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593208064 00000100:00100000:2.0:1789117796.204654:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593208192 00000100:00100000:2.0:1789117796.204657:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593208192 00000100:00100000:2.0:1789117796.204688:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789117796.204700:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1bbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876025593208064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789117796.204734:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789117796.204782:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1bbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876025593208064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117796.204789:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789117796.204807:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789117796.204814:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1bbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593208192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789117796.204842:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789117796.204867:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1bbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593208192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117796.204874:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:1.0:1789117796.205511:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789117796.205556:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593208192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789117796.205573:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593208064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117796.253157:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117796.253881:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572155264 00000100:00100000:2.0:1789117796.253898:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572155264 00000100:00100000:2.0:1789117796.256357:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 175 00000100:00100000:2.0:1789117796.256394:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba07183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+46:12585:x1876025572155264:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1789117796.256430:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117796.256464:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2600/0xaa253ed19be2059e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f0aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.256625:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3000/0xaa253ed19be205a5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.256644:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20589 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f09c expref: 47 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.256655:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3000/0xaa253ed19be205a5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.256710:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20589 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f09c expref: 47 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.256729:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20589 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f09c expref: 47 pid: 9533 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117796.256747:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fab480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876025593208320:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789117796.257049:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a88489900 going to sleep for 11 seconds 00000100:00100000:1.0:1789117796.263603:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117796.263756:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572155392 00000100:00100000:3.0:1789117796.263766:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572155392 00010000:00010000:3.0:1789117796.263809:0:7470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20589 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f09c expref: 48 pid: 9533 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117796.263848:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 96 00000100:00100000:3.0:1789117796.263858:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb093a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+48:2407:x1876025572155392:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117796.263891:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117796.263899:0:7470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20589 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f09c expref: 48 pid: 9533 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117796.263913:0:7470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20589 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f09c expref: 48 pid: 9533 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117796.263948:0:7470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:3.0:1789117796.263954:0:7470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3000/0xaa253ed19be205a5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117796.264006:0:7470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3000/0xaa253ed19be205a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117796.264013:0:7470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3000/0xaa253ed19be205a5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117796.264032:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117796.264122:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb093a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+48:2407:x1876025572155392:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 266us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117796.264131:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 96 00010000:00010000:2.0:1789117796.268598:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20589 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f09c expref: 47 pid: 9533 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117796.268640:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fab480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876025593208320:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789117796.268671:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3000/0xaa253ed19be205a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.268691:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3000/0xaa253ed19be205a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.268697:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3000/0xaa253ed19be205a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117796.268731:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1789117796.268891:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2600/0xaa253ed19be2059e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0aa expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.268906:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3000/0xaa253ed19be205a5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0aa expref: 47 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.268917:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:2.0:1789117796.268920:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789117796.268924:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f3000, rc 0) 00000100:00100000:2.0:1789117796.269024:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba07183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+47:12585:x1876025572155264:12345-192.168.204.30@tcp:101:bash.0 Request processed in 12649us (15878us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1789117796.269034:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 175 00000100:00100000:1.0:1789117796.275575:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117796.275735:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572155648 00000100:00100000:0.0:1789117796.275746:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572155648 00000100:00100000:0.0:1789117796.275814:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 176 00000100:00100000:0.0:1789117796.275824:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+47:12585:x1876025572155648:12345-192.168.204.30@tcp:36:bash.0 00010000:00010000:0.0:1789117796.276113:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be205b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117796.276134:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be205b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117796.276146:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be205b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789117796.276225:0:9533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1789117796.276249:0:9533:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000089c22232 reply state 0000000090d7e8a3 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be205b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117796.276264:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be205b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117796.276839:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:0.0:1789117796.276842:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789117796.276846:0:9533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789117796.281670:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+50:12585:x1876025572155648:12345-192.168.204.30@tcp:36:bash.0 Request processed in 5830us (6089us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1789117796.281695:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 176 00000020:00080000:1.0:1789117796.281703:0:9533:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789117796.301022:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117796.301376:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572155776 00000100:00100000:0.0:1789117796.301528:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572155776 00000100:00100000:0.0:1789117796.301653:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 177 00000100:00100000:0.0:1789117796.301665:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+50:12585:x1876025572155776:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:0.0:1789117796.301702:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117796.301726:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be205ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f0b1 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117796.301824:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be205c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117796.301839:0:14247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3000/0xaa253ed19be205a5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0aa expref: 51 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117796.301847:0:14247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be205c1 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117796.301881:0:14247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3000/0xaa253ed19be205a5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0aa expref: 51 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117796.301916:0:14247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3000/0xaa253ed19be205a5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0aa expref: 51 pid: 6520 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117796.301930:0:14247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887df480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14247:1876025593208448:192.168.204.30@tcp:104: 00000100:00100000:0.0:1789117796.302031:0:14247:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb300 going to sleep for 11 seconds 00000100:00100000:0.0:1789117796.313250:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117796.313373:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572155904 00000100:00100000:2.0:1789117796.313398:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572155904 00010000:00010000:2.0:1789117796.313446:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3000/0xaa253ed19be205a5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0aa expref: 52 pid: 6520 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117796.313494:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 97 00000100:00100000:2.0:1789117796.313505:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+52:2407:x1876025572155904:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117796.313524:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117796.313531:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3000/0xaa253ed19be205a5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0aa expref: 52 pid: 6520 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.313545:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3000/0xaa253ed19be205a5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0aa expref: 52 pid: 6520 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.313570:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:2.0:1789117796.313576:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be205c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.313587:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be205c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.313595:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be205c1 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.313615:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117796.313688:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+52:2407:x1876025572155904:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 175us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117796.313696:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 97 00010000:00010000:1.0:1789117796.314466:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3000/0xaa253ed19be205a5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0aa expref: 51 pid: 6520 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117796.314487:0:14247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887df480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14247:1876025593208448:192.168.204.30@tcp:104: 00010000:00010000:1.0:1789117796.314512:0:14247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be205c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.314520:0:14247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be205c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.314525:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be205c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117796.314587:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789117796.314593:0:14247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789117796.314617:0:14247:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be205c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.314654:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be205ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0b1 expref: 51 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.314671:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be205c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0b1 expref: 50 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.315942:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:1.0:1789117796.315946:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117796.315952:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f4c00, rc 0) 00000100:00100000:1.0:1789117796.316086:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+50:12585:x1876025572155776:12345-192.168.204.30@tcp:101:bash.0 Request processed in 14394us (15043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117796.316097:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 177 00000100:00100000:0.0:1789117796.322943:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117796.323051:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572156160 00000100:00100000:3.0:1789117796.323083:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572156160 00000100:00100000:3.0:1789117796.323532:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 45 00000100:00100000:3.0:1789117796.323546:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+50:12585:x1876025572156160:12345-192.168.204.30@tcp:35:bash.0 00000100:00100000:3.0:1789117796.323886:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+51:12585:x1876025572156160:12345-192.168.204.30@tcp:35:bash.0 Request processed in 343us (951us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1789117796.323917:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 45 00010000:00010000:2.0:1789117796.328785:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117796.494422:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117796.494528:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572156416 00000100:00100000:1.0:1789117796.494540:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572156416 00000100:00100000:1.0:1789117796.494618:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 178 00000100:00100000:1.0:1789117796.494631:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+51:12595:x1876025572156416:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1789117796.494672:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117796.494710:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be205c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f0b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117796.494836:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789117796.499542:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be205c8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0b8 expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117796.499573:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4aeb00) 00010000:00010000:0.0:1789117796.499577:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789117796.499585:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be205c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0b8 expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117796.499612:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70d200, rc 0) 00000100:00100000:0.0:1789117796.500553:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+52:12595:x1876025572156416:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 5916us (6140us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1789117796.500567:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 178 00000100:00100000:0.0:1789117796.505663:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117796.506110:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572156544 00000100:00100000:1.0:1789117796.506124:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572156544 00000100:00100000:1.0:1789117796.506287:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 179 00000100:00100000:1.0:1789117796.506298:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+52:12595:x1876025572156544:12345-192.168.204.30@tcp:34:lfs.0 00010000:00010000:1.0:1789117796.506419:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be205d6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506440:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be205d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506454:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be205d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506492:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be205dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506501:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be205dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506507:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be205dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506604:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be205e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506615:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be205e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506622:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be205e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789117796.506695:0:9533:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be205e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506710:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be205d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506716:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be205d6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506723:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be205d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506730:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117796.506734:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be205d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506748:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be205d6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506763:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:1.0:1789117796.506767:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117796.506784:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be205d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506791:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be205d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506807:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be205dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506813:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be205dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506818:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be205dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506823:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117796.506827:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be205dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506832:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be205dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506840:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff962b84d70f00) 00010000:00010000:1.0:1789117796.506842:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117796.506845:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be205dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506859:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be205dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506876:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be205e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506882:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be205e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506887:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be205e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506892:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70ca00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117796.506894:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be205e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506899:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be205e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.506906:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:1.0:1789117796.506907:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117796.507490:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be205e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.507503:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be205e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117796.507689:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+52:12595:x1876025572156544:12345-192.168.204.30@tcp:34:lfs.0 Request processed in 1378us (2022us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117796.507698:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 179 00000100:00100000:1.0:1789117796.528212:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117796.529129:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572156800 00000100:00100000:3.0:1789117796.529140:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572156800 00000100:00100000:3.0:1789117796.529215:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 46 00000100:00100000:3.0:1789117796.529227:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88418f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+52:12595:x1876025572156800:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:2.0:1789117796.529829:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88418f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+53:12595:x1876025572156800:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 601us (1627us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789117796.529838:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 46 00000100:00100000:2.0:1789117796.645872:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117796.646089:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572157056 00000100:00100000:1.0:1789117796.646101:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572157056 00000100:00100000:1.0:1789117796.646174:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 180 00000100:00100000:1.0:1789117796.646186:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+53:12598:x1876025572157056:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1789117796.646216:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117796.646241:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be205eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f0bf expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.646344:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be205f2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.646364:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be205f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.646375:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be205f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.646390:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be205f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.646396:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be205f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.646402:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be205f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.646517:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20600 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.646527:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20600 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.646552:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20600 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117796.646563:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789117796.646683:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be205f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.646691:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be205f2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.646697:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be205f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.646703:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117796.646708:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be205f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.646715:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be205f2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.646728:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:1.0:1789117796.646731:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117796.646736:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be205f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.646741:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d200/0xaa253ed19be205f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.646756:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be205f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.646762:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be205f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.646774:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be205f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.646780:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117796.646783:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be205f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.646789:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be205f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.646797:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff962b84d70f00) 00010000:00010000:1.0:1789117796.646800:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117796.646803:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be205f9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.646809:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c200/0xaa253ed19be205f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.646859:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be205eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0bf expref: 56 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.646874:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20600 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0bf expref: 55 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.646881:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:1.0:1789117796.646883:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117796.646886:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813db800, rc 0) 00000100:00100000:1.0:1789117796.646975:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+55:12598:x1876025572157056:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 791us (1113us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1789117796.647004:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 180 00000100:00100000:0.0:1789117796.655400:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117796.655519:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572157184 00000100:00100000:2.0:1789117796.655530:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572157184 00000100:00100000:2.0:1789117796.655592:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 181 00000100:00100000:2.0:1789117796.655603:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+55:12598:x1876025572157184:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:2.0:1789117796.655689:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2c00/0xaa253ed19be2060e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.655711:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2c00/0xaa253ed19be2060e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.655725:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2c00/0xaa253ed19be2060e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.655759:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2c00/0xaa253ed19be2060e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.655766:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2c00/0xaa253ed19be2060e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.655787:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2c00/0xaa253ed19be2060e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.655792:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f2c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117796.655796:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2c00/0xaa253ed19be2060e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.655802:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2c00/0xaa253ed19be2060e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.655828:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:2.0:1789117796.655831:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789117796.655836:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2c00/0xaa253ed19be2060e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.655843:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2c00/0xaa253ed19be2060e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117796.655978:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+55:12598:x1876025572157184:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 375us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117796.655987:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 181 00000100:00100000:1.0:1789117796.658607:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117796.658757:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572157312 00000100:00100000:2.0:1789117796.658767:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572157312 00000100:00100000:2.0:1789117796.658839:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:2.0:1789117796.658850:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88564780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+55:2406:x1876025572157312:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117796.658867:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117796.658890:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20600 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0bf expref: 55 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.658912:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:2.0:1789117796.658917:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117796.658960:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88564780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+54:2406:x1876025572157312:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 113us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117796.658967:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:0.0:1789117796.665487:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117796.666549:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572157568 00000100:00100000:2.0:1789117796.666568:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572157568 00000100:00100000:2.0:1789117796.666786:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 47 00000100:00100000:2.0:1789117796.666816:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+54:12598:x1876025572157568:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:2.0:1789117796.667139:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+55:12598:x1876025572157568:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 324us (1665us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1789117796.667156:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 47 00000100:00100000:1.0:1789117796.711559:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593208576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117796.711693:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117796.715089:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593208576 00000100:00100000:2.0:1789117796.715106:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593208576 00000100:00100000:2.0:1789117796.715184:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789117796.715195:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88565e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593208576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789117796.715237:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789117796.715759:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88565e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593208576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 563us (4062us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117796.715769:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789117796.715904:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593208576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117796.716565:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e1ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593208960:0@lo:400:kworker.0 00000100:00100000:1.0:1789117796.716635:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117796.716689:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876025593209472:0@lo:400:kworker.0 00000100:00100000:1.0:1789117796.716713:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117796.716742:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789117796.716748:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e1e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593208832:0@lo:400:kworker.0 00000100:00100000:1.0:1789117796.716770:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117796.716803:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876025593209344:0@lo:400:kworker.0 00000100:00100000:1.0:1789117796.716826:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117796.716841:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88573c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593209856:0@lo:400:kworker.0 00000100:00100000:1.0:1789117796.716871:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117796.716908:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593209856 00000100:00100000:1.0:1789117796.716916:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593209856 00000100:00100000:1.0:1789117796.716977:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789117796.716988:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593209856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117796.717047:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593209856:12345-0@lo:400:kworker.0 Request processed in 60us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117796.717085:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1789117796.717110:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789117796.717136:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88573c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593209856:0@lo:400:kworker.0 00000100:00100000:1.0:1789117796.717191:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593208960 00000100:00100000:1.0:1789117796.717194:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593208960 00000100:00100000:1.0:1789117796.717221:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593209472 00000100:00100000:1.0:1789117796.717224:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593209472 00000100:00100000:1.0:1789117796.717243:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593208832 00000100:00100000:1.0:1789117796.717246:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593208832 00000100:00100000:1.0:1789117796.717257:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593209344 00000100:00100000:1.0:1789117796.717259:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593209344 00000100:00100000:1.0:1789117796.717273:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:1.0:1789117796.717279:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593208960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117796.717311:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593208960:12345-0@lo:400:kworker.0 Request processed in 33us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117796.717317:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:1.0:1789117796.717327:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:1.0:1789117796.717333:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876025593209472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117796.717353:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876025593209472:12345-0@lo:400:kworker.0 Request processed in 21us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117796.717358:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:1.0:1789117796.717367:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1789117796.717372:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593208832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117796.717391:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593208832:12345-0@lo:400:kworker.0 Request processed in 19us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117796.717396:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1789117796.717404:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1789117796.717409:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a884e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876025593209344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117796.717428:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a884e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876025593209344:12345-0@lo:400:kworker.0 Request processed in 19us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117796.717442:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00080000:1.0:1789117796.717454:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789117796.717457:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117796.717471:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e1e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593208832:0@lo:400:kworker.0 00010000:00080000:1.0:1789117796.717483:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e1cf00 x1876025593209344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117796.717495:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876025593209344:0@lo:400:kworker.0 00000100:00100000:1.0:1789117796.717503:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e1ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593208960:0@lo:400:kworker.0 00000100:00100000:1.0:1789117796.717510:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876025593209472:0@lo:400:kworker.0 00000100:00100000:3.0:1789117796.718580:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88566940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593208704:0@lo:400:kworker.0 00000100:00100000:3.0:1789117796.718649:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117796.718837:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e1fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593209216:0@lo:400:kworker.0 00000100:00100000:3.0:1789117796.718868:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117796.718892:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88571680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593209728:0@lo:400:kworker.0 00000100:00100000:3.0:1789117796.718918:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117796.718946:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789117796.718952:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593209088:0@lo:400:kworker.0 00000100:00100000:3.0:1789117796.718975:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117796.718994:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87e1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593209600:0@lo:400:kworker.0 00000100:00100000:3.0:1789117796.719020:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117796.719086:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593209728 00000100:00100000:3.0:1789117796.719094:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593209728 00000100:00100000:3.0:1789117796.719167:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789117796.719179:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87ef43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593209728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117796.719245:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87ef43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593209728:12345-0@lo:400:kworker.0 Request processed in 70us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117796.719253:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789117796.719381:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593208704 00000100:00100000:0.0:1789117796.719386:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593208704 00000100:00100000:0.0:1789117796.719416:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:0.0:1789117796.719422:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593208704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117796.719464:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593208704:12345-0@lo:400:kworker.0 Request processed in 43us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117796.719470:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:2.0:1789117796.720979:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593209216 00000100:00100000:2.0:1789117796.721008:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593209216 00000100:00100000:2.0:1789117796.721133:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593209600 00000100:00100000:2.0:1789117796.721138:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593209600 00000100:00100000:2.0:1789117796.721166:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1789117796.721177:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8852f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593209216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117796.721273:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8852f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593209216:12345-0@lo:400:kworker.0 Request processed in 98us (2404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117796.721281:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1789117796.721298:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:2.0:1789117796.721305:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8121ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593209600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117796.721336:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8121ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593209600:12345-0@lo:400:kworker.0 Request processed in 32us (2315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117796.721342:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:2.0:1789117796.721423:0:14928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593209088 00000100:00100000:2.0:1789117796.721428:0:14928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593209088 00000100:00100000:2.0:1789117796.721458:0:14928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789117796.721465:0:14928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8121fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593209088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117796.721503:0:14928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8121fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593209088:12345-0@lo:400:kworker.0 Request processed in 40us (2527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117796.721510:0:14928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:2.0:1789117796.721559:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789117796.721565:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789117796.721568:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117796.721642:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593209088:0@lo:400:kworker.0 00010000:00080000:2.0:1789117796.722829:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87e1e580 x1876025593209600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117796.722846:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593209600:0@lo:400:kworker.0 00000100:00100000:2.0:1789117796.722874:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88566940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593208704:0@lo:400:kworker.0 00000100:00100000:2.0:1789117796.722891:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87e1fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593209216:0@lo:400:kworker.0 00000100:00100000:2.0:1789117796.722905:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88571680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593209728:0@lo:400:kworker.0 00000100:00100000:1.0:1789117796.898852:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117796.898968:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572157824 00000100:00100000:2.0:1789117796.898985:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572157824 00000100:00100000:2.0:1789117796.899119:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 182 00000100:00100000:2.0:1789117796.899133:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+55:12616:x1876025572157824:12345-192.168.204.30@tcp:101:cat.0 00010000:00010000:2.0:1789117796.899185:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117796.899223:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2c00/0xaa253ed19be20615 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f0c6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.899448:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3c00/0xaa253ed19be2061c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.899469:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3c00/0xaa253ed19be2061c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.899483:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3c00/0xaa253ed19be2061c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117796.899496:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789117796.899661:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2c00/0xaa253ed19be20615 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0c6 expref: 58 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.899695:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3c00/0xaa253ed19be2061c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0c6 expref: 57 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.899705:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:2.0:1789117796.899709:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789117796.899715:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f3c00, rc 0) 00000100:00100000:2.0:1789117796.899806:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+57:12616:x1876025572157824:12345-192.168.204.30@tcp:101:cat.0 Request processed in 676us (969us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1789117796.899814:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 182 00000100:00100000:0.0:1789117796.937602:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117796.937781:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572157952 00000100:00100000:2.0:1789117796.937791:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572157952 00000100:00100000:2.0:1789117796.937871:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 183 00000100:00100000:2.0:1789117796.937882:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+57:12617:x1876025572157952:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789117796.937910:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117796.937946:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2c00/0xaa253ed19be2062a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f0cd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.938024:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20631 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.938039:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20631 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.938051:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20631 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117796.938141:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789117796.938155:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789117796.938181:0:6519:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20631 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.938212:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2c00/0xaa253ed19be2062a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0cd expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.938233:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20631 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0cd expref: 58 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117796.938243:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:2.0:1789117796.938246:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789117796.938260:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f2400, rc 0) 00000100:00100000:2.0:1789117796.938326:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+58:12617:x1876025572157952:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 446us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117796.938333:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 183 00000100:00100000:0.0:1789117796.944867:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117796.944989:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572158336 00000100:00100000:1.0:1789117796.945002:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572158336 00000100:00100000:1.0:1789117796.945157:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 48 00000100:00100000:1.0:1789117796.945171:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+58:12617:x1876025572158336:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:1.0:1789117796.945508:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+59:12617:x1876025572158336:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 340us (650us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1789117796.945518:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 48 00000100:00100000:2.0:1789117796.948009:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117796.948207:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572158464 00000100:00100000:0.0:1789117796.948220:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572158464 00000100:00100000:0.0:1789117796.948498:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:0.0:1789117796.948512:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87faad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+59:12617:x1876025572158464:12345-192.168.204.30@tcp:103:lfs.0 00010000:00010000:0.0:1789117796.948533:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789117796.948568:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be205c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0b1 expref: 59 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117796.948598:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3c00/0xaa253ed19be2061c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0c6 expref: 58 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117796.948613:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69000/0xaa253ed19be204be lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f06b expref: 57 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117796.948625:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:0.0:1789117796.948632:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117796.948964:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87faad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+56:12617:x1876025572158464:12345-192.168.204.30@tcp:103:lfs.0 Request processed in 455us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117796.948974:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:0.0:1789117796.951417:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117796.951524:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572158592 00000100:00100000:1.0:1789117796.951537:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572158592 00000100:00100000:1.0:1789117796.951644:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 184 00000100:00100000:1.0:1789117796.951674:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf8ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+56:12617:x1876025572158592:12345-192.168.204.30@tcp:58:lfs.0 00010000:00010000:1.0:1789117796.951817:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20638 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.951844:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20638 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.951857:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20638 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789117796.951961:0:9533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1789117796.952245:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf8ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+56:12617:x1876025572158592:12345-192.168.204.30@tcp:58:lfs.0 Request processed in 590us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117796.952263:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 184 00000100:00100000:3.0:1789117796.997836:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117796.997958:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572158720 00000100:00100000:1.0:1789117796.997970:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572158720 00000100:00100000:1.0:1789117796.998097:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 185 00000100:00100000:1.0:1789117796.998119:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+56:12619:x1876025572158720:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1789117796.998146:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117796.998183:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2063f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f0d4 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998259:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20646 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998275:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20646 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998287:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20646 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998302:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be2064d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998327:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be2064d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998334:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be2064d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998414:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20654 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998424:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20654 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998430:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20654 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117796.998472:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789117796.998477:0:14247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789117796.998497:0:14247:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20654 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998510:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20654 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998520:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20646 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998526:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20646 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998533:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20646 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998547:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117796.998551:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20646 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998558:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20646 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998569:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:1.0:1789117796.998572:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117796.998577:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20646 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998582:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20646 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998595:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be2064d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998600:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be2064d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998605:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be2064d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998609:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117796.998611:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be2064d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998616:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be2064d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998630:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff962b84d70f00) 00010000:00010000:1.0:1789117796.998632:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117796.998635:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be2064d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998640:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be2064d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998683:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2063f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0d4 expref: 58 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998697:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20654 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0d4 expref: 57 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117796.998704:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:1.0:1789117796.998706:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789117796.998709:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813db800, rc 0) 00000100:00100000:1.0:1789117796.998780:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+57:12619:x1876025572158720:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 672us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117796.998789:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 185 00000100:00100000:2.0:1789117797.221454:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789117797.221479:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593209984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789117797.221565:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117797.221766:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593209984 00000100:00100000:0.0:1789117797.221787:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593209984 00000100:00100000:0.0:1789117797.221950:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789117797.221964:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593209984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789117797.222022:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789117797.222111:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593209984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 150us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117797.222120:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789117797.222472:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593209984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117797.222510:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789117797.222524:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593210112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117797.222563:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117797.230648:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593210112 00000100:00100000:2.0:1789117797.230676:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593210112 00000100:00100000:2.0:1789117797.230761:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789117797.230773:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593210112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789117797.230810:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789117797.230927:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593210112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (8363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117797.230936:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789117797.231110:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593210112:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1789117797.349415:0:14501:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789117797.349429:0:14501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:3.0:1789117797.349444:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789117797.349512:0:14501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789117797.349527:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789117797.351389:0:14501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6c780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14501:1876025593210240:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789117797.352395:0:14501:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117797.361051:0:14501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6c780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14501:1876025593210240:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789117797.371371:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117797.371995:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572158848 00000100:00100000:2.0:1789117797.372014:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572158848 00000100:00080000:1.0:1789117797.372319:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117797.372451:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 186 00000100:00100000:2.0:1789117797.372469:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+57:12630:x1876025572158848:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789117797.372866:0:6519:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789117797.373460:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+57:12630:x1876025572158848:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 992us (2105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117797.373471:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 186 00000100:00100000:3.0:1789117797.385406:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117797.385880:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572158976 00000100:00100000:0.0:1789117797.385904:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572158976 00000100:00100000:0.0:1789117797.386316:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 187 00000100:00100000:0.0:1789117797.386334:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+57:12630:x1876025572158976:12345-192.168.204.30@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789117797.387566:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2065b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.387601:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2065b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.387621:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2065b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.389257:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20662 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.389298:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20662 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.389312:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20662 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.389387:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20669 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.389398:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20669 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.389405:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20669 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117797.390918:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789117797.390931:0:9533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789117797.390960:0:9533:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20669 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.390984:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2065b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.390992:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2065b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.391001:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2065b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.391027:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117797.391033:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2065b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.391043:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2065b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.391086:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff962bbe7ec500) 00010000:00010000:0.0:1789117797.391091:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117797.391600:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2065b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.391613:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2065b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.391639:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20662 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.391646:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20662 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.391653:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20662 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.391668:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117797.391672:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20662 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.391678:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20662 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.392352:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff962b832d0300) 00010000:00010000:0.0:1789117797.392356:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117797.392363:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20662 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.392369:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20662 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.392398:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20669 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.392404:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20669 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.392409:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20669 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.392415:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f5e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117797.392418:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20669 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.392425:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20669 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.392434:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:0.0:1789117797.392436:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117797.392439:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20669 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.392448:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20669 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117797.392623:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+57:12630:x1876025572158976:12345-192.168.204.30@tcp:34:lhsmtool_posix.0 Request processed in 6289us (7227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117797.392637:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 187 00000100:00100000:3.0:1789117797.417827:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117797.418384:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572159232 00000100:00100000:2.0:1789117797.418397:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572159232 00000100:00100000:2.0:1789117797.418470:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 188 00000100:00100000:2.0:1789117797.418482:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+57:12630:x1876025572159232:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117797.418512:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117797.424545:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be20670 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f0db expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.427269:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be20677 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.427300:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be20677 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.427313:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be20677 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117797.427329:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789117797.427432:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be20677 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.427441:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be20677 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.427448:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be20677 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.427455:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f3800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117797.427460:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be20677 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.427469:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be20677 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.427485:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:2.0:1789117797.427488:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789117797.427494:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be20677 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.427524:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be20677 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.427587:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be20670 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0db expref: 59 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.427599:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff962bbe7ec500) 00010000:00010000:2.0:1789117797.427601:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789117797.427606:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be20670 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0db expref: 59 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.427617:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f3e00, rc 0) 00000100:00100000:2.0:1789117797.427741:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+58:12630:x1876025572159232:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 9261us (9929us total) trans 4294967459 rc 301/301 00000100:00100000:2.0:1789117797.427752:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 188 00000100:00100000:2.0:1789117797.430440:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117797.430717:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572159360 00000100:00100000:0.0:1789117797.430730:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572159360 00000100:00100000:0.0:1789117797.430797:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 189 00000100:00100000:0.0:1789117797.430808:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88566940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+58:12630:x1876025572159360:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789117797.430841:0:6519:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789117797.430971:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88566940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+58:12630:x1876025572159360:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 164us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117797.430980:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 189 00000100:00100000:3.0:1789117797.442505:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117797.444514:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572159616 00000100:00100000:1.0:1789117797.444536:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572159616 00000100:00100000:1.0:1789117797.444649:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 190 00000100:00100000:1.0:1789117797.444673:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+58:12630:x1876025572159616:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789117797.444708:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117797.444713:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789117797.445245:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20631 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0cd expref: 58 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.445278:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:1.0:1789117797.445285:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789117797.445310:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20685 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f0e2 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789117797.448911:0:9533:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1789117797.449287:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be2068c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.449324:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be2068c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.449345:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be2068c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.449464:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20685 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0e2 expref: 60 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.449488:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be2068c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0e2 expref: 59 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.449499:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff962b84d70f00) 00010000:00010000:1.0:1789117797.449503:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117797.449507:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813db400, rc 0) 00000100:00100000:1.0:1789117797.449610:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+59:12630:x1876025572159616:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 4939us (7127us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1789117797.449646:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 190 00000100:00100000:0.0:1789117797.456766:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117797.456900:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572159872 00000100:00100000:2.0:1789117797.456918:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572159872 00000100:00100000:2.0:1789117797.457006:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 191 00000100:00100000:2.0:1789117797.457020:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8867bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+59:12630:x1876025572159872:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789117797.457180:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117797.457239:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be2068c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0e2 expref: 59 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.457266:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff962b84d70f00) 00010000:00010000:2.0:1789117797.457285:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117797.457507:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be2069a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.457527:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be2069a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.457541:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be2069a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.457563:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3400/0xaa253ed19be206a1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x6a16a8ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.457570:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3400/0xaa253ed19be206a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6a16a8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.457578:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3400/0xaa253ed19be206a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6a16a8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.457665:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be2069a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.457674:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be2069a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.457682:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be2069a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.457690:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f3800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117797.457696:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be2069a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.457706:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be2069a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.457727:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:2.0:1789117797.457730:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117797.457735:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be2069a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.457742:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be2069a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.457754:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3400/0xaa253ed19be206a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6a16a8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.457761:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3400/0xaa253ed19be206a1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6a16a8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.457766:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3400/0xaa253ed19be206a1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6a16a8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.457771:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f3400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117797.457774:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3400/0xaa253ed19be206a1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6a16a8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.457780:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3400/0xaa253ed19be206a1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6a16a8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.457787:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x6a16a8ce (ffff962a87c24800) 00010000:00010000:2.0:1789117797.457789:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117797.457793:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3400/0xaa253ed19be206a1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6a16a8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.457800:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3400/0xaa253ed19be206a1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6a16a8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117797.457934:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8867bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+58:12630:x1876025572159872:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 916us (1185us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789117797.457944:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 191 00000100:00100000:0.0:1789117797.462919:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117797.464198:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572160000 00000100:00100000:2.0:1789117797.464214:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572160000 00000100:00100000:2.0:1789117797.464290:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 192 00000100:00100000:2.0:1789117797.464303:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8867b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+58:12630:x1876025572160000:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117797.464331:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117797.464363:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be206a8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f0e9 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.464407:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be206af lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.464424:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be206af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.464450:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be206af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.464586:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be206a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0e9 expref: 60 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.464607:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be206af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0e9 expref: 59 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.464615:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff962a87c24e00) 00010000:00010000:2.0:1789117797.464626:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789117797.464631:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f3e00, rc 0) 00000100:00100000:2.0:1789117797.464731:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8867b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+59:12630:x1876025572160000:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 431us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117797.464739:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 192 00000100:00100000:3.0:1789117797.471485:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117797.471570:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572160256 00000100:00100000:1.0:1789117797.471588:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572160256 00000100:00100000:1.0:1789117797.471686:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 193 00000100:00100000:1.0:1789117797.471698:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae4b4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+59:12630:x1876025572160256:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789117797.471824:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be206b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.471846:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be206b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.471863:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be206b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789117797.472148:0:9533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1789117797.472162:0:9533:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 449755106710ns, next at 450755102903ns, rc = 0 00000004:00010000:1.0:1789117797.472242:0:9533:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000464a0bb8 reply state 00000000214b946d transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be206b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.472261:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be206b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.472273:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff962a87c24e00) 00010000:00010000:1.0:1789117797.472277:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789117797.472283:0:9533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789117797.472531:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae4b4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+61:12630:x1876025572160256:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 833us (1060us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1789117797.472539:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 193 00000100:00100000:3.0:1789117797.474895:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117797.474962:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572160384 00000100:00100000:3.0:1789117797.474976:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572160384 00000100:00100000:3.0:1789117797.475087:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 194 00000100:00100000:3.0:1789117797.475115:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+61:12630:x1876025572160384:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789117797.475159:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117797.475190:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be206bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f0f0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117797.475283:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be206bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0f0 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117797.476396:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be206bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0f0 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117797.476456:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff962a87c24e00) 00010000:00010000:3.0:1789117797.476470:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789117797.476476:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92a00, rc 0) 00000100:00100000:3.0:1789117797.476569:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+62:12630:x1876025572160384:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 1470us (1690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117797.476583:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 194 00000100:00100000:3.0:1789117797.481737:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117797.484111:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572160512 00000100:00100000:0.0:1789117797.484133:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572160512 00000100:00100000:0.0:1789117797.484248:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 58 00000100:00100000:0.0:1789117797.484261:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+6:2407:x1876025572160512:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789117797.484589:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2407:x1876025572160512:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 Request processed in 329us (2869us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789117797.484599:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 58 00000100:00080000:3.0:1789117797.485671:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117797.491600:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117797.492151:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572160768 00000100:00100000:3.0:1789117797.492173:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572160768 00000100:00100000:3.0:1789117797.492270:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 49 00000100:00100000:3.0:1789117797.492284:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88564b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+62:12630:x1876025572160768:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789117797.492677:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88564b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+63:12630:x1876025572160768:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 395us (1098us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1789117797.492688:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 49 00000100:00100000:0.0:1789117797.505308:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117797.505412:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572161024 00000100:00100000:3.0:1789117797.505430:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572161024 00000100:00100000:3.0:1789117797.505533:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 195 00000100:00100000:3.0:1789117797.505549:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88679680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+63:12630:x1876025572161024:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789117797.505937:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88679680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+63:12630:x1876025572161024:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 390us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117797.505949:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 195 00000100:00100000:3.0:1789117797.509108:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117797.510373:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572161152 00000100:00100000:1.0:1789117797.510408:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572161152 00000100:00100000:1.0:1789117797.510504:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 196 00000100:00100000:1.0:1789117797.510518:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+63:12630:x1876025572161152:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789117797.510547:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117797.510582:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be206c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f0f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.510705:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be206cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.510724:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be206cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.510740:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be206cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117797.510813:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789117797.510844:0:6519:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be206cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.510880:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be206c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0f7 expref: 65 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.510902:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be206cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0f7 expref: 64 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.510912:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff962a87c24e00) 00010000:00010000:1.0:1789117797.510915:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789117797.510920:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813dbe00, rc 0) 00000100:00100000:1.0:1789117797.511951:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+64:12630:x1876025572161152:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 1423us (2858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117797.511984:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 196 00000100:00100000:3.0:1789117797.521598:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117797.521727:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572161280 00000100:00100000:2.0:1789117797.521741:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572161280 00000100:00100000:2.0:1789117797.521813:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 59 00000100:00100000:2.0:1789117797.521829:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2404:x1876025572161280:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117797.521852:0:8833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117797.521889:0:8833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005057708f/0xaa253ed19be206d2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f0fe expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789117797.521922:0:8833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3c566, blocks: 0x0 00010000:00010000:2.0:1789117797.521943:0:8833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1789117797.521948:0:8833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117797.521958:0:8833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005057708f/0xaa253ed19be206d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0fe expref: 8 pid: 8833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.521977:0:8833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005057708f/0xaa253ed19be206d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0fe expref: 8 pid: 8833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.521993:0:8833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f3800, rc 0) 00000100:00100000:2.0:1789117797.522125:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2404:x1876025572161280:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 302us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117797.522156:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 59 00000100:00100000:0.0:1789117797.536771:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117797.536879:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572161536 00000100:00100000:2.0:1789117797.536896:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572161536 00000100:00100000:2.0:1789117797.536981:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 197 00000100:00100000:2.0:1789117797.536995:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88679a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+64:12630:x1876025572161536:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789117797.537210:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88679a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+64:12630:x1876025572161536:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 219us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117797.537218:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 197 00000100:00100000:2.0:1789117797.544556:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117797.545192:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572161664 00000100:00100000:1.0:1789117797.545205:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572161664 00000100:00100000:0.0:1789117797.545323:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00100000:0.0:1789117797.545344:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88567840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:12630:x1876025572161664:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789117797.545393:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117797.545421:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ba23cf8/0xaa253ed19be206d9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f105 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.545461:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005057708f/0xaa253ed19be206d2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0fe expref: 9 pid: 8833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.545471:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117797.545476:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117797.545482:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ba23cf8/0xaa253ed19be206d9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f105 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.545530:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005057708f/0xaa253ed19be206d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0fe expref: 9 pid: 8833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.545546:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005057708f/0xaa253ed19be206d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0fe expref: 9 pid: 8833 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117797.545562:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8867ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1876025593210368:192.168.204.30@tcp:104: 00000100:00100000:0.0:1789117797.545712:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117797.551507:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117797.552450:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572161792 00000100:00100000:2.0:1789117797.552466:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572161792 00010000:00010000:2.0:1789117797.552533:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005057708f/0xaa253ed19be206d2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0fe expref: 10 pid: 8833 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117797.552596:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 98 00000100:00100000:2.0:1789117797.552608:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa84f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+10:2407:x1876025572161792:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117797.552630:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117797.552672:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005057708f/0xaa253ed19be206d2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0fe expref: 10 pid: 8833 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.552688:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005057708f/0xaa253ed19be206d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0fe expref: 10 pid: 8833 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.552732:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117797.552738:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117797.552774:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000ba23cf8/0xaa253ed19be206d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f105 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.552788:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ba23cf8/0xaa253ed19be206d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f105 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.552853:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000ba23cf8/0xaa253ed19be206d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f105 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117797.552875:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88566580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6506:1876025593210496:192.168.204.30@tcp:105: 00000100:00100000:2.0:1789117797.553024:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a884896c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789117797.556004:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005057708f/0xaa253ed19be206d2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0fe expref: 10 pid: 8833 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117797.556038:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8867ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1876025593210368:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117797.556121:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000ba23cf8/0xaa253ed19be206d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f105 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.556177:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f4600, rc 0) 00000100:00100000:0.0:1789117797.556279:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88567840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:12630:x1876025572161664:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 10938us (11739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117797.556290:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00100000:0.0:1789117797.559707:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88566580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6506:1876025593210496:192.168.204.30@tcp:105: 00010000:00010000:0.0:1789117797.559752:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117797.559827:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa84f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2407:x1876025572161792:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 7220us (8333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117797.559840:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 98 00000100:00100000:0.0:1789117797.562727:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117797.562819:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572161920 00000100:00100000:2.0:1789117797.562833:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572161920 00002000:00100000:2.0:1789117797.562904:0:8441:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff962a8867ad00 x1876025572161920/t0(0) o4->35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp:348/0 lens 504/0 e 0 to 0 dl 1789117808 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789117797.562916:0:8441:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962a8867ad00 with x1876025572161920 ext(0->8) 00002000:00010000:2.0:1789117797.562924:0:8441:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff962a8867ad00 00000100:00100000:2.0:1789117797.562965:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:2.0:1789117797.562977:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8867ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2406:x1876025572161920:12345-192.168.204.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789117797.564712:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8867ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+10:2406:x1876025572161920:12345-192.168.204.30@tcp:4:lhsmtool_posix.0 Request processed in 1726us (1987us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789117797.564728:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 4 00002000:00100000:2.0:1789117797.564742:0:8441:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff962a8867ad00 x1876025572161920/t4294967315(0) o4->35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp:348/0 lens 504/448 e 0 to 0 dl 1789117808 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789117797.564754:0:8441:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962a8867ad00 with x1876025572161920 ext(0->8) 00002000:00010000:2.0:1789117797.564774:0:8441:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff962a8867ad00 00000100:00100000:3.0:1789117797.571736:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117797.571830:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572162048 00000100:00100000:0.0:1789117797.571844:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572162048 00000100:00100000:0.0:1789117797.571922:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 198 00000100:00100000:0.0:1789117797.571936:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+64:12630:x1876025572162048:12345-192.168.204.30@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789117797.585793:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1789117797.585821:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:2.0:1789117797.585866:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:2.0:1789117797.585912:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789117797.585926:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff962bbf839300 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789117797.585932:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962bbf61f000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff962bbf839c00 00000020:00080000:2.0:1789117797.585935:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962a86e2d300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff962b87cba800 00000020:00080000:2.0:1789117797.585974:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1789117797.586050:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1789117797.586369:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be2054a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586397:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be2054a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586407:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be2054a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586415:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70da00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117797.586420:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be2054a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586431:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be2054a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586454:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:1.0:1789117797.586458:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117797.586463:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be2054a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586469:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70da00/0xaa253ed19be2054a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586496:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be2056d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586502:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be2056d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586526:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be2056d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586531:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117797.586534:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be2056d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586541:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be2056d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586549:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:1.0:1789117797.586551:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117797.586554:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be2056d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586561:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c800/0xaa253ed19be2056d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586590:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be205b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586596:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be205b3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586602:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be205b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586608:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f5a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117797.586611:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be205b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586625:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be205b3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586634:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:1.0:1789117797.586636:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117797.586639:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be205b3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586645:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be205b3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586688:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be206b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586695:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be206b6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586707:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be206b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586713:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813daa00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117797.586716:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be206b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586722:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be206b6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586731:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff962a87c24e00) 00010000:00010000:1.0:1789117797.586734:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789117797.586738:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be206b6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.586753:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be206b6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117797.586899:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593210624:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789117797.586998:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117797.587102:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593210624 00000100:00100000:1.0:1789117797.587112:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593210624 00000100:00100000:1.0:1789117797.587176:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789117797.587189:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593210624:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789117797.587366:0:8833:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789117797.587371:0:8833:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789117798 00002000:00010000:1.0:1789117797.587374:0:8833:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789117797.587377:0:8833:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789117798 -> 1789117798 00002000:00010000:1.0:1789117797.587381:0:8833:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789117797.587427:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1876025593210624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 241us (429us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789117797.587435:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000004:00080000:1.0:1789117797.587486:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff962bc1a4b0c0/2, rc 0, transno 4294967316 00000100:00100000:1.0:1789117797.587493:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593210624:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789117797.587519:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88679e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593210752:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789117797.587559:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117797.587741:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+19:12630:x1876025572162048:12345-192.168.204.30@tcp:44:lhsmtool_posix.0 Request processed in 15805us (16020us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117797.587752:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 198 00000100:00100000:1.0:1789117797.590791:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593210752 00000100:00100000:1.0:1789117797.590806:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593210752 00000100:00100000:0.0:1789117797.590867:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117797.590872:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789117797.590884:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88678b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876025593210752:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789117797.590908:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572162176 00000100:00100000:0.0:1789117797.590914:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572162176 00002000:00080000:1.0:1789117797.590926:0:8434:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00000100:00100000:0.0:1789117797.590962:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 63 00000100:00100000:0.0:1789117797.590972:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+10:2407:x1876025572162176:12345-192.168.204.30@tcp:16:lhsmtool_posix.0 00002000:00010000:1.0:1789117797.590984:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa3c562, atime: 0x6aa3c563, ctime: 0x6aa3c562, blocks: 0x8 00010000:00010000:1.0:1789117797.590999:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be206e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.591033:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1789117797.591039:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117797.591049:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be206e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.591102:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be206e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.591114:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be206e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.591123:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be206e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.591143:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789117797.591158:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117797.591165:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be206e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.591174:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117797.591180:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be206e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.591190:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be206e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.591226:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be206e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.591235:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be206e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.591255:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117797.591257:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117797.591259:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117797.591490:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88678b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1876025593210752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 607us (3929us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789117797.591500:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:3.0:1789117797.591711:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff962a88679e00/2, rc 0, transno 4294967308 00000100:00100000:3.0:1789117797.591729:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88679e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593210752:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1789117797.596602:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:0.0:1789117797.596616:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:1.0:1789117797.596833:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2407:x1876025572162176:12345-192.168.204.30@tcp:16:lhsmtool_posix.0 Request processed in 5850us (5959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117797.596849:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 63 00000100:00100000:0.0:1789117797.606428:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117797.607137:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572162432 00000100:00100000:1.0:1789117797.607160:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572162432 00000100:00100000:1.0:1789117797.607254:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 199 00000100:00100000:1.0:1789117797.607267:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8867b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+19:12630:x1876025572162432:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789117797.607363:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117797.607407:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be206cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0f7 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.607434:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff962a87c24e00) 00010000:00010000:1.0:1789117797.607442:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789117797.607522:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be206e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.607543:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be206e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.607557:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be206e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789117797.613539:0:6519:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000030ad7b reply state 00000000214b946d transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be206e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.613576:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be206e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.613587:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff962a87c24e00) 00010000:00010000:0.0:1789117797.613591:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789117797.613596:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789117797.613801:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8867b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+20:12630:x1876025572162432:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 6530us (7383us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1789117797.613813:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 199 00000100:00100000:1.0:1789117797.623229:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117797.623330:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572162560 00000100:00100000:3.0:1789117797.623347:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572162560 00000100:00100000:3.0:1789117797.623466:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 64 00000100:00100000:3.0:1789117797.623481:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2406:x1876025572162560:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789117797.623763:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789117797.623768:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789117798 -> 1789117796 00002000:00010000:3.0:1789117797.623771:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789117795 00002000:00010000:3.0:1789117797.623774:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789117798 -> 1789117796 00002000:00010000:3.0:1789117797.623777:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789117797.623873:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2406:x1876025572162560:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 Request processed in 395us (661us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789117797.623884:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 64 00000100:00100000:0.0:1789117797.632689:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117797.632775:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572162816 00000100:00100000:3.0:1789117797.632790:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572162816 00000100:00100000:3.0:1789117797.632873:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 200 00000100:00100000:3.0:1789117797.632887:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8867a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+20:12630:x1876025572162816:12345-192.168.204.30@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789117797.632997:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be206ee lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117797.633023:0:14247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be206af lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0e9 expref: 20 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117797.633035:0:14247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be206ee lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117797.633114:0:14247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be206af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0e9 expref: 20 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117797.633146:0:14247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be206af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0e9 expref: 20 pid: 14247 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117797.633174:0:14247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa84000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14247:1876025593210880:192.168.204.30@tcp:104: 00000100:00100000:3.0:1789117797.633311:0:14247:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf839f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117797.638752:0:14247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa84000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14247:1876025593210880:192.168.204.30@tcp:104: 00010000:00010000:3.0:1789117797.638816:0:14247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be206ee lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117797.639804:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117797.640387:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572162944 00000100:00100000:3.0:1789117797.640399:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572162944 00010000:00010000:3.0:1789117797.640527:0:7470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be206af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0e9 expref: 21 pid: 14247 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117797.640595:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 99 00000100:00100000:3.0:1789117797.640610:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88678780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+21:2407:x1876025572162944:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117797.640635:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117797.640647:0:7470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be206af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0e9 expref: 21 pid: 14247 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117797.640680:0:7470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be206af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0e9 expref: 21 pid: 14247 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117797.640722:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be206af lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0e9 expref: 21 pid: 14247 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117797.640756:0:7470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff962a87c24e00) 00010000:00010000:3.0:1789117797.640764:0:7470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be206ee lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117797.640775:0:7470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be206ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117797.640786:0:7470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be206ee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117797.640830:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117797.640914:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88678780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+20:2407:x1876025572162944:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 307us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117797.640924:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 99 00010000:00010000:0.0:1789117797.640940:0:14247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be206ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.640949:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be206ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.641004:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be206ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.641014:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be206ee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.641022:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be206ee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.641036:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117797.641042:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be206ee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.641051:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be206ee lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.641080:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff962a87c24e00) 00010000:00010000:0.0:1789117797.641084:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789117797.641088:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be206ee lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.641165:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be206ee lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117797.641290:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8867a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+19:12630:x1876025572162816:12345-192.168.204.30@tcp:55:lhsmtool_posix.0 Request processed in 8401us (8612us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789117797.641301:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 200 00000100:00100000:0.0:1789117797.647209:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117797.647263:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572163072 00000100:00100000:1.0:1789117797.647277:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572163072 00000100:00100000:1.0:1789117797.647354:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 65 00000100:00100000:1.0:1789117797.647368:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8867a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2407:x1876025572163072:12345-192.168.204.30@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789117797.647517:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b83345b7/0xaa253ed19be206f5 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.647545:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000ba23cf8/0xaa253ed19be206d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f105 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.647554:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117797.647559:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789117797.647564:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b83345b7/0xaa253ed19be206f5 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.647610:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000ba23cf8/0xaa253ed19be206d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f105 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.647628:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000ba23cf8/0xaa253ed19be206d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f105 expref: 8 pid: 8437 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117797.647877:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a49a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1876025593211008:192.168.204.30@tcp:104: 00000100:00100000:1.0:1789117797.648014:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b87cf6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789117797.654166:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a49a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1876025593211008:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789117797.654236:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b83345b7/0xaa253ed19be206f5 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117797.657494:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117797.657759:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572163200 00000100:00100000:1.0:1789117797.657773:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572163200 00010000:00010000:1.0:1789117797.657832:0:9524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000ba23cf8/0xaa253ed19be206d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f105 expref: 9 pid: 8437 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117797.657888:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 100 00000100:00100000:1.0:1789117797.657899:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:2407:x1876025572163200:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117797.657974:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117797.658004:0:9524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000ba23cf8/0xaa253ed19be206d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f105 expref: 9 pid: 8437 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.658160:0:9524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000ba23cf8/0xaa253ed19be206d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f105 expref: 9 pid: 8437 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.658193:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ba23cf8/0xaa253ed19be206d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f105 expref: 9 pid: 8437 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.658212:0:9524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789117797.658218:0:9524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789117797.658297:0:9524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b83345b7/0xaa253ed19be206f5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.658324:0:9524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b83345b7/0xaa253ed19be206f5 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.658408:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117797.658506:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2407:x1876025572163200:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 607us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117797.658517:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 100 00010000:00010000:2.0:1789117797.660186:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b83345b7/0xaa253ed19be206f5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.660207:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b83345b7/0xaa253ed19be206f5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.660246:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b83345b7/0xaa253ed19be206f5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.660255:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b83345b7/0xaa253ed19be206f5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.660278:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b83345b7/0xaa253ed19be206f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.660286:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db400 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117797.660291:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b83345b7/0xaa253ed19be206f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.660302:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b83345b7/0xaa253ed19be206f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.660327:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b83345b7/0xaa253ed19be206f5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.660336:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b83345b7/0xaa253ed19be206f5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117797.660554:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8867a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2407:x1876025572163072:12345-192.168.204.30@tcp:1:lhsmtool_posix.0 Request processed in 13183us (13352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117797.660567:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 65 00000100:00100000:3.0:1789117797.662708:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117797.662965:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572163456 00000100:00100000:0.0:1789117797.662992:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572163456 00000100:00100000:0.0:1789117797.663234:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 201 00000100:00100000:0.0:1789117797.663246:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+19:12630:x1876025572163456:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789117797.663354:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be206fc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.663376:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20543 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f08e expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.663695:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be206fc lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.663747:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20543 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f08e expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.663764:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20543 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f08e expref: 19 pid: 6519 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117797.663782:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8867bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1876025593211136:192.168.204.30@tcp:104: 00000100:00100000:0.0:1789117797.663901:0:9533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb900 going to sleep for 11 seconds 00000100:00100000:1.0:1789117797.672101:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117797.672610:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572163584 00000100:00100000:3.0:1789117797.672624:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572163584 00010000:00010000:3.0:1789117797.672693:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20543 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f08e expref: 20 pid: 6519 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117797.672736:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 101 00000100:00100000:3.0:1789117797.672750:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb093ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+20:2406:x1876025572163584:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117797.672769:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117797.672777:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20543 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f08e expref: 20 pid: 6519 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117797.672805:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20543 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f08e expref: 20 pid: 6519 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117797.672837:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:3.0:1789117797.672844:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be206fc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117797.672858:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be206fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117797.672867:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be206fc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117797.672892:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117797.672963:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb093ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+20:2406:x1876025572163584:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 217us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117797.672972:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 101 00010000:00010000:0.0:1789117797.674797:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20543 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f08e expref: 19 pid: 6519 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117797.674827:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8867bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1876025593211136:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117797.674864:0:9533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be206fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.674878:0:9533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be206fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.674884:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be206fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.675360:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20703 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.675386:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be206bd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0f0 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.675499:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20703 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.675551:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be206bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0f0 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.675575:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be206bd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0f0 expref: 19 pid: 6521 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117797.675595:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8867bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1876025593211264:192.168.204.30@tcp:104: 00000100:00100000:0.0:1789117797.675827:0:9533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb300 going to sleep for 11 seconds 00000100:00100000:1.0:1789117797.679943:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117797.680012:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572163712 00000100:00100000:3.0:1789117797.680033:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572163712 00010000:00010000:3.0:1789117797.680118:0:7470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be206bd lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0f0 expref: 20 pid: 6521 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117797.680166:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 102 00000100:00100000:3.0:1789117797.680178:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+20:2406:x1876025572163712:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117797.680196:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117797.680203:0:7470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be206bd lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0f0 expref: 20 pid: 6521 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117797.680244:0:7470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be206bd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0f0 expref: 20 pid: 6521 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117797.680276:0:7470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff962a87c24e00) 00010000:00010000:3.0:1789117797.680284:0:7470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20703 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117797.680295:0:7470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20703 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117797.680303:0:7470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20703 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117797.680328:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117797.680395:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+20:2406:x1876025572163712:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 218us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117797.680405:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 102 00010000:00010000:0.0:1789117797.682766:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be206bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0f0 expref: 19 pid: 6521 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117797.683326:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8867bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1876025593211264:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117797.683363:0:9533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20703 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.683378:0:9533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20703 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.683385:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20703 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789117797.683585:0:9533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1789117797.683762:0:9533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1789117797.683979:0:9533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1789117797.684341:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8867bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9533:1876025593211392:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789117797.684752:0:9533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117797.685139:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593211392 00000100:00100000:1.0:1789117797.685151:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593211392 00000100:00100000:0.0:1789117797.685186:0:9533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87debc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789117797.685344:0:14928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789117797.685360:0:14928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8867b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9533:x1876025593211392:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789117797.685514:0:14928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8867b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9533:x1876025593211392:12345-0@lo:1000:mdt00_003.0 Request processed in 158us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117797.685524:0:14928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789117797.685674:0:9533:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1789117797.685680:0:9533:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff962bc1a4b0c0, transno 4294967316 00000100:00100000:0.0:1789117797.685707:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8867bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9533:1876025593211392:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1789117797.685910:0:9533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1789117797.686868:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8867bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9533:1876025593211520:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789117797.688557:0:9533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117797.688634:0:9533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb240 going to sleep for 11 seconds 00000100:00100000:1.0:1789117797.689038:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593211520 00000100:00100000:1.0:1789117797.689050:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593211520 00000100:00100000:1.0:1789117797.689144:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789117797.689158:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88678780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9533:x1876025593211520:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789117797.689392:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88678780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9533:x1876025593211520:12345-0@lo:1000:mdt00_003.0 Request processed in 236us (843us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789117797.689402:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789117797.689478:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8867bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9533:1876025593211520:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789117797.689543:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20703 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.689558:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20703 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.689567:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20703 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.689593:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f5e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117797.689598:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20703 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.689608:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20703 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.689629:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff962a87c24e00) 00010000:00010000:1.0:1789117797.689633:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789117797.689640:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20703 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.689647:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be20703 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.689690:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20638 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.689697:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20638 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.689703:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20638 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.689708:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dba00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117797.689711:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20638 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.689716:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20638 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.689748:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:1.0:1789117797.689751:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789117797.689754:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20638 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.689760:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20638 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.689793:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2070a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.689811:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20654 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0d4 expref: 22 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.689822:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2070a lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.689863:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20654 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0d4 expref: 22 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.689879:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20654 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0d4 expref: 22 pid: 14247 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117797.689894:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a49e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1876025593211648:192.168.204.30@tcp:104: 00000100:00100000:1.0:1789117797.689992:0:9533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b87cf6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789117797.692533:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a49e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9533:1876025593211648:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117797.692577:0:9533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2070a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117797.693033:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117797.693360:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572163840 00000100:00100000:0.0:1789117797.693371:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572163840 00010000:00010000:0.0:1789117797.693430:0:9524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20654 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0d4 expref: 23 pid: 14247 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117797.693476:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 103 00000100:00100000:0.0:1789117797.693488:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+23:2406:x1876025572163840:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117797.693506:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117797.693513:0:9524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20654 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0d4 expref: 23 pid: 14247 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.693525:0:9524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20654 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0d4 expref: 23 pid: 14247 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.693584:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20654 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f0d4 expref: 23 pid: 14247 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.693605:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:0.0:1789117797.693611:0:9524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2070a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.693623:0:9524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2070a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.693632:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2070a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.693686:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117797.693775:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+22:2406:x1876025572163840:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 288us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117797.693784:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 103 00010000:00010000:1.0:1789117797.693931:0:9533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2070a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.693952:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2070a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.693968:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2070a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.693976:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2070a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.693983:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2070a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.693990:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dbe00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117797.693996:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2070a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.694005:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2070a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.694016:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:1.0:1789117797.694029:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117797.694033:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2070a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.694040:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2070a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.694081:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be206fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.694088:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be206fc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.694112:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be206fc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.694118:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f5a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117797.694121:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be206fc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.694128:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be206fc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.694147:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962a87c24d00) 00010000:00010000:1.0:1789117797.694149:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789117797.694152:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be206fc lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117797.694159:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be206fc lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117797.694352:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+21:12630:x1876025572163456:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 31104us (31652us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1789117797.694363:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 201 00000020:00080000:1.0:1789117797.694367:0:9533:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789117797.695083:0:14501:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789117797.695091:0:14501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789117797.695686:0:14501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1789117797.695705:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789117797.699364:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117797.699476:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572164096 00000100:00100000:3.0:1789117797.699490:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572164096 00000100:00100000:3.0:1789117797.699569:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 50 00000100:00100000:3.0:1789117797.699581:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962baeaa7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+21:12630:x1876025572164096:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789117797.700011:0:6522:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789117797.700192:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:0.0:1789117797.700495:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20711 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.700519:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20711 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.700534:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20711 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.700564:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20711 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.700571:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20711 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.700578:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20711 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117797.700606:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789117797.700730:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117797.700740:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20711 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.700749:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4400 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117797.700755:0:9523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20711 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.700766:0:9523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20711 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117797.700784:0:9523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff962a87c24e00) 00000100:00100000:0.0:1789117797.700789:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962baeaa7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+23:12630:x1876025572164096:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 1207us (1437us total) trans 4294967470 rc 0/0 00010000:00010000:2.0:1789117797.700790:0:9523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789117797.700799:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20711 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117797.700805:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 50 00010000:00010000:2.0:1789117797.700813:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20711 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789117797.700815:0:6522:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789117797.700835:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117797.700838:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117797.700840:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789117797.933032:0:15312:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789117797.933050:0:15312:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789117797.933131:0:15312:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789117797.933139:0:15312:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789117798.133371:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117798.133535:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572164352 00000100:00100000:3.0:1789117798.133547:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572164352 00000100:00100000:3.0:1789117798.133630:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 202 00000100:00100000:3.0:1789117798.133654:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88567c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+23:12640:x1876025572164352:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1789117798.133715:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117798.133745:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be20718 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f10c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.133894:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be2071f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.133914:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be2071f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.133929:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be2071f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117798.133942:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789117798.134118:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be20718 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f10c expref: 26 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.134153:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be2071f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f10c expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.134162:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:3.0:1789117798.134165:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789117798.134169:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93c00, rc 0) 00000100:00100000:3.0:1789117798.134248:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88567c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+25:12640:x1876025572164352:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 608us (896us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789117798.134267:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 202 00000100:00100000:1.0:1789117798.138325:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117798.138472:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572164480 00000100:00100000:3.0:1789117798.138490:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572164480 00000100:00100000:3.0:1789117798.138581:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 203 00000100:00100000:3.0:1789117798.138607:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+25:12640:x1876025572164480:12345-192.168.204.30@tcp:34:lfs.0 00010000:00010000:3.0:1789117798.138892:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be2072d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.138924:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be2072d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.138940:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be2072d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.138959:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20734 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.138968:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20734 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.138975:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20734 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.139347:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be2073b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.139358:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be2073b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.139367:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be2073b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789117798.139465:0:14247:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be2073b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.139486:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be2072d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.139512:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be2072d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.139521:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be2072d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.139528:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117798.139535:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be2072d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.139547:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be2072d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.139567:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:3.0:1789117798.139570:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117798.139578:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be2072d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.139586:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be2072d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.139606:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20734 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.139613:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20734 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.139620:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20734 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.139626:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117798.139636:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20734 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.139656:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20734 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.139664:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff962bae4aed00) 00010000:00010000:3.0:1789117798.139668:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117798.139671:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20734 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.140792:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20734 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.140857:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be2073b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.140865:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be2073b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.140873:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be2073b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.140880:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117798.140885:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be2073b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.140894:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be2073b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.140914:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962bae4ae300) 00010000:00010000:3.0:1789117798.140918:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117798.140950:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be2073b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.140957:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be2073b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117798.142012:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+25:12640:x1876025572164480:12345-192.168.204.30@tcp:34:lfs.0 Request processed in 3391us (3692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117798.142030:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 203 00000100:00100000:2.0:1789117798.241373:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117798.241433:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117798.241463:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117798.241492:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117798.241521:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117798.241532:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572164608 00000100:00100000:2.0:1789117798.241544:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572165120 00000100:00100000:3.0:1789117798.241545:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572164608 00000100:00100000:2.0:1789117798.241546:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572165120 00000100:00100000:2.0:1789117798.241604:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572164736 00000100:00100000:2.0:1789117798.241607:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572164736 00000100:00100000:3.0:1789117798.241610:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 467 00000100:00100000:3.0:1789117798.241621:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572164608:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117798.241660:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572164992 00000100:00100000:2.0:1789117798.241663:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572164992 00000100:00100000:2.0:1789117798.241682:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 414 00000100:00100000:2.0:1789117798.241688:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88565a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572165120:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117798.241722:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2407:x1876025572164608:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 103us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117798.241722:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88565a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572165120:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 34us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117798.241731:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 467 00000100:00100000:2.0:1789117798.241731:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 414 00000100:00100000:2.0:1789117798.241749:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 415 00000100:00100000:2.0:1789117798.241755:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88566d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572164736:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117798.241772:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 416 00000100:00100000:2.0:1789117798.241775:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88566d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572164736:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 21us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117798.241779:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572164992:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117798.241782:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 415 00000100:00100000:3.0:1789117798.241806:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572164992:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 28us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117798.241825:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 416 00000100:00080000:2.0:1789117798.241838:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789117798.241843:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789117798.242501:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572164864 00000100:00100000:0.0:1789117798.242510:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572164864 00000100:00100000:0.0:1789117798.242576:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 152 00000100:00100000:0.0:1789117798.242586:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88565680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2407:x1876025572164864:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117798.242630:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88565680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2407:x1876025572164864:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 47us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117798.242636:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 152 00000100:00080000:0.0:1789117798.242668:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117798.257937:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117798.258036:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572165376 00000100:00100000:1.0:1789117798.258116:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572165376 00000100:00100000:1.0:1789117798.258207:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 204 00000100:00100000:1.0:1789117798.258219:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+25:12643:x1876025572165376:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1789117798.258249:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117798.258291:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20742 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f113 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.258397:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20749 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.258416:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20749 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.258430:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20749 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.258447:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20750 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.258456:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20750 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.258462:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20750 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.258614:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20757 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.258624:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20757 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.258632:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20757 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117798.258666:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789117798.258771:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20749 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.258780:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20749 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.258786:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20749 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.258793:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117798.258798:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20749 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.258806:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20749 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.258819:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:1.0:1789117798.258822:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117798.258828:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20749 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.258836:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20749 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.258850:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20750 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.258857:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20750 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.258873:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20750 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.258879:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117798.258882:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20750 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.258888:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20750 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.258897:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff962b84d70a00) 00010000:00010000:1.0:1789117798.258899:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117798.258903:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20750 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.258909:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20750 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.258961:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20742 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f113 expref: 28 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.258976:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20757 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f113 expref: 27 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.258984:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962b84d70f00) 00010000:00010000:1.0:1789117798.258986:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117798.258988:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813dbe00, rc 0) 00000100:00100000:1.0:1789117798.259104:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+27:12643:x1876025572165376:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 887us (1183us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1789117798.259126:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 204 00000100:00100000:1.0:1789117798.269311:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117798.272753:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572165504 00000100:00100000:3.0:1789117798.272780:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572165504 00000100:00100000:3.0:1789117798.272983:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 205 00000100:00100000:3.0:1789117798.272999:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+27:12643:x1876025572165504:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:3.0:1789117798.273146:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be20765 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.273198:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be20765 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.273217:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be20765 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.273286:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be20765 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.273294:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be20765 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.273305:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be20765 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.273313:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117798.273321:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be20765 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.273333:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be20765 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.273350:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962b84d70f00) 00010000:00010000:3.0:1789117798.273355:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789117798.273362:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be20765 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.273370:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be20765 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117798.273505:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+27:12643:x1876025572165504:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 509us (4212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117798.273520:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 205 00000100:00100000:2.0:1789117798.278371:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117798.278958:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572165760 00000100:00100000:1.0:1789117798.278974:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572165760 00000100:00100000:1.0:1789117798.279098:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00100000:1.0:1789117798.279110:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+27:12643:x1876025572165760:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:1.0:1789117798.279447:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+28:12643:x1876025572165760:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 339us (1088us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1789117798.279456:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00100000:3.0:1789117798.334294:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117798.334350:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572166016 00000100:00100000:3.0:1789117798.334365:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572166016 00000100:00100000:3.0:1789117798.334449:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 206 00000100:00100000:3.0:1789117798.334461:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+28:12174:x1876025572166016:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:3.0:1789117798.334497:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117798.334526:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be2076c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f11a expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.334690:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20773 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.334708:0:14247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20757 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f113 expref: 29 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.334718:0:14247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20773 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.334762:0:14247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20757 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f113 expref: 29 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.334776:0:14247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20757 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f113 expref: 29 pid: 9533 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117798.334789:0:14247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa84000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14247:1876025593211776:192.168.204.30@tcp:104: 00000100:00100000:3.0:1789117798.334889:0:14247:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf839cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117798.342108:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117798.342156:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572166144 00000100:00100000:1.0:1789117798.342167:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572166144 00010000:00010000:1.0:1789117798.342213:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20757 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f113 expref: 30 pid: 9533 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117798.342254:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 104 00000100:00100000:1.0:1789117798.342265:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a48780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+30:2406:x1876025572166144:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117798.342285:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117798.342292:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20757 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f113 expref: 30 pid: 9533 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.342306:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20757 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f113 expref: 30 pid: 9533 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.342329:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962b84d70f00) 00010000:00010000:1.0:1789117798.342335:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20773 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.342354:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20773 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.342361:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20773 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.342382:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117798.342443:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a48780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+30:2406:x1876025572166144:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 179us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117798.342451:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 104 00010000:00010000:1.0:1789117798.342572:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20757 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f113 expref: 29 pid: 9533 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117798.342586:0:14247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa84000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14247:1876025593211776:192.168.204.30@tcp:104: 00010000:00010000:1.0:1789117798.342609:0:14247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20773 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.342618:0:14247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20773 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.342623:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20773 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117798.342655:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789117798.342801:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be2076c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f11a expref: 30 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.342816:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20773 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f11a expref: 29 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.342833:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962b84d70f00) 00010000:00010000:1.0:1789117798.342836:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789117798.342839:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93600, rc 0) 00000100:00100000:1.0:1789117798.342870:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+29:12174:x1876025572166016:12345-192.168.204.30@tcp:101:bash.0 Request processed in 8412us (8592us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1789117798.342878:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 206 00000100:00100000:3.0:1789117798.352332:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117798.352378:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572166272 00000100:00100000:3.0:1789117798.352391:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572166272 00000100:00100000:3.0:1789117798.352464:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 207 00000100:00100000:3.0:1789117798.352478:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+29:12174:x1876025572166272:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:3.0:1789117798.352513:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117798.352534:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20781 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f121 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.352581:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be20788 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.352599:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be20788 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.352613:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be20788 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.352793:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20781 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f121 expref: 31 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.352816:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be20788 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f121 expref: 30 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.352828:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962b84d70f00) 00010000:00010000:3.0:1789117798.352832:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789117798.352837:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93000, rc 0) 00000100:00100000:3.0:1789117798.352929:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+30:12174:x1876025572166272:12345-192.168.204.30@tcp:101:bash.0 Request processed in 454us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117798.352949:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 207 00000100:00100000:1.0:1789117798.355406:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117798.355886:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572166528 00000100:00100000:3.0:1789117798.355898:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572166528 00000100:00100000:3.0:1789117798.355975:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 208 00000100:00100000:3.0:1789117798.355987:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+30:12174:x1876025572166528:12345-192.168.204.30@tcp:36:bash.0 00010000:00010000:3.0:1789117798.356302:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be2078f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.356320:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be2078f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.356332:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be2078f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789117798.356378:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:3.0:1789117798.356403:0:6519:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008822fa42 reply state 00000000a9474ba1 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be2078f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.356416:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be2078f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.356423:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962b84d70f00) 00010000:00010000:3.0:1789117798.356426:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789117798.356430:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789117798.356469:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:3.0:1789117798.356580:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+34:12174:x1876025572166528:12345-192.168.204.30@tcp:36:bash.0 Request processed in 594us (1185us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789117798.356587:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 208 00000020:00080000:3.0:1789117798.356592:0:6519:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789117798.361435:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117798.361521:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572166656 00000100:00100000:3.0:1789117798.361532:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572166656 00000100:00100000:3.0:1789117798.361624:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 209 00000100:00100000:3.0:1789117798.361634:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+34:12174:x1876025572166656:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:3.0:1789117798.361720:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117798.361742:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b400/0xaa253ed19be20796 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f128 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.361797:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b400/0xaa253ed19be20796 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f128 expref: 35 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.361810:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b400/0xaa253ed19be20796 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f128 expref: 35 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.361828:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962b84d70f00) 00010000:00010000:3.0:1789117798.361832:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789117798.361835:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962baea9b400, rc 0) 00000100:00100000:3.0:1789117798.361891:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+35:12174:x1876025572166656:12345-192.168.204.30@tcp:101:bash.0 Request processed in 259us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117798.361898:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 209 00000100:00100000:3.0:1789117798.367373:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117798.368271:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572166784 00000100:00100000:2.0:1789117798.368282:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572166784 00000100:00100000:2.0:1789117798.368342:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 66 00000100:00100000:2.0:1789117798.368353:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:12174:x1876025572166784:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1789117798.368370:0:8833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117798.368390:0:8833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000157b1ab6/0xaa253ed19be2079d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f12f expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789117798.368416:0:8833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa3c564, atime: 0x6aa3c563, ctime: 0x6aa3c564, blocks: 0x8 00010000:00010000:2.0:1789117798.368436:0:8833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1789117798.368441:0:8833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117798.368461:0:8833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000157b1ab6/0xaa253ed19be2079d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f12f expref: 8 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117798.368481:0:8833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000157b1ab6/0xaa253ed19be2079d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f12f expref: 8 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117798.368494:0:8833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f3a00, rc 0) 00000100:00100000:2.0:1789117798.368548:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:12174:x1876025572166784:12345-192.168.204.30@tcp:101:bash.0 Request processed in 198us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117798.368555:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 66 00010000:00010000:3.0:1789117798.373502:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117798.374390:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117798.374472:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572166912 00000100:00100000:2.0:1789117798.374482:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572166912 00002000:00010000:2.0:1789117798.374529:0:8442:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1789117798.374535:0:8442:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962bbfa86580 with x1876025572166912 ext(0->18446744073709551615) 00002000:00010000:2.0:1789117798.374548:0:8442:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff962bbfa86580. 00000100:00100000:2.0:1789117798.374688:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:2.0:1789117798.374701:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2407:x1876025572166912:12345-192.168.204.30@tcp:10:bash.0 00002000:00010000:2.0:1789117798.374982:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789117798.374986:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789117796 -> 1789117798 00002000:00010000:2.0:1789117798.374989:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1789117795 -> 1789117795 00002000:00010000:2.0:1789117798.374991:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789117796 -> 1789117798 00002000:00010000:2.0:1789117798.374994:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1789117798.375100:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:2407:x1876025572166912:12345-192.168.204.30@tcp:10:bash.0 Request processed in 402us (716us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789117798.381563:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 5 00002000:00010000:2.0:1789117798.381575:0:8442:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1789117798.381597:0:8442:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962bbfa86580 with x1876025572166912 ext(0->18446744073709551615) 00002000:00010000:2.0:1789117798.381609:0:8442:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff962bbfa86580. 00000100:00100000:1.0:1789117798.461893:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117798.462014:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572167040 00000100:00100000:3.0:1789117798.462028:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572167040 00000100:00100000:3.0:1789117798.462288:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 210 00000100:00100000:3.0:1789117798.462302:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+35:12657:x1876025572167040:12345-192.168.204.30@tcp:34:lfs.0 00010000:00010000:3.0:1789117798.462591:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be207a4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.462626:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be207a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.462650:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be207a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.462673:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be207ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.462682:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be207ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.462689:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be207ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.462771:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.462781:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.462788:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789117798.462838:0:6521:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.462850:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be207a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.462857:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be207a4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.462874:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be207a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.462881:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9bc00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117798.462886:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be207a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.462896:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be207a4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.462910:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:3.0:1789117798.462914:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117798.462919:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be207a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.462926:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be207a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.462942:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be207ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.462948:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be207ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.462953:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be207ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.462958:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117798.462960:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be207ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.462975:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be207ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.462982:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff962bae4ae300) 00010000:00010000:3.0:1789117798.462985:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117798.462988:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be207ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.462993:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be207ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.463006:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.463011:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.463017:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.463022:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117798.463024:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.463029:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.463037:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962b84d70f00) 00010000:00010000:3.0:1789117798.463039:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117798.463042:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.463108:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117798.463207:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+35:12657:x1876025572167040:12345-192.168.204.30@tcp:34:lfs.0 Request processed in 907us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117798.463215:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 210 00000100:00100000:3.0:1789117798.502280:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117798.502534:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572167296 00000100:00100000:0.0:1789117798.502547:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572167296 00000100:00100000:0.0:1789117798.502624:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 211 00000100:00100000:0.0:1789117798.502650:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+35:12660:x1876025572167296:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1789117798.502704:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117798.502734:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be207b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f136 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.502836:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be207c0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.502856:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be207c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.502870:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be207c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.502888:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be207c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.502895:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be207c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.502903:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be207c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.503328:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be207ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.503342:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be207ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.503350:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be207ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117798.503363:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789117798.503500:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be207c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.503510:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be207c0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.503517:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be207c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.503525:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117798.503530:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be207c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.503539:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be207c0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.503555:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:0.0:1789117798.503558:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117798.503565:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be207c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.503572:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be207c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.503597:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be207c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.503604:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be207c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.503763:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be207c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.503768:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117798.503777:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be207c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.503784:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be207c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.503792:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff962b832d0100) 00010000:00010000:0.0:1789117798.503795:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117798.503799:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be207c7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.503805:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be207c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.503866:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be207b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f136 expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.503882:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be207ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f136 expref: 37 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.503891:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962b84d70f00) 00010000:00010000:0.0:1789117798.503894:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789117798.503897:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f4400, rc 0) 00000100:00100000:0.0:1789117798.504283:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+37:12660:x1876025572167296:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 1647us (2027us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1789117798.504293:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 211 00000100:00100000:1.0:1789117798.507324:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117798.507433:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572167424 00000100:00100000:3.0:1789117798.507446:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572167424 00000100:00100000:3.0:1789117798.507547:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 212 00000100:00100000:3.0:1789117798.507560:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+37:12660:x1876025572167424:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:3.0:1789117798.507667:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.507683:0:14247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20773 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f11a expref: 37 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.507691:0:14247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207dc lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.507729:0:14247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20773 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f11a expref: 37 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.507741:0:14247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20773 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f11a expref: 37 pid: 14247 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117798.507754:0:14247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa85a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14247:1876025593211904:192.168.204.30@tcp:104: 00000100:00100000:3.0:1789117798.507942:0:14247:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf8393c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117798.510026:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117798.510121:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572167680 00000100:00100000:2.0:1789117798.510131:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572167680 00000100:00100000:3.0:1789117798.510190:0:14247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa85a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14247:1876025593211904:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789117798.510205:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 52 00000100:00100000:2.0:1789117798.510216:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+38:6177:x1876025572167680:12345-192.168.204.30@tcp:35:ldlm_bl.0 00010000:00010000:3.0:1789117798.510237:0:14247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789117798.510520:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967479 00000100:00100000:2.0:1789117798.510683:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+40:6177:x1876025572167680:12345-192.168.204.30@tcp:35:ldlm_bl.0 Request processed in 467us (668us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1789117798.510692:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 52 00000020:00080000:2.0:1789117798.510698:0:6523:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789117798.512854:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117798.513206:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572167808 00000100:00100000:1.0:1789117798.513221:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572167808 00010000:00010000:1.0:1789117798.513295:0:7470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20773 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f11a expref: 40 pid: 14247 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117798.513348:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 105 00000100:00100000:1.0:1789117798.513360:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa85a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+40:2407:x1876025572167808:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117798.513572:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117798.513597:0:7470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20773 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f11a expref: 40 pid: 14247 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.513614:0:7470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20773 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f11a expref: 40 pid: 14247 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.513661:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20773 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f11a expref: 40 pid: 14247 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.513705:0:7470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962b84d70f00) 00010000:00010000:1.0:1789117798.513711:0:7470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.513725:0:7470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.513735:0:7470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207dc lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.513781:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789117798.513853:0:14247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.513865:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117798.513880:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa85a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+39:2407:x1876025572167808:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 521us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117798.513889:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 105 00010000:00010000:3.0:1789117798.513942:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.513951:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.513958:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.513965:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117798.513970:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.513978:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.513988:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962b84d70f00) 00010000:00010000:3.0:1789117798.513991:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789117798.513996:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.514011:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117798.514300:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+38:12660:x1876025572167424:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 6741us (6991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117798.514311:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 212 00000100:00100000:1.0:1789117798.516555:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117798.516755:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572168064 00000100:00100000:0.0:1789117798.516769:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572168064 00000100:00100000:0.0:1789117798.516849:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 53 00000100:00100000:0.0:1789117798.516862:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+38:12660:x1876025572168064:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:0.0:1789117798.517883:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+39:12660:x1876025572168064:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 1017us (1335us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1789117798.517895:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 53 00000100:00100000:2.0:1789117798.583228:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117798.584907:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572168320 00000100:00100000:3.0:1789117798.584928:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572168320 00000100:00100000:3.0:1789117798.585027:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 213 00000100:00100000:3.0:1789117798.585041:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+39:12671:x1876025572168320:12345-192.168.204.30@tcp:101:cat.0 00010000:00010000:3.0:1789117798.585226:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117798.585486:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be207e3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f13d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.585597:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207ea lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.585616:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.585630:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.585728:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be207f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.585738:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be207f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.585767:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be207f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.585912:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be207f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.585923:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be207f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.585931:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be207f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117798.585943:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1789117798.586048:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.586204:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207ea lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.586213:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.586220:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117798.586224:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.586232:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207ea lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.586246:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:3.0:1789117798.586250:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117798.586434:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.586441:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be207ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.586459:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be207f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.586465:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be207f1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.586471:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be207f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.586477:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117798.586480:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be207f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.586487:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be207f1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.586494:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff962bae4ae300) 00010000:00010000:3.0:1789117798.586497:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117798.586499:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be207f1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.586688:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be207f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.586751:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be207e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f13d expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.586781:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be207f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f13d expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.586789:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962b84d70f00) 00010000:00010000:3.0:1789117798.586792:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789117798.586794:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962baea9bc00, rc 0) 00000100:00100000:3.0:1789117798.586906:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+41:12671:x1876025572168320:12345-192.168.204.30@tcp:101:cat.0 Request processed in 1867us (3860us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1789117798.586915:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 213 00000100:00100000:3.0:1789117798.596194:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117798.597217:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572168576 00000100:00100000:2.0:1789117798.597238:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572168576 00000100:00100000:2.0:1789117798.597337:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 54 00000100:00100000:2.0:1789117798.597352:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+41:12671:x1876025572168576:12345-192.168.204.30@tcp:35:cat.0 00000100:00100000:2.0:1789117798.598014:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+42:12671:x1876025572168576:12345-192.168.204.30@tcp:35:cat.0 Request processed in 663us (1841us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1789117798.598026:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 54 00000100:00100000:1.0:1789117798.623015:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117798.625518:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572168832 00000100:00100000:0.0:1789117798.625541:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572168832 00000100:00100000:0.0:1789117798.625916:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 214 00000100:00100000:0.0:1789117798.625931:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+42:12672:x1876025572168832:12345-192.168.204.30@tcp:36:rm.0 00010000:00010000:0.0:1789117798.626048:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1789117798.626113:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b400/0xaa253ed19be20796 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f128 expref: 42 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.626142:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be207f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f13d expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.626169:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be207ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f136 expref: 40 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.626187:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be20788 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f121 expref: 39 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.626200:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962b84d70f00) 00010000:00010000:0.0:1789117798.626207:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117798.626239:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20806 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.626256:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20806 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.626297:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20806 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.626315:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2080d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.626323:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2080d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.626331:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2080d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.626457:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20814 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.626466:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20814 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.626473:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20814 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789117798.627873:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1789117798.627889:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 450910834561ns, next at 451910830549ns, rc = 0 00010000:00010000:0.0:1789117798.628322:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2081b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.628341:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2081b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.628352:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2081b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.628385:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2081b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.628392:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2081b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.628398:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2081b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.628466:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789117798.628505:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20814 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.628512:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20814 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.628519:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20814 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.628526:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117798.628531:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20814 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.628540:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20814 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.628620:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962b84d70f00) 00010000:00010000:0.0:1789117798.628624:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789117798.628631:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20814 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.628658:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20814 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.628686:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20806 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.628692:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20806 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.628699:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20806 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.628705:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117798.628708:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20806 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.628715:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20806 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.628726:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:0.0:1789117798.628729:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117798.628732:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20806 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.628737:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20806 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789117798.628750:0:6520:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004f1ff535 reply state 000000003f7b0fd3 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2080d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.628763:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2080d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.628776:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff962b832d0100) 00010000:00010000:0.0:1789117798.628779:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789117798.628784:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789117798.628909:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+40:12672:x1876025572168832:12345-192.168.204.30@tcp:36:rm.0 Request processed in 2976us (5916us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1789117798.628919:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 214 00010000:00010000:1.0:1789117798.630644:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117798.630665:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2081b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.630680:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f5e00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117798.630685:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2081b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.630696:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2081b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.630720:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962b84d70f00) 00010000:00010000:1.0:1789117798.630724:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789117798.630755:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2081b lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.630761:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5e00/0xaa253ed19be2081b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.630787:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117798.630789:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117798.630791:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117798.693962:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117798.694101:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572169088 00000100:00100000:3.0:1789117798.694121:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572169088 00000100:00100000:3.0:1789117798.694203:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 215 00000100:00100000:3.0:1789117798.694216:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9277fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+40:12678:x1876025572169088:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:3.0:1789117798.694262:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117798.694296:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be20822 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f144 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.694834:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20829 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.694858:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20829 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.694878:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20829 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.694923:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20830 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.694932:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20830 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.694939:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20830 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789117798.696561:0:14247:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1789117798.697511:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2800/0xaa253ed19be20837 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117798.697537:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2800/0xaa253ed19be20837 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117798.697557:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2800/0xaa253ed19be20837 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117798.698866:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20829 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117798.698877:0:14247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20829 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117798.698885:0:14247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20829 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117798.698893:0:14247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117798.698900:0:14247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20829 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117798.698910:0:14247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20829 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117798.698932:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:2.0:1789117798.698935:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117798.698943:0:14247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20829 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117798.698950:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be20829 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789117798.698977:0:14247:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a92a0c55 reply state 000000001379b5d0 transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20830 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117798.698996:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20830 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117798.699004:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff962b832d0100) 00010000:00010000:2.0:1789117798.699018:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789117798.699023:0:14247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789117798.699471:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be20822 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f144 expref: 43 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117798.699499:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2800/0xaa253ed19be20837 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f144 expref: 42 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117798.699509:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db400) 00010000:00010000:2.0:1789117798.699511:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789117798.699514:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f2800, rc 0) 00000100:00100000:2.0:1789117798.700445:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9277fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+43:12678:x1876025572169088:12345-192.168.204.30@tcp:101:bash.0 Request processed in 5839us (6112us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789117798.700460:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 215 00000100:00100000:3.0:1789117798.709483:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117798.710048:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572169216 00000100:00100000:0.0:1789117798.710090:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572169216 00000100:00100000:0.0:1789117798.710198:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00100000:0.0:1789117798.710212:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2407:x1876025572169216:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:0.0:1789117798.710782:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117798.710825:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa0fb10b/0xaa253ed19be20845 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f14b expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789117798.710868:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117798.710905:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=450s v=(0 0) 00010000:00010000:0.0:1789117798.710912:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117798.710927:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa0fb10b/0xaa253ed19be20845 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f14b expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.711424:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aa0fb10b/0xaa253ed19be20845 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f14b expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117798.711451:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f4200, rc 0) 00000100:00100000:0.0:1789117798.711562:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2407:x1876025572169216:12345-192.168.204.30@tcp:101:bash.0 Request processed in 1351us (2341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117798.711791:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00100000:1.0:1789117798.724885:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117798.725152:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572169344 00000100:00100000:2.0:1789117798.725171:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572169344 00000100:00100000:2.0:1789117798.725282:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 68 00000100:00100000:2.0:1789117798.725296:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfc05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:12678:x1876025572169344:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1789117798.725328:0:8833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117798.725356:0:8833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be2084c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f152 expref: -99 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117798.725403:0:8833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa0fb10b/0xaa253ed19be20845 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f14b expref: 9 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117798.725415:0:8833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789117798.725420:0:8833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117798.725426:0:8833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be2084c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f152 expref: 9 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117798.725498:0:8833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aa0fb10b/0xaa253ed19be20845 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f14b expref: 9 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117798.725517:0:8833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aa0fb10b/0xaa253ed19be20845 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f14b expref: 9 pid: 8434 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117798.725546:0:8833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a885643c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8833:1876025593212032:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789117798.725918:0:8833:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a884890c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117798.740700:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117798.741115:0:8833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a885643c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8833:1876025593212032:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789117798.741175:0:8833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be2084c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f152 expref: 9 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117798.741212:0:8833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f2000, rc 0) 00000100:00100000:2.0:1789117798.741320:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfc05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:12678:x1876025572169344:12345-192.168.204.30@tcp:101:bash.0 Request processed in 16027us (16456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117798.741336:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 68 00000100:00100000:3.0:1789117798.742506:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572169472 00000100:00100000:3.0:1789117798.742535:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572169472 00010000:00010000:3.0:1789117798.742610:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aa0fb10b/0xaa253ed19be20845 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f14b expref: 9 pid: 8434 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117798.742676:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 106 00000100:00100000:3.0:1789117798.742690:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9277e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:2406:x1876025572169472:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117798.742714:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117798.742753:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aa0fb10b/0xaa253ed19be20845 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f14b expref: 9 pid: 8434 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.742770:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aa0fb10b/0xaa253ed19be20845 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f14b expref: 9 pid: 8434 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.742813:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa0fb10b/0xaa253ed19be20845 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f14b expref: 9 pid: 8434 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.742872:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117798.742877:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117798.742889:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be2084c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f152 expref: 8 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.742902:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be2084c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f152 expref: 8 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.742957:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be2084c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f152 expref: 8 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117798.742977:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa87c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6506:1876025593212160:192.168.204.30@tcp:105: 00000100:00100000:3.0:1789117798.743906:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf839cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117798.754466:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117798.754723:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572169728 00000100:00100000:2.0:1789117798.754740:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572169728 00000100:00100000:2.0:1789117798.754838:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 55 00000100:00100000:2.0:1789117798.754856:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+43:12678:x1876025572169728:12345-192.168.204.30@tcp:35:bash.0 00000100:00100000:3.0:1789117798.755796:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa87c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6506:1876025593212160:192.168.204.30@tcp:105: 00010000:00010000:3.0:1789117798.755836:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117798.755931:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+44:12678:x1876025572169728:12345-192.168.204.30@tcp:35:bash.0 Request processed in 1081us (1482us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1789117798.755945:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 55 00000100:00100000:2.0:1789117798.767869:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9277e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2406:x1876025572169472:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 25164us (27174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117798.767891:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 106 00000100:00100000:0.0:1789117798.933304:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117798.933435:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572169856 00000100:00100000:3.0:1789117798.933448:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572169856 00000100:00100000:3.0:1789117798.933551:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 216 00000100:00100000:3.0:1789117798.933565:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+44:12694:x1876025572169856:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1789117798.933605:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117798.933650:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be20853 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f159 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.933754:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2085a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.933795:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2085a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.933814:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2085a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117798.933879:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789117798.933884:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789117798.933913:0:6521:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2085a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.933947:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be20853 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f159 expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.933970:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2085a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f159 expref: 45 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.933982:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:3.0:1789117798.933985:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789117798.933990:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93600, rc 0) 00000100:00100000:3.0:1789117798.934297:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+45:12694:x1876025572169856:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 734us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117798.934308:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 216 00000100:00100000:0.0:1789117798.943278:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117798.943640:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572170112 00000100:00100000:3.0:1789117798.943654:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572170112 00000100:00100000:3.0:1789117798.943745:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 217 00000100:00100000:3.0:1789117798.943758:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+45:12694:x1876025572170112:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1789117798.943792:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117798.943845:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be20861 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f160 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.944016:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be20868 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.944040:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be20868 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.944107:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be20868 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117798.944127:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789117798.944290:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be20861 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f160 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.944317:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be20868 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f160 expref: 47 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.944329:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db400) 00010000:00010000:3.0:1789117798.944335:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789117798.944340:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93000, rc 0) 00000100:00100000:3.0:1789117798.944456:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+47:12694:x1876025572170112:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 700us (1194us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1789117798.944465:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 217 00000100:00100000:1.0:1789117798.948419:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117798.948602:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572170368 00000100:00100000:2.0:1789117798.948616:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572170368 00000100:00100000:2.0:1789117798.948707:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 218 00000100:00100000:2.0:1789117798.948720:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88625e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+47:12694:x1876025572170368:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789117798.948758:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117798.948786:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2e00/0xaa253ed19be20876 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f167 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117798.948938:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be2087d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117798.948957:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be2087d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117798.948971:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be2087d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117798.948988:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789117798.949239:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2e00/0xaa253ed19be20876 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f167 expref: 50 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117798.949275:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be2087d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f167 expref: 49 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117798.949287:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db400) 00010000:00010000:2.0:1789117798.949291:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789117798.949322:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f2a00, rc 0) 00000100:00100000:2.0:1789117798.949408:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88625e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+49:12694:x1876025572170368:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 691us (1013us total) trans 4294967488 rc 0/0 00000100:00100000:2.0:1789117798.949416:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 218 00000100:00100000:0.0:1789117798.952554:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117798.952766:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572170496 00000100:00100000:1.0:1789117798.952780:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572170496 00000100:00100000:1.0:1789117798.952869:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:1.0:1789117798.952881:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+49:2406:x1876025572170496:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117798.952903:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117798.953586:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be20868 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f160 expref: 49 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.953612:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db400) 00010000:00010000:1.0:1789117798.953619:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117798.955315:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+48:2406:x1876025572170496:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 2420us (2763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117798.955331:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:2.0:1789117798.959872:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117798.959987:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572170624 00000100:00100000:3.0:1789117798.960004:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572170624 00000100:00100000:3.0:1789117798.960384:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 69 00000100:00100000:3.0:1789117798.960400:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2404:x1876025572170624:12345-192.168.204.30@tcp:1:lfs.0 00010000:00010000:3.0:1789117798.960498:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098d2a218/0xaa253ed19be2088b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.960524:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be2084c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f152 expref: 8 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.960535:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117798.960540:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789117798.960546:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098d2a218/0xaa253ed19be2088b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.960596:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be2084c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f152 expref: 8 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.960614:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be2084c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f152 expref: 8 pid: 8833 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117798.960645:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa87c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1876025593212288:192.168.204.30@tcp:104: 00000100:00100000:3.0:1789117798.960782:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf839e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789117798.966384:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117798.966652:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa87c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1876025593212288:192.168.204.30@tcp:104: 00010000:00010000:3.0:1789117798.966702:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000098d2a218/0xaa253ed19be2088b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117798.966825:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572170752 00000100:00100000:1.0:1789117798.967003:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572170752 00002000:00100000:1.0:1789117798.967363:0:8441:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff962a88567840 x1876025572170752/t0(0) o4->35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp:349/0 lens 504/0 e 0 to 0 dl 1789117809 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789117798.967402:0:8441:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962a88567840 with x1876025572170752 ext(0->8) 00010000:00010000:1.0:1789117798.967415:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be2084c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f152 expref: 9 pid: 8833 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.967433:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be2084c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f152 expref: 9 pid: 8833 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789117798.967442:0:8441:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff962a88567840 00000100:00100000:1.0:1789117798.967622:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:1.0:1789117798.967711:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88567840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:2407:x1876025572170752:12345-192.168.204.30@tcp:4:lfs.0 00000100:00100000:1.0:1789117798.969413:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88567840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+11:2407:x1876025572170752:12345-192.168.204.30@tcp:4:lfs.0 Request processed in 1692us (3032us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789117798.969430:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 3 00002000:00100000:1.0:1789117798.969446:0:8441:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff962a88567840 x1876025572170752/t4294967309(0) o4->35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp:349/0 lens 504/448 e 0 to 0 dl 1789117809 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789117798.969460:0:8441:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962a88567840 with x1876025572170752 ext(0->8) 00010000:00010000:1.0:1789117798.969474:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be2084c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f152 expref: 11 pid: 8833 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.969501:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be2084c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f152 expref: 11 pid: 8833 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789117798.969510:0:8441:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff962a88567840 00000100:00100000:0.0:1789117798.975423:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117798.975605:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572170880 00000100:00100000:1.0:1789117798.975647:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572170880 00010000:00010000:1.0:1789117798.975708:0:7470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be2084c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f152 expref: 11 pid: 8833 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117798.975789:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 107 00000100:00100000:1.0:1789117798.975804:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb093bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+11:2406:x1876025572170880:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117798.975826:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789117798.975854:0:7470:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789117798.975857:0:7470:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789117799 00002000:00010000:1.0:1789117798.975860:0:7470:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789117799 00002000:00010000:1.0:1789117798.975863:0:7470:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789117799 00002000:00010000:1.0:1789117798.975865:0:7470:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789117798.975873:0:7470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be2084c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f152 expref: 11 pid: 8833 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.975890:0:7470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be2084c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f152 expref: 11 pid: 8833 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.975921:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be2084c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f152 expref: 11 pid: 8833 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.975944:0:7470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789117798.975949:0:7470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789117798.975956:0:7470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000098d2a218/0xaa253ed19be2088b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.975968:0:7470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098d2a218/0xaa253ed19be2088b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.976140:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117798.976218:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb093bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+10:2406:x1876025572170880:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 416us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117798.976227:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 107 00010000:00010000:3.0:1789117798.980520:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000098d2a218/0xaa253ed19be2088b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.980589:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098d2a218/0xaa253ed19be2088b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.980646:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098d2a218/0xaa253ed19be2088b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.980657:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098d2a218/0xaa253ed19be2088b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.980669:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098d2a218/0xaa253ed19be2088b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.980678:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93200 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789117798.980685:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098d2a218/0xaa253ed19be2088b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.980697:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098d2a218/0xaa253ed19be2088b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.980725:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098d2a218/0xaa253ed19be2088b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117798.980735:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098d2a218/0xaa253ed19be2088b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117798.983531:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:2404:x1876025572170624:12345-192.168.204.30@tcp:1:lfs.0 Request processed in 23117us (23659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117798.983552:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 69 00000100:00100000:0.0:1789117798.988789:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117798.988905:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572171136 00000100:00100000:1.0:1789117798.988917:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572171136 00000100:00100000:1.0:1789117798.989333:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 56 00000100:00100000:1.0:1789117798.989351:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962baeaa5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+48:12694:x1876025572171136:12345-192.168.204.30@tcp:35:lfs.0 00000004:00010000:1.0:1789117798.989448:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be2087d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f167 expref: 48 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789117798.989736:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1789117798.989767:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:1.0:1789117798.990224:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:1.0:1789117798.990283:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20892 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.990306:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2800/0xaa253ed19be20837 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f144 expref: 52 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.990316:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20892 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.990370:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2800/0xaa253ed19be20837 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f144 expref: 52 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117798.990390:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2800/0xaa253ed19be20837 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f144 expref: 52 pid: 14247 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117798.990433:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88624780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1876025593212416:192.168.204.30@tcp:104: 00000100:00100000:1.0:1789117798.997610:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb840 going to sleep for 11 seconds 00000100:00100000:2.0:1789117798.999516:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88624780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1876025593212416:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789117798.999562:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20892 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117798.999983:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117799.000244:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572171264 00000100:00100000:2.0:1789117799.000253:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572171264 00010000:00010000:2.0:1789117799.000325:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2800/0xaa253ed19be20837 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f144 expref: 53 pid: 14247 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117799.000375:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 108 00000100:00100000:2.0:1789117799.000395:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88625680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+53:2406:x1876025572171264:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117799.000421:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117799.000430:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2800/0xaa253ed19be20837 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f144 expref: 53 pid: 14247 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.000444:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2800/0xaa253ed19be20837 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f144 expref: 53 pid: 14247 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.000509:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2800/0xaa253ed19be20837 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f144 expref: 53 pid: 14247 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.000532:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db400) 00010000:00010000:2.0:1789117799.000538:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20892 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.000550:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20892 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.000558:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20892 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.000595:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117799.000680:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88625680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+52:2406:x1876025572171264:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 295us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117799.000689:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 108 00000100:00080000:0.0:1789117799.000921:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789117799.001111:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20892 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.001120:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20892 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789117799.001290:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:2.0:1789117799.002375:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1789117799.004411:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88565680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876025593212544:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789117799.004526:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117799.004568:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a88489540 going to sleep for 11 seconds 00000100:00100000:1.0:1789117799.006315:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593212544 00000100:00100000:1.0:1789117799.006332:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593212544 00000100:00080000:2.0:1789117799.006486:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789117799.006592:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789117799.006609:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6523:x1876025593212544:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789117799.006806:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6523:x1876025593212544:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 203us (2280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117799.006814:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789117799.006899:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88565680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876025593212544:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789117799.007170:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:2.0:1789117799.007275:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88565680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876025593212672:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789117799.007324:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117799.012904:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a88489780 going to sleep for 11 seconds 00000100:00100000:3.0:1789117799.013280:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593212672 00000100:00100000:3.0:1789117799.013299:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593212672 00000100:00100000:2.0:1789117799.013820:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789117799.013836:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88566940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6523:x1876025593212672:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789117799.014295:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88566940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6523:x1876025593212672:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 462us (6970us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789117799.014308:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789117799.014864:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88565680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876025593212672:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789117799.014991:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1789117799.015612:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20892 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.015639:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20892 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.015649:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20892 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.015658:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dba00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117799.015664:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20892 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.015675:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20892 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.015704:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db400) 00010000:00010000:3.0:1789117799.015708:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789117799.015740:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20892 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.015748:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20892 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789117799.015940:0:6523:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789117799.030378:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1789117799.030420:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 451313364961ns, next at 452313352327ns, rc = 0 00000001:00080000:2.0:1789117799.030446:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:2.0:1789117799.030549:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db400) 00010000:00010000:2.0:1789117799.030555:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789117799.030571:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be2087d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f167 expref: 56 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117799.031287:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962baeaa5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+55:12694:x1876025572171136:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 41936us (42509us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1789117799.031302:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 56 00000020:00080000:2.0:1789117799.031310:0:6523:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789117799.055926:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117799.058199:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572171392 00000100:00100000:2.0:1789117799.058230:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572171392 00000100:00100000:2.0:1789117799.058366:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 219 00000100:00100000:2.0:1789117799.058382:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88624b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+55:12694:x1876025572171392:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789117799.058425:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117799.058464:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2600/0xaa253ed19be20899 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f16e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.058565:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2600/0xaa253ed19be20899 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f16e expref: 56 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.058634:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2600/0xaa253ed19be20899 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f16e expref: 56 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.058662:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:2.0:1789117799.058666:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789117799.058671:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f2600, rc 0) 00000100:00100000:2.0:1789117799.058774:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88624b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+56:12694:x1876025572171392:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 395us (2857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117799.058782:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 219 00000100:00100000:2.0:1789117799.077410:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117799.078833:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572171648 00000100:00100000:0.0:1789117799.078856:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572171648 00000100:00100000:0.0:1789117799.078972:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 57 00000100:00100000:0.0:1789117799.078987:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+56:12694:x1876025572171648:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:0.0:1789117799.079491:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+57:12694:x1876025572171648:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 505us (2105us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1789117799.079501:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 57 00000100:00100000:0.0:1789117799.167915:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117799.171440:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572171776 00000100:00100000:3.0:1789117799.171470:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572171776 00000100:00100000:2.0:1789117799.171742:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 220 00000100:00100000:2.0:1789117799.171758:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+57:12704:x1876025572171776:12345-192.168.204.30@tcp:34:lfs.0 00010000:00010000:2.0:1789117799.171897:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208a0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.171923:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.171940:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172025:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be208a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172035:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be208a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172043:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be208a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172243:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be208ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172253:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be208ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172261:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be208ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789117799.172347:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be208ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172368:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172376:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208a0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172384:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172393:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f2a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117799.172398:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172407:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208a0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172424:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:2.0:1789117799.172427:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117799.172435:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172450:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172471:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be208a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172479:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be208a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172484:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be208a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172490:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f2200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117799.172493:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be208a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172499:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be208a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172508:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff962b832d0100) 00010000:00010000:2.0:1789117799.172511:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117799.172514:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be208a7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172521:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be208a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172531:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be208ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172551:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be208ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172565:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be208ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172571:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f3e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117799.172574:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be208ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172582:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be208ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172591:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:2.0:1789117799.172593:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117799.172596:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be208ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.172603:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be208ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117799.172759:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+57:12704:x1876025572171776:12345-192.168.204.30@tcp:34:lfs.0 Request processed in 1001us (4858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117799.172770:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 220 00000100:00100000:1.0:1789117799.239042:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117799.239408:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572172032 00000100:00100000:3.0:1789117799.239422:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572172032 00000100:00100000:3.0:1789117799.239505:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 221 00000100:00100000:3.0:1789117799.239518:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88626d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+57:12707:x1876025572172032:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1789117799.239547:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117799.239581:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be208b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f175 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.239723:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be208bc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.239747:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be208bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.239764:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be208bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.239780:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b80030c00/0xaa253ed19be208c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.239790:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b80030c00/0xaa253ed19be208c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.239825:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b80030c00/0xaa253ed19be208c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.240684:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be208ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.240705:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be208ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.240717:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be208ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117799.240736:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789117799.240896:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be208bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.240905:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be208bc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.240914:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be208bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.240922:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117799.240927:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be208bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.240937:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be208bc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.241026:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:2.0:1789117799.241031:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117799.241040:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be208bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.241048:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be208bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.241236:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b80030c00/0xaa253ed19be208c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.241243:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b80030c00/0xaa253ed19be208c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.241249:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b80030c00/0xaa253ed19be208c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.241735:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b80030c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117799.241761:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b80030c00/0xaa253ed19be208c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.241771:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b80030c00/0xaa253ed19be208c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.241786:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff962b832d0100) 00010000:00010000:2.0:1789117799.241789:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117799.241794:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b80030c00/0xaa253ed19be208c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.241801:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b80030c00/0xaa253ed19be208c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.242824:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be208b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f175 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.242854:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be208ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f175 expref: 59 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.242863:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:2.0:1789117799.242866:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789117799.242870:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f3e00, rc 0) 00000100:00100000:2.0:1789117799.244426:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88626d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+59:12707:x1876025572172032:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 4895us (5390us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1789117799.244444:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 221 00000100:00100000:3.0:1789117799.255731:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117799.256139:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572172160 00000100:00100000:2.0:1789117799.256156:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572172160 00000100:00100000:2.0:1789117799.256248:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 222 00000100:00100000:2.0:1789117799.256497:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+59:12707:x1876025572172160:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:2.0:1789117799.256638:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be208d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.256666:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be208d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.256682:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be208d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.256740:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be208d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.256749:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be208d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.256758:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be208d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.256766:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f2200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117799.256773:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be208d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.256783:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be208d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.256801:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:2.0:1789117799.256805:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789117799.256813:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be208d8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.256822:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be208d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117799.256987:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+59:12707:x1876025572172160:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 496us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117799.259182:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 222 00000100:00100000:0.0:1789117799.263283:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117799.263395:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572172416 00000100:00100000:2.0:1789117799.263409:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572172416 00000100:00100000:2.0:1789117799.263490:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 58 00000100:00100000:2.0:1789117799.263504:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+59:12707:x1876025572172416:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:2.0:1789117799.263851:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+60:12707:x1876025572172416:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 349us (583us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1789117799.263859:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 58 00000100:00100000:1.0:1789117799.272437:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117799.272480:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593212800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789117799.272589:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117799.272805:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593212800 00000100:00100000:2.0:1789117799.272818:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593212800 00000100:00100000:2.0:1789117799.272890:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789117799.272902:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a886243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593212800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789117799.272949:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789117799.273015:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a886243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593212800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117799.273024:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789117799.273473:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593212800:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1789117799.334425:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789117799.361546:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117799.361684:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572172672 00000100:00100000:2.0:1789117799.361701:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572172672 00000100:00100000:2.0:1789117799.361875:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 223 00000100:00100000:2.0:1789117799.361892:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88625a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+60:12717:x1876025572172672:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1789117799.361932:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117799.361937:0:14247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789117799.362870:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2085a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f159 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.362928:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:2.0:1789117799.362937:0:14247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117799.363711:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be208df lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f17c expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.363925:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208e6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.363946:0:14247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be208ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f175 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.363969:0:14247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208e6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.364030:0:14247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be208ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f175 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.364088:0:14247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be208ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f175 expref: 60 pid: 6521 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117799.364118:0:14247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a885661c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14247:1876025593212928:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789117799.364463:0:14247:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a88489240 going to sleep for 11 seconds 00000100:00100000:1.0:1789117799.372969:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117799.373398:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572172800 00000100:00100000:3.0:1789117799.373416:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572172800 00010000:00010000:3.0:1789117799.373500:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be208ca lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f175 expref: 61 pid: 6521 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117799.373560:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 109 00000100:00100000:3.0:1789117799.373575:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88626580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+61:2406:x1876025572172800:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117799.373594:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117799.373602:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be208ca lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f175 expref: 61 pid: 6521 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.373628:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be208ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f175 expref: 61 pid: 6521 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.373662:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:3.0:1789117799.373669:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208e6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.373683:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.373693:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208e6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.373871:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117799.374022:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88626580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+61:2406:x1876025572172800:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 448us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117799.374033:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 109 00010000:00010000:2.0:1789117799.374647:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be208ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f175 expref: 60 pid: 6521 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117799.374676:0:14247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a885661c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14247:1876025593212928:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789117799.374735:0:14247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.374759:0:14247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.374766:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117799.374797:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789117799.375593:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be208df lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f17c expref: 61 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.375628:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208e6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f17c expref: 60 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.375638:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:2.0:1789117799.375642:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789117799.375646:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f2a00, rc 0) 00000100:00100000:2.0:1789117799.375725:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88625a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+60:12717:x1876025572172672:12345-192.168.204.30@tcp:101:bash.0 Request processed in 13836us (14202us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1789117799.375736:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 223 00000100:00100000:3.0:1789117799.381501:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117799.381807:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572172928 00000100:00100000:2.0:1789117799.381821:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572172928 00000100:00100000:2.0:1789117799.381908:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 224 00000100:00100000:2.0:1789117799.381922:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+60:12717:x1876025572172928:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1789117799.381970:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117799.382001:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be208f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f183 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.382123:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2c00/0xaa253ed19be208fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.382144:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2c00/0xaa253ed19be208fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.382163:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2c00/0xaa253ed19be208fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.382600:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be208f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f183 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.382634:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2c00/0xaa253ed19be208fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f183 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.382645:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:2.0:1789117799.382649:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789117799.382656:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f2c00, rc 0) 00000100:00100000:2.0:1789117799.382850:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+61:12717:x1876025572172928:12345-192.168.204.30@tcp:101:bash.0 Request processed in 930us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117799.382860:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 224 00000100:00100000:0.0:1789117799.388986:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117799.389151:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572173184 00000100:00100000:2.0:1789117799.389166:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572173184 00000100:00100000:2.0:1789117799.389268:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 225 00000100:00100000:2.0:1789117799.389280:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+61:12717:x1876025572173184:12345-192.168.204.30@tcp:36:bash.0 00010000:00010000:2.0:1789117799.389667:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be20902 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.389729:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be20902 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.389964:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be20902 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789117799.390050:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:2.0:1789117799.390173:0:6519:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000025a3a2dc reply state 00000000d7a89d24 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be20902 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.390253:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be20902 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.390261:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:2.0:1789117799.390264:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789117799.390269:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789117799.390423:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+64:12717:x1876025572173184:12345-192.168.204.30@tcp:36:bash.0 Request processed in 1141us (1453us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1789117799.390433:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 225 00000020:00080000:2.0:1789117799.390440:0:6519:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789117799.396871:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117799.397029:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572173312 00000100:00100000:2.0:1789117799.397044:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572173312 00010000:00010000:1.0:1789117799.397567:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117799.398202:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 226 00000100:00100000:2.0:1789117799.398228:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+64:12717:x1876025572173312:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1789117799.398268:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117799.398303:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be20909 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f18a expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.398469:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be20910 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.398508:0:14247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208e6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f17c expref: 65 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.398519:0:14247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be20910 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.398576:0:14247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208e6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f17c expref: 65 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.399424:0:14247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208e6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f17c expref: 65 pid: 14247 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117799.399449:0:14247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a885661c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14247:1876025593213056:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789117799.399596:0:14247:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a88489240 going to sleep for 11 seconds 00000100:00100000:3.0:1789117799.402550:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117799.402846:0:14247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a885661c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14247:1876025593213056:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789117799.402893:0:14247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be20910 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117799.403775:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572173440 00000100:00100000:1.0:1789117799.403791:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572173440 00010000:00010000:1.0:1789117799.403854:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208e6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f17c expref: 66 pid: 14247 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117799.403906:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 110 00000100:00100000:1.0:1789117799.403917:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa85a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+66:2407:x1876025572173440:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117799.403970:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117799.403979:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208e6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f17c expref: 66 pid: 14247 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.403993:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208e6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f17c expref: 66 pid: 14247 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.404027:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be208e6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f17c expref: 66 pid: 14247 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.404051:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:1.0:1789117799.404470:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be20910 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.404483:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be20910 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.404492:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be20910 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.404527:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117799.404614:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa85a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+65:2407:x1876025572173440:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 697us (2078us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117799.404636:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 110 00010000:00010000:0.0:1789117799.405995:0:14247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be20910 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.406016:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be20910 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117799.406592:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789117799.406605:0:14247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789117799.406686:0:14247:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be20910 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.406752:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be20909 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f18a expref: 65 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.406777:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be20910 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f18a expref: 64 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.406788:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:0.0:1789117799.406792:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117799.406796:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f3e00, rc 0) 00000100:00100000:0.0:1789117799.406908:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+64:12717:x1876025572173312:12345-192.168.204.30@tcp:101:bash.0 Request processed in 8692us (10182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117799.406920:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 226 00000100:00100000:2.0:1789117799.412673:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117799.412786:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572173696 00000100:00100000:0.0:1789117799.412801:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572173696 00000100:00100000:0.0:1789117799.412926:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 59 00000100:00100000:0.0:1789117799.412944:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+64:12717:x1876025572173696:12345-192.168.204.30@tcp:35:bash.0 00000100:00100000:0.0:1789117799.413513:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+65:12717:x1876025572173696:12345-192.168.204.30@tcp:35:bash.0 Request processed in 572us (855us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1789117799.413523:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 59 00000100:00100000:1.0:1789117799.516171:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117799.516370:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572173824 00000100:00100000:0.0:1789117799.516386:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572173824 00000100:00100000:0.0:1789117799.516487:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 227 00000100:00100000:0.0:1789117799.516501:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+65:12723:x1876025572173824:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1789117799.516537:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117799.516585:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20917 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f191 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.516709:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be2091e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.516733:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be2091e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.516751:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be2091e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117799.516824:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789117799.516828:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789117799.516855:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be2091e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.516893:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4600/0xaa253ed19be20917 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f191 expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.516922:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be2091e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f191 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.516934:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:0.0:1789117799.516938:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789117799.516944:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f4200, rc 0) 00000100:00100000:0.0:1789117799.517044:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+66:12723:x1876025572173824:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 546us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117799.517215:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 227 00000100:00100000:1.0:1789117799.522239:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117799.522965:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572173952 00000100:00100000:2.0:1789117799.522986:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572173952 00000100:00100000:2.0:1789117799.523265:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 228 00000100:00100000:2.0:1789117799.523284:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a886252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+66:12723:x1876025572173952:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789117799.523316:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117799.523348:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3200/0xaa253ed19be20925 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f198 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.523469:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be2092c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.523490:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be2092c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.523504:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be2092c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.523516:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3400/0xaa253ed19be20933 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.523523:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3400/0xaa253ed19be20933 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.523531:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3400/0xaa253ed19be20933 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.523658:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3c00/0xaa253ed19be2093a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.523670:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3c00/0xaa253ed19be2093a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.523678:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3c00/0xaa253ed19be2093a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117799.523755:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789117799.523762:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789117799.523793:0:6519:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3c00/0xaa253ed19be2093a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.523822:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3c00/0xaa253ed19be2093a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.523834:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be2092c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.523843:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be2092c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.523853:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be2092c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.523860:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f2400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117799.523866:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be2092c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.523877:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be2092c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.523896:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:2.0:1789117799.523901:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117799.523911:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be2092c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.523920:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be2092c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.523938:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3400/0xaa253ed19be20933 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.523945:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3400/0xaa253ed19be20933 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.523958:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3400/0xaa253ed19be20933 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.523964:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f3400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117799.523968:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3400/0xaa253ed19be20933 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.523974:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3400/0xaa253ed19be20933 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.523984:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff962b832d0100) 00010000:00010000:2.0:1789117799.523986:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117799.523990:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3400/0xaa253ed19be20933 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.523996:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3400/0xaa253ed19be20933 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.524032:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3200/0xaa253ed19be20925 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f198 expref: 68 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.524049:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3c00/0xaa253ed19be2093a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f198 expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.524131:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:2.0:1789117799.524133:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789117799.524488:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f3c00, rc 0) 00000100:00100000:2.0:1789117799.524739:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a886252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+67:12723:x1876025572173952:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 1459us (2517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117799.529349:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117799.529421:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117799.529541:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572174336 00000100:00100000:1.0:1789117799.529556:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572174336 00000100:00100000:1.0:1789117799.529657:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:1.0:1789117799.529677:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+68:2407:x1876025572174336:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117799.529702:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117799.529747:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3c00/0xaa253ed19be2093a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f198 expref: 68 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.529774:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:1.0:1789117799.529780:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117799.529846:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+67:2407:x1876025572174336:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 173us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117799.529855:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:1.0:1789117799.530015:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572174208 00000100:00100000:1.0:1789117799.530019:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572174208 00000100:00100000:1.0:1789117799.530046:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 229 00000100:00100000:1.0:1789117799.530099:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+67:12723:x1876025572174208:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1789117799.530123:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117799.530764:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20941 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f19f expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.530947:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20948 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.530968:0:14247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be20910 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f18a expref: 68 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.530981:0:14247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20948 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.531034:0:14247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be20910 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f18a expref: 68 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.531897:0:14247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be20910 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f18a expref: 68 pid: 14247 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117799.531918:0:14247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88627c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14247:1876025593213184:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789117799.536724:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 228 00000100:00100000:1.0:1789117799.537035:0:14247:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117799.538373:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117799.538521:0:14247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88627c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14247:1876025593213184:192.168.204.30@tcp:104: 00010000:00010000:1.0:1789117799.538562:0:14247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20948 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117799.538861:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572174464 00000100:00100000:3.0:1789117799.538871:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572174464 00010000:00010000:3.0:1789117799.538926:0:7470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be20910 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f18a expref: 68 pid: 14247 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117799.538969:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 111 00000100:00100000:3.0:1789117799.538981:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+68:2407:x1876025572174464:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117799.539002:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117799.539010:0:7470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be20910 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f18a expref: 68 pid: 14247 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.539026:0:7470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be20910 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f18a expref: 68 pid: 14247 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.540830:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3e00/0xaa253ed19be20910 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f18a expref: 68 pid: 14247 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.540865:0:7470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:3.0:1789117799.540872:0:7470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20948 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.540913:0:7470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20948 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.540923:0:7470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20948 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.540975:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117799.541109:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+67:2407:x1876025572174464:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 2117us (2733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117799.541122:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 111 00010000:00010000:1.0:1789117799.542358:0:14247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20948 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.542374:0:14247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20948 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117799.542406:0:14247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789117799.542626:0:14247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20941 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f19f expref: 68 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.542651:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20948 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f19f expref: 67 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.542660:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:1.0:1789117799.542663:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789117799.542667:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813db400, rc 0) 00000100:00100000:1.0:1789117799.542748:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+67:12723:x1876025572174208:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 12694us (13415us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1789117799.542778:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 229 00000100:00100000:0.0:1789117799.547937:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117799.548035:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572174720 00000100:00100000:1.0:1789117799.548051:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572174720 00000100:00100000:1.0:1789117799.548212:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:1.0:1789117799.548226:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887fa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+67:12723:x1876025572174720:12345-192.168.204.30@tcp:103:lfs.0 00010000:00010000:1.0:1789117799.548250:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117799.548285:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2600/0xaa253ed19be20899 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f16e expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.548313:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:1.0:1789117799.548319:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117799.548388:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887fa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+66:12723:x1876025572174720:12345-192.168.204.30@tcp:103:lfs.0 Request processed in 165us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117799.548398:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:0.0:1789117799.552868:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117799.553043:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572174848 00000100:00100000:1.0:1789117799.553352:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572174848 00000100:00100000:1.0:1789117799.553516:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 230 00000100:00100000:1.0:1789117799.553530:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+66:12723:x1876025572174848:12345-192.168.204.30@tcp:58:lfs.0 00010000:00010000:1.0:1789117799.553723:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20956 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.553752:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20956 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.553771:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20956 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789117799.553969:0:9533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1789117799.554167:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+66:12723:x1876025572174848:12345-192.168.204.30@tcp:58:lfs.0 Request processed in 638us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117799.554178:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 230 00000100:00100000:0.0:1789117799.557853:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117799.557997:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572174976 00000100:00100000:2.0:1789117799.558019:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572174976 00000100:00100000:2.0:1789117799.558530:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 231 00000100:00100000:2.0:1789117799.558546:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+66:12723:x1876025572174976:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789117799.558582:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117799.558642:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3200/0xaa253ed19be2095d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f1a6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.558735:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20956 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.558748:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3200/0xaa253ed19be2095d lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1a6 expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.558778:0:6520:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20956 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.558795:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3200/0xaa253ed19be2095d lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1a6 expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.558815:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:2.0:1789117799.558819:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789117799.558824:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3200/0xaa253ed19be2095d lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1a6 expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.558833:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f3200, rc 0) 00000100:00100000:2.0:1789117799.558961:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+67:12723:x1876025572174976:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 419us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117799.558970:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 231 00000040:00080000:2.0:1789117799.781644:0:14501:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789117799.781656:0:14501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789117799.781689:0:14501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1789117799.781697:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789117799.781849:0:14501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88564b40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14501:1876025593213312:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789117799.781985:0:14501:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a884890c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117799.799427:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117799.799992:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572175104 00000100:00100000:1.0:1789117799.800008:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572175104 00000100:00100000:1.0:1789117799.800160:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 232 00000100:00100000:1.0:1789117799.800174:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+68:12724:x1876025572175104:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789117799.800225:0:14247:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789117799.800407:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+68:12724:x1876025572175104:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 235us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117799.800417:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 232 00000100:00100000:2.0:1789117799.801244:0:14501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88564b40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14501:1876025593213312:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789117799.816348:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117799.816531:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572175232 00000100:00100000:1.0:1789117799.816544:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572175232 00000100:00100000:1.0:1789117799.816637:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 233 00000100:00100000:1.0:1789117799.816650:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+67:12724:x1876025572175232:12345-192.168.204.30@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789117799.816755:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20964 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.816777:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20964 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.816794:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20964 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.816811:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be2096b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.816842:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be2096b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.816849:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be2096b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.816880:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20972 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.816891:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20972 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.816897:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20972 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117799.816969:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789117799.816975:0:9533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789117799.816991:0:9533:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20972 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.817004:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20964 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.817011:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20964 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.817018:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20964 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.817026:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117799.817030:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20964 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.817046:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20964 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.818314:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff962bbe7ec500) 00010000:00010000:1.0:1789117799.818325:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117799.818335:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20964 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.818345:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db800/0xaa253ed19be20964 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.818366:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be2096b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.818373:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be2096b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.818381:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be2096b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.818387:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117799.818391:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be2096b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.818399:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be2096b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.818407:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff962b84d70200) 00010000:00010000:1.0:1789117799.818411:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117799.818414:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be2096b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.818441:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be2096b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.818462:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20972 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.818469:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20972 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.818476:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20972 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.818482:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dbe00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117799.818485:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20972 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.818492:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20972 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.818501:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:1.0:1789117799.818504:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117799.818508:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20972 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.818514:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20972 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117799.818661:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+67:12724:x1876025572175232:12345-192.168.204.30@tcp:34:lhsmtool_posix.0 Request processed in 2009us (2325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117799.818673:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 233 00000100:00100000:0.0:1789117799.823652:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117799.823805:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572175488 00000100:00100000:2.0:1789117799.823817:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572175488 00000100:00100000:2.0:1789117799.823890:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 234 00000100:00100000:2.0:1789117799.823902:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+67:12724:x1876025572175488:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117799.823930:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117799.823958:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3400/0xaa253ed19be20979 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f1ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.824129:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20980 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.824147:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20980 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.824161:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20980 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117799.824175:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789117799.824297:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20980 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.824305:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20980 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.824312:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20980 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.824319:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f2400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117799.824326:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20980 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.824334:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20980 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.824348:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:2.0:1789117799.824352:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789117799.824357:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20980 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.824363:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20980 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.824414:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3400/0xaa253ed19be20979 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1ad expref: 69 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.824425:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff962bbe7ec500) 00010000:00010000:2.0:1789117799.824427:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789117799.824431:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3400/0xaa253ed19be20979 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1ad expref: 69 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.824459:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f3400, rc 0) 00000100:00100000:2.0:1789117799.826362:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+68:12724:x1876025572175488:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 2449us (2710us total) trans 4294967506 rc 301/301 00000100:00100000:2.0:1789117799.826378:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 234 00000100:00100000:0.0:1789117799.830788:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117799.830980:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572175616 00000100:00100000:3.0:1789117799.830992:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572175616 00000100:00100000:2.0:1789117799.831498:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 235 00000100:00100000:2.0:1789117799.831515:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+68:12724:x1876025572175616:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789117799.831564:0:6521:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789117799.831750:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+68:12724:x1876025572175616:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 239us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117799.831759:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 235 00000100:00100000:0.0:1789117799.836349:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117799.837695:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572175872 00000100:00100000:1.0:1789117799.837713:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572175872 00000100:00100000:1.0:1789117799.837801:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 236 00000100:00100000:1.0:1789117799.837815:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf775680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+68:12724:x1876025572175872:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789117799.837844:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117799.837848:0:9533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789117799.837886:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be2091e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f191 expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.837912:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:1.0:1789117799.837918:0:9533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789117799.837936:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2098e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f1b4 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789117799.839567:0:9533:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:1.0:1789117799.839788:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20995 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.839809:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.839824:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.839905:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be2098e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1b4 expref: 70 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.839927:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20995 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1b4 expref: 69 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.839962:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff962b84d70200) 00010000:00010000:1.0:1789117799.839966:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117799.839970:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813db600, rc 0) 00000100:00100000:1.0:1789117799.840491:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf775680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+69:12724:x1876025572175872:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 2675us (4157us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1789117799.840503:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 236 00000100:00100000:0.0:1789117799.852776:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117799.852874:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572176128 00000100:00100000:2.0:1789117799.852886:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572176128 00000100:00100000:2.0:1789117799.852959:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 237 00000100:00100000:2.0:1789117799.852972:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf775e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+69:12724:x1876025572176128:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789117799.853158:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117799.853197:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20995 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1b4 expref: 69 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.853223:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff962b84d70200) 00010000:00010000:2.0:1789117799.853237:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117799.853266:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be209a3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.853285:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be209a3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.853317:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be209a3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.853334:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be209aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xb13d9ff bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.853342:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be209aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xb13d9ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.853349:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be209aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xb13d9ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.853408:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be209a3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.853416:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be209a3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.853424:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be209a3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.853432:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f2400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117799.853437:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be209a3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.853446:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be209a3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.853454:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:2.0:1789117799.853457:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117799.853461:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be209a3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.853474:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be209a3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.853485:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be209aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xb13d9ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.853492:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be209aa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xb13d9ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.853498:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be209aa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xb13d9ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.853503:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f3800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117799.853507:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be209aa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xb13d9ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.853513:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be209aa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xb13d9ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.853521:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xb13d9ff (ffff962b900db400) 00010000:00010000:2.0:1789117799.853523:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117799.853526:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be209aa lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xb13d9ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.853532:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be209aa lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xb13d9ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117799.853648:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf775e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+68:12724:x1876025572176128:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 678us (887us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789117799.853656:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 237 00000100:00100000:2.0:1789117799.856334:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117799.856719:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572176256 00000100:00100000:0.0:1789117799.856732:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572176256 00000100:00100000:0.0:1789117799.856815:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 238 00000100:00100000:0.0:1789117799.856827:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88564b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+68:12724:x1876025572176256:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789117799.856855:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117799.856892:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be209b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f1bb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.857717:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be209b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.857739:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be209b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.857754:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be209b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.857919:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be209b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1bb expref: 70 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.857956:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be209b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1bb expref: 69 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.857968:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff962b832d0600) 00010000:00010000:0.0:1789117799.857972:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789117799.857977:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f5a00, rc 0) 00000100:00100000:0.0:1789117799.858128:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88564b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+69:12724:x1876025572176256:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 1301us (1807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117799.858138:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 238 00000100:00100000:1.0:1789117799.863865:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117799.867972:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572176512 00000100:00100000:3.0:1789117799.867995:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572176512 00000100:00100000:2.0:1789117799.868198:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 239 00000100:00100000:2.0:1789117799.868215:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88627c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+69:12724:x1876025572176512:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789117799.868339:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be209bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.868451:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be209bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.868469:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be209bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789117799.868708:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1789117799.868723:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 452151667759ns, next at 453151662325ns, rc = 0 00000004:00010000:2.0:1789117799.868789:0:6520:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000cc49d79d reply state 00000000f46da302 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be209bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.868806:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be209bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.868815:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff962b832d0600) 00010000:00010000:2.0:1789117799.868819:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789117799.868824:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789117799.868983:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88627c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+71:12724:x1876025572176512:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 771us (5134us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1789117799.868992:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 239 00000100:00100000:1.0:1789117799.874120:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117799.875009:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572176640 00000100:00100000:2.0:1789117799.875029:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572176640 00000100:00100000:2.0:1789117799.875179:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 240 00000100:00100000:2.0:1789117799.875192:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88626940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+71:12724:x1876025572176640:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117799.875259:0:14247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117799.875292:0:14247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be209c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f1c2 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.875382:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be209c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1c2 expref: 72 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.875401:0:14247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be209c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1c2 expref: 72 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.875422:0:14247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff962b832d0600) 00010000:00010000:2.0:1789117799.875425:0:14247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789117799.875430:0:14247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f2400, rc 0) 00000100:00100000:2.0:1789117799.875513:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88626940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+72:12724:x1876025572176640:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 324us (1464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117799.875522:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 240 00000100:00100000:0.0:1789117799.880213:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117799.880377:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572176768 00000100:00100000:3.0:1789117799.880393:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572176768 00000100:00100000:3.0:1789117799.880491:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 70 00000100:00100000:3.0:1789117799.880505:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf774b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:2407:x1876025572176768:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789117799.880824:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf774b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+10:2407:x1876025572176768:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 Request processed in 322us (627us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1789117799.880833:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 70 00000100:00080000:0.0:1789117799.881374:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789117799.887553:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117799.887722:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572177024 00000100:00100000:2.0:1789117799.887736:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572177024 00000100:00100000:2.0:1789117799.887824:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00100000:2.0:1789117799.887836:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf776580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+72:12724:x1876025572177024:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789117799.888198:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf776580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+73:12724:x1876025572177024:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 363us (659us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1789117799.888207:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00100000:3.0:1789117799.896700:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117799.896962:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572177280 00000100:00100000:0.0:1789117799.896977:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572177280 00000100:00100000:0.0:1789117799.897098:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 241 00000100:00100000:0.0:1789117799.897110:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+73:12724:x1876025572177280:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789117799.897274:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+73:12724:x1876025572177280:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 166us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117799.897283:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 241 00000100:00100000:1.0:1789117799.900494:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117799.900782:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572177408 00000100:00100000:2.0:1789117799.900795:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572177408 00000100:00100000:2.0:1789117799.900871:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 242 00000100:00100000:2.0:1789117799.900883:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a886261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+73:12724:x1876025572177408:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117799.900933:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117799.900961:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be209cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f1c9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.901424:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2800/0xaa253ed19be209d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.901445:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2800/0xaa253ed19be209d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.901459:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2800/0xaa253ed19be209d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117799.901523:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789117799.901548:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2800/0xaa253ed19be209d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.901584:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be209cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1c9 expref: 75 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.901910:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2800/0xaa253ed19be209d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1c9 expref: 74 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.901920:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff962b832d0600) 00010000:00010000:2.0:1789117799.901923:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789117799.901927:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f2800, rc 0) 00000100:00100000:2.0:1789117799.902023:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a886261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+74:12724:x1876025572177408:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 1141us (1543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117799.902033:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 242 00000100:00100000:1.0:1789117799.905864:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117799.905984:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572177536 00000100:00100000:0.0:1789117799.906000:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572177536 00000100:00100000:0.0:1789117799.906131:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 71 00000100:00100000:0.0:1789117799.906144:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88627840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+10:2406:x1876025572177536:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789117799.906431:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117799.906481:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ba23cf8/0xaa253ed19be209db lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f1d0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789117799.906515:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3c568, blocks: 0x0 00010000:00010000:0.0:1789117799.906544:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1789117799.906549:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117799.906561:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ba23cf8/0xaa253ed19be209db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1d0 expref: 11 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.906586:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000ba23cf8/0xaa253ed19be209db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1d0 expref: 11 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.906861:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f4600, rc 0) 00000100:00100000:0.0:1789117799.906950:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88627840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+11:2406:x1876025572177536:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 808us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117799.906960:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 71 00000100:00100000:3.0:1789117799.912314:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117799.912923:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572177792 00000100:00100000:1.0:1789117799.912938:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572177792 00000100:00100000:1.0:1789117799.913025:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 243 00000100:00100000:1.0:1789117799.913037:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+74:12724:x1876025572177792:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789117799.913233:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+74:12724:x1876025572177792:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 198us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117799.913242:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 243 00000100:00100000:1.0:1789117799.917922:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117799.918668:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572177920 00000100:00100000:3.0:1789117799.918683:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572177920 00000100:00100000:3.0:1789117799.918769:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 72 00000100:00100000:3.0:1789117799.918781:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88624f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+11:12724:x1876025572177920:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789117799.918823:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117799.918850:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e68a5dcc/0xaa253ed19be209e2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f1d7 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.918896:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000ba23cf8/0xaa253ed19be209db lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1d0 expref: 12 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.918907:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117799.918913:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117799.918919:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e68a5dcc/0xaa253ed19be209e2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1d7 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.918976:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000ba23cf8/0xaa253ed19be209db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1d0 expref: 12 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.918992:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000ba23cf8/0xaa253ed19be209db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1d0 expref: 12 pid: 8434 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117799.919012:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa84780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1876025593213440:192.168.204.30@tcp:104: 00000100:00100000:3.0:1789117799.919203:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf8396c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117799.925430:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117799.925574:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa84780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1876025593213440:192.168.204.30@tcp:104: 00010000:00010000:3.0:1789117799.925638:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e68a5dcc/0xaa253ed19be209e2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1d7 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.925667:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b80031a00, rc 0) 00000100:00100000:3.0:1789117799.925769:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88624f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+12:12724:x1876025572177920:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 6989us (7862us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117799.925781:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 72 00000100:00100000:0.0:1789117799.926012:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572178048 00000100:00100000:0.0:1789117799.926022:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572178048 00010000:00010000:0.0:1789117799.926218:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000ba23cf8/0xaa253ed19be209db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1d0 expref: 12 pid: 8434 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117799.926262:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 112 00000100:00100000:0.0:1789117799.926273:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae57f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+12:2406:x1876025572178048:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117799.926291:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117799.926317:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000ba23cf8/0xaa253ed19be209db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1d0 expref: 12 pid: 8434 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.926348:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000ba23cf8/0xaa253ed19be209db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1d0 expref: 12 pid: 8434 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.926381:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ba23cf8/0xaa253ed19be209db lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1d0 expref: 12 pid: 8434 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.926402:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117799.926407:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117799.926420:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e68a5dcc/0xaa253ed19be209e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1d7 expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.926432:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e68a5dcc/0xaa253ed19be209e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1d7 expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.926476:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e68a5dcc/0xaa253ed19be209e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1d7 expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117799.926507:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7743c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1876025593213568:192.168.204.30@tcp:105: 00000100:00100000:0.0:1789117799.926825:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8299e480 going to sleep for 11 seconds 00000100:00100000:2.0:1789117799.934289:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117799.934508:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7743c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1876025593213568:192.168.204.30@tcp:105: 00010000:00010000:0.0:1789117799.934548:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117799.934641:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae57f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+11:2406:x1876025572178048:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 8369us (9227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117799.934656:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 112 00000100:00100000:1.0:1789117799.935043:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572178176 00000100:00100000:1.0:1789117799.935137:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572178176 00002000:00100000:1.0:1789117799.935199:0:8442:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff962a88564780 x1876025572178176/t0(0) o4->35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp:350/0 lens 504/0 e 0 to 0 dl 1789117810 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789117799.935211:0:8442:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962a88564780 with x1876025572178176 ext(0->12) 00002000:00010000:1.0:1789117799.935217:0:8442:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff962a88564780 00000100:00100000:1.0:1789117799.935301:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:1.0:1789117799.935313:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88564780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+11:2407:x1876025572178176:12345-192.168.204.30@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789117799.936900:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88564780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+13:2407:x1876025572178176:12345-192.168.204.30@tcp:4:lhsmtool_posix.0 Request processed in 1573us (2611us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1789117799.936915:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 6 00002000:00100000:1.0:1789117799.936929:0:8442:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff962a88564780 x1876025572178176/t4294967321(0) o4->35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp:350/0 lens 504/448 e 0 to 0 dl 1789117810 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789117799.936941:0:8442:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962a88564780 with x1876025572178176 ext(0->12) 00002000:00010000:1.0:1789117799.936948:0:8442:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff962a88564780 00000100:00100000:2.0:1789117799.940810:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117799.941336:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572178304 00000100:00100000:3.0:1789117799.941354:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572178304 00000100:00100000:3.0:1789117799.941449:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 244 00000100:00100000:3.0:1789117799.941462:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88566580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+74:12724:x1876025572178304:12345-192.168.204.30@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789117799.949597:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:0.0:1789117799.949683:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00010000:00010000:3.0:1789117799.949697:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be206e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.949715:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be206e7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.949725:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be206e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.949733:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813daa00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117799.949739:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be206e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789117799.949741:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00010000:00010000:3.0:1789117799.949752:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be206e7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.949775:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff962a87c24e00) 00000020:00080000:0.0:1789117799.949776:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff962a88489540 refcount 2 committed 0 result 0 batchid 7 00010000:00010000:3.0:1789117799.949781:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:0.0:1789117799.949783:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962a87f9c100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff962a88489f00 00000020:00080000:0.0:1789117799.949788:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962a87f9c800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff962a86d81e00 00010000:00010000:3.0:1789117799.949789:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be206e7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.949798:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be206e7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789117799.949821:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:0.0:1789117799.949858:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff962a87debc00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1789117799.949863:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962b90353b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff962a87deba80 00010000:00010000:3.0:1789117799.949866:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be2078f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789117799.949867:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962b90353400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff962a88720e00 00010000:00010000:3.0:1789117799.949876:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be2078f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.949881:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be2078f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.949886:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9ba00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117799.949889:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be2078f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.949895:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be2078f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.949904:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962b84d70f00) 00010000:00010000:3.0:1789117799.949907:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117799.949910:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be2078f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.949915:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be2078f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.949930:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2080d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.949936:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2080d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.949942:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2080d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.949953:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117799.949956:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2080d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.949963:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2080d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.949972:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff962b832d0100) 00010000:00010000:3.0:1789117799.949975:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117799.949978:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2080d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.949985:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be2080d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.950000:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20830 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.950006:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20830 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.950018:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20830 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.950024:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117799.950028:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20830 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789117799.950028:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:3.0:1789117799.950038:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20830 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789117799.950086:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1789117799.950195:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1789117799.950552:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593213696:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789117799.950969:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117799.951029:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789117799.951037:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593213824:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789117799.951395:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789117799.951407:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88625680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593213952:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789117799.951447:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117799.951503:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593213696 00000100:00100000:1.0:1789117799.951512:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593213696 00010000:00010000:3.0:1789117799.952364:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff962b832d0100) 00010000:00010000:3.0:1789117799.952370:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117799.952383:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20830 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.952395:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92a00/0xaa253ed19be20830 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.952445:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be20902 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.952453:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be20902 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.952459:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be20902 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.952465:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f2200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117799.952470:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be20902 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.952478:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be20902 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.952488:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:3.0:1789117799.952490:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117799.952494:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be20902 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.952500:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be20902 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.952542:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be209bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.952549:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be209bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.952556:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be209bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.952561:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f3800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117799.952564:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be209bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.952570:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be209bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117799.952703:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593213952 00000100:00100000:1.0:1789117799.952712:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593213952 00000100:00100000:1.0:1789117799.952763:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789117799.952776:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876025593213696:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789117799.952821:0:8434:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:1.0:1789117799.952861:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de805928/0xaa253ed19be209e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.952887:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000157b1ab6/0xaa253ed19be2079d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f12f expref: 12 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.952897:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789117799.952911:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789117799.952917:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de805928/0xaa253ed19be209e9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.952962:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000157b1ab6/0xaa253ed19be2079d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f12f expref: 12 pid: 8833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.952979:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000157b1ab6/0xaa253ed19be2079d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f12f expref: 12 pid: 8833 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117799.952996:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88624780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8434:1876025593214080:192.168.204.30@tcp:104: 00000100:00100000:1.0:1789117799.953145:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb300 going to sleep for 11 seconds 00010000:00010000:3.0:1789117799.953703:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff962b832d0600) 00010000:00010000:3.0:1789117799.953712:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789117799.953721:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be209bf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.953731:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3800/0xaa253ed19be209bf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117799.953793:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789117799.953813:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88626580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3647:x1876025593213952:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789117799.953840:0:8433:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:3.0:1789117799.953884:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa3c567, atime: 0x6aa3c567, ctime: 0x6aa3c567, blocks: 0x8 00010000:00010000:3.0:1789117799.953892:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a12eabc/0xaa253ed19be209f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.953918:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1789117799.953922:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117799.953929:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a12eabc/0xaa253ed19be209f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.953950:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a12eabc/0xaa253ed19be209f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.953963:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a12eabc/0xaa253ed19be209f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.953970:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a12eabc/0xaa253ed19be209f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.953998:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789117799.955395:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789117799.955407:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789117799.955430:0:8833:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789117799.955442:0:8833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1789117799.955536:0:8437:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1789117799.955548:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593213824 00000100:00100000:2.0:1789117799.955557:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593213824 00000100:00100000:3.0:1789117799.955893:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88626580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3647:x1876025593213952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2084us (4440us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789117799.955905:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789117799.955937:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789117799.955948:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf777c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3644:x1876025593213824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789117799.956115:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789117799.956119:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789117800 00002000:00010000:3.0:1789117799.956122:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789117799.956125:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789117800 -> 1789117800 00002000:00010000:3.0:1789117799.956127:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789117799.957128:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf777c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3644:x1876025593213824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1170us (1726us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1789117799.957300:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:3.0:1789117799.957348:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117799.957360:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a12eabc/0xaa253ed19be209f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.957375:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b80030a00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789117799.957383:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a12eabc/0xaa253ed19be209f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.957398:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a12eabc/0xaa253ed19be209f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.957431:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a12eabc/0xaa253ed19be209f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.957440:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a12eabc/0xaa253ed19be209f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117799.957466:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117799.957467:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117799.957469:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789117799.957522:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff962a88625680/2, rc 0, transno 4294967311 00000100:00100000:3.0:1789117799.957530:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88625680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593213952:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1789117799.957937:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff962bc1a4b0c0/2, rc 0, transno 4294967322 00000100:00100000:1.0:1789117799.957946:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593213824:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789117799.958537:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88566580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+21:12724:x1876025572178304:12345-192.168.204.30@tcp:44:lhsmtool_posix.0 Request processed in 17071us (17737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117799.958561:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 244 00000100:00100000:2.0:1789117799.965509:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117799.965680:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572178432 00000100:00100000:0.0:1789117799.965698:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572178432 00010000:00010000:0.0:1789117799.965769:0:7470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000157b1ab6/0xaa253ed19be2079d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f12f expref: 13 pid: 8833 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117799.965834:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 113 00000100:00100000:0.0:1789117799.965848:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+13:2406:x1876025572178432:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117799.965869:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117799.965895:0:7470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000157b1ab6/0xaa253ed19be2079d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f12f expref: 13 pid: 8833 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.965913:0:7470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000157b1ab6/0xaa253ed19be2079d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f12f expref: 13 pid: 8833 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.965951:0:7470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789117799.965956:0:7470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789117799.965963:0:7470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000de805928/0xaa253ed19be209e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.965975:0:7470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de805928/0xaa253ed19be209e9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789117799.965987:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:0.0:1789117799.966001:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00080000:3.0:1789117799.966002:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1789117799.966108:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+13:2406:x1876025572178432:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 263us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117799.966118:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 113 00000100:00100000:3.0:1789117799.966566:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117799.966596:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572178560 00000100:00100000:3.0:1789117799.966603:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572178560 00000100:00100000:3.0:1789117799.966651:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 76 00000100:00100000:3.0:1789117799.966659:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+13:2405:x1876025572178560:12345-192.168.204.30@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789117799.972144:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1789117799.972178:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00010000:00010000:1.0:1789117799.972484:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000157b1ab6/0xaa253ed19be2079d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f12f expref: 8 pid: 8833 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117799.972515:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88624780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8434:1876025593214080:192.168.204.30@tcp:104: 00010000:00010000:1.0:1789117799.972546:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000de805928/0xaa253ed19be209e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.972560:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000de805928/0xaa253ed19be209e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.972593:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de805928/0xaa253ed19be209e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.972617:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de805928/0xaa253ed19be209e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.972627:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de805928/0xaa253ed19be209e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117799.972654:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789117799.972691:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117799.972700:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de805928/0xaa253ed19be209e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.972709:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dbe00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117799.972714:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de805928/0xaa253ed19be209e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.972725:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de805928/0xaa253ed19be209e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.972749:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de805928/0xaa253ed19be209e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.972758:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de805928/0xaa253ed19be209e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.972780:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117799.972782:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117799.972784:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117799.972987:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876025593213696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20211us (22017us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1789117799.973000:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789117799.973039:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1789117799.973046:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:0.0:1789117799.973111:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff962bc1a4b0c0, transno 4294967322 00000100:00100000:0.0:1789117799.973125:0:3644:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff962bc1a49e00 x1876025593213696/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789117815 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789117799.973138:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff962bc1a49e00/2, rc 0, transno 4294967323 00000100:00100000:0.0:1789117799.973143:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593213696:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789117799.973645:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2405:x1876025572178560:12345-192.168.204.30@tcp:16:lhsmtool_posix.0 Request processed in 6982us (7075us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117799.973655:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 76 00000100:00100000:3.0:1789117799.975762:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117799.975870:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572178816 00000100:00100000:2.0:1789117799.975907:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572178816 00000100:00100000:2.0:1789117799.975984:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 245 00000100:00100000:2.0:1789117799.975998:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+21:12724:x1876025572178816:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789117799.976137:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117799.976180:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2800/0xaa253ed19be209d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1c9 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.976211:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff962b832d0600) 00010000:00010000:2.0:1789117799.976219:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117799.976274:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be209f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.976298:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be209f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.976312:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be209f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789117799.976527:0:6520:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000098003573 reply state 00000000f6d84a0f transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be209f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.976543:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be209f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117799.976549:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff962b832d0600) 00010000:00010000:2.0:1789117799.976552:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789117799.976555:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789117799.976692:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+22:12724:x1876025572178816:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 696us (946us total) trans 4294967510 rc 0/0 00000100:00100000:2.0:1789117799.976701:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 245 00000100:00100000:2.0:1789117799.979430:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117799.979723:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572178944 00000100:00100000:1.0:1789117799.979737:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572178944 00000100:00100000:1.0:1789117799.979810:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 77 00000100:00100000:1.0:1789117799.979822:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2406:x1876025572178944:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789117799.980013:0:8833:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789117799.980017:0:8833:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1789117800 -> 1789117800 00002000:00010000:1.0:1789117799.980020:0:8833:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789117799 00002000:00010000:1.0:1789117799.980023:0:8833:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789117800 -> 1789117800 00002000:00010000:1.0:1789117799.980025:0:8833:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789117799.980140:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2406:x1876025572178944:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 Request processed in 319us (723us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1789117799.980158:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 77 00000100:00100000:0.0:1789117799.994949:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117799.995181:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572179200 00000100:00100000:2.0:1789117799.995196:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572179200 00000100:00100000:0.0:1789117799.995392:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 246 00000100:00100000:0.0:1789117799.995406:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+22:12724:x1876025572179200:12345-192.168.204.30@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789117799.995522:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be209fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.995548:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be209b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1bb expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.995562:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be209fe lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.995632:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be209b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1bb expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117799.995652:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be209b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1bb expref: 22 pid: 6521 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117799.995671:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf774f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593214208:192.168.204.30@tcp:104: 00000100:00100000:0.0:1789117799.995809:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8299e240 going to sleep for 11 seconds 00000100:00100000:3.0:1789117800.001954:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117800.002189:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf774f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593214208:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117800.002231:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be209fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117800.003992:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572179328 00000100:00100000:1.0:1789117800.004009:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572179328 00010000:00010000:1.0:1789117800.004118:0:9524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be209b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1bb expref: 23 pid: 6521 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117800.004329:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 114 00000100:00100000:1.0:1789117800.004342:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+23:2407:x1876025572179328:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117800.004363:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117800.004371:0:9524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be209b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1bb expref: 23 pid: 6521 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117800.004389:0:9524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be209b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1bb expref: 23 pid: 6521 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117800.004420:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f5a00/0xaa253ed19be209b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1bb expref: 23 pid: 6521 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117800.004447:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff962b832d0600) 00010000:00010000:1.0:1789117800.004454:0:9524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be209fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117800.004465:0:9524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be209fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117800.004474:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be209fe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117800.004514:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117800.004548:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be209fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.004556:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be209fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117800.004601:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+22:2407:x1876025572179328:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 262us (2664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117800.004626:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 114 00010000:00010000:0.0:1789117800.004636:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be209fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.004644:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be209fe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.004651:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be209fe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.004658:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117800.004663:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be209fe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.004672:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be209fe lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.004682:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff962b832d0600) 00010000:00010000:0.0:1789117800.004684:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789117800.004688:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be209fe lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.004694:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be209fe lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117800.004742:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+21:12724:x1876025572179200:12345-192.168.204.30@tcp:55:lhsmtool_posix.0 Request processed in 9339us (9807us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789117800.004751:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 246 00000100:00100000:1.0:1789117800.007322:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117800.007387:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572179456 00000100:00100000:3.0:1789117800.007401:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572179456 00000100:00100000:3.0:1789117800.007481:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 78 00000100:00100000:0.0:1789117800.007545:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88624780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2405:x1876025572179456:12345-192.168.204.30@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789117800.007616:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000990480ba/0xaa253ed19be20a05 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.007663:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e68a5dcc/0xaa253ed19be209e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1d7 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.007674:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117800.007679:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789117800.007684:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000990480ba/0xaa253ed19be20a05 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.007803:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e68a5dcc/0xaa253ed19be209e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1d7 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.007822:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e68a5dcc/0xaa253ed19be209e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1d7 expref: 8 pid: 8433 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117800.007841:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf774f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1876025593214336:192.168.204.30@tcp:104: 00000100:00100000:0.0:1789117800.008367:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8299e240 going to sleep for 11 seconds 00000100:00100000:2.0:1789117800.022346:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117800.022467:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572179584 00000100:00100000:3.0:1789117800.022481:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572179584 00000100:00100000:0.0:1789117800.022520:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf774f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1876025593214336:192.168.204.30@tcp:104: 00010000:00010000:3.0:1789117800.022539:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e68a5dcc/0xaa253ed19be209e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1d7 expref: 9 pid: 8433 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.022554:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000990480ba/0xaa253ed19be20a05 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117800.022597:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 115 00000100:00100000:3.0:1789117800.022617:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+9:2406:x1876025572179584:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117800.022637:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117800.022666:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e68a5dcc/0xaa253ed19be209e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1d7 expref: 9 pid: 8433 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117800.022721:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e68a5dcc/0xaa253ed19be209e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1d7 expref: 9 pid: 8433 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117800.022759:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e68a5dcc/0xaa253ed19be209e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1d7 expref: 9 pid: 8433 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117800.022785:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789117800.022790:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789117800.022796:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000990480ba/0xaa253ed19be20a05 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117800.022809:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000990480ba/0xaa253ed19be20a05 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117800.022849:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117800.022939:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2406:x1876025572179584:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 332us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117800.022949:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 115 00010000:00010000:0.0:1789117800.023389:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000990480ba/0xaa253ed19be20a05 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.023400:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000990480ba/0xaa253ed19be20a05 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.023437:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000990480ba/0xaa253ed19be20a05 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.023446:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000990480ba/0xaa253ed19be20a05 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.023454:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000990480ba/0xaa253ed19be20a05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.023461:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4c00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789117800.023465:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000990480ba/0xaa253ed19be20a05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.023475:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000990480ba/0xaa253ed19be20a05 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.023490:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000990480ba/0xaa253ed19be20a05 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.023499:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000990480ba/0xaa253ed19be20a05 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117800.023585:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88624780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2405:x1876025572179456:12345-192.168.204.30@tcp:1:lhsmtool_posix.0 Request processed in 16092us (16273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117800.023595:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 78 00000100:00100000:2.0:1789117800.037447:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117800.042505:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572179840 00000100:00100000:3.0:1789117800.042537:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572179840 00000100:00100000:2.0:1789117800.043513:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 247 00000100:00100000:2.0:1789117800.043531:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+21:12724:x1876025572179840:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789117800.043663:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2e00/0xaa253ed19be20a0c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117800.043684:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2c00/0xaa253ed19be208fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f183 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117800.043696:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2e00/0xaa253ed19be20a0c lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117800.043745:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2c00/0xaa253ed19be208fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f183 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117800.043763:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2c00/0xaa253ed19be208fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f183 expref: 21 pid: 6521 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117800.043781:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876025593214464:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789117800.043914:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a88489480 going to sleep for 11 seconds 00000100:00100000:1.0:1789117800.060885:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117800.061026:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572179968 00000100:00100000:3.0:1789117800.061040:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572179968 00010000:00010000:3.0:1789117800.061168:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2c00/0xaa253ed19be208fb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f183 expref: 22 pid: 6521 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117800.061213:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 116 00000100:00100000:3.0:1789117800.061246:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9277e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+22:2407:x1876025572179968:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117800.061268:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117800.061277:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2c00/0xaa253ed19be208fb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f183 expref: 22 pid: 6521 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117800.061294:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2c00/0xaa253ed19be208fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f183 expref: 22 pid: 6521 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117800.061334:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:3.0:1789117800.061343:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3200/0xaa253ed19be2095d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1a6 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117800.061358:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2e00/0xaa253ed19be20a0c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117800.061368:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2e00/0xaa253ed19be20a0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117800.061378:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2e00/0xaa253ed19be20a0c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117800.061407:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117800.061511:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9277e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+22:2407:x1876025572179968:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 268us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117800.061521:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 116 00010000:00010000:2.0:1789117800.061912:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2c00/0xaa253ed19be208fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f183 expref: 21 pid: 6521 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117800.061937:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876025593214464:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789117800.061983:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2e00/0xaa253ed19be20a0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117800.061997:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2e00/0xaa253ed19be20a0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117800.062004:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2e00/0xaa253ed19be20a0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117800.062346:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be20a13 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117800.062363:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be209c6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1c2 expref: 21 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117800.062373:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be20a13 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117800.062417:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be209c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1c2 expref: 21 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117800.062437:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be209c6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1c2 expref: 21 pid: 14247 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117800.062456:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876025593214592:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789117800.062556:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a884893c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117800.067326:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876025593214592:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789117800.067375:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be20a13 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117800.068159:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117800.078437:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572180096 00000100:00100000:2.0:1789117800.078460:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572180096 00010000:00010000:2.0:1789117800.078533:0:9524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be209c6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1c2 expref: 22 pid: 14247 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117800.078593:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 117 00000100:00100000:2.0:1789117800.078616:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+22:2406:x1876025572180096:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117800.078641:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117800.078650:0:9524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be209c6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1c2 expref: 22 pid: 14247 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117800.078667:0:9524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be209c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1c2 expref: 22 pid: 14247 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117800.078702:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be209c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1c2 expref: 22 pid: 14247 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117800.078727:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff962b832d0600) 00010000:00010000:2.0:1789117800.078733:0:9524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be20a13 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117800.078744:0:9524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be20a13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117800.078753:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be20a13 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117800.078793:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117800.078900:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+21:2406:x1876025572180096:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 295us (10747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117800.078909:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 117 00010000:00010000:0.0:1789117800.079344:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be20a13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.079356:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be20a13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789117800.079526:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1789117800.079689:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:0.0:1789117800.079738:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1789117800.079854:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf774f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1876025593214720:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789117800.079940:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117800.079999:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bae4706c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117800.084948:0:14928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593214720 00000100:00100000:3.0:1789117800.084968:0:14928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593214720 00000100:00100000:3.0:1789117800.085098:0:14928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789117800.085110:0:14928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6519:x1876025593214720:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789117800.085320:0:14928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6519:x1876025593214720:12345-0@lo:1000:mdt00_000.0 Request processed in 211us (5378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117800.085328:0:14928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789117800.085499:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf774f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1876025593214720:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789117800.085729:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:0.0:1789117800.085826:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf774f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1876025593214848:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789117800.085874:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117800.085896:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b813e1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789117800.085977:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593214848 00000100:00100000:1.0:1789117800.085982:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593214848 00000100:00100000:1.0:1789117800.086026:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789117800.086034:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6519:x1876025593214848:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789117800.086210:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6519:x1876025593214848:12345-0@lo:1000:mdt00_000.0 Request processed in 176us (335us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789117800.086217:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789117800.086490:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf774f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1876025593214848:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789117800.086547:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be20a13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.086560:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be20a13 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.086568:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be20a13 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.086575:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f2000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117800.086581:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be20a13 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.086626:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be20a13 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.086650:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff962b832d0600) 00010000:00010000:0.0:1789117800.086653:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789117800.086661:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be20a13 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.086667:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2000/0xaa253ed19be20a13 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.086703:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20956 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.086711:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20956 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.086717:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20956 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.086722:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dba00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117800.086725:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20956 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.086731:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20956 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.086739:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:0.0:1789117800.086741:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789117800.086749:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3200/0xaa253ed19be2095d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1a6 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.086773:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3200/0xaa253ed19be2095d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1a6 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.086785:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3200/0xaa253ed19be2095d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1a6 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.086821:0:6519:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3200/0xaa253ed19be2095d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1a6 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117800.086834:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7752c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876025593214976:192.168.204.30@tcp:105: 00000100:00100000:0.0:1789117800.086914:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b88605cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117800.091326:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7752c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876025593214976:192.168.204.30@tcp:105: 00010000:00010000:0.0:1789117800.091376:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20956 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.091391:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20956 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.091443:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20a1a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.091462:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20a1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.091477:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20a1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.091489:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20a1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.091515:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20a1a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.091522:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20a1a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.091529:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117800.091533:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20a1a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.091541:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20a1a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.091557:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:0.0:1789117800.091560:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117800.091564:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20a1a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.091570:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20a1a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.091582:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2e00/0xaa253ed19be20a0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.091589:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2e00/0xaa253ed19be20a0c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.091595:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2e00/0xaa253ed19be20a0c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.091600:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f2e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117800.091621:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2e00/0xaa253ed19be20a0c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.091628:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2e00/0xaa253ed19be20a0c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.091637:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:0.0:1789117800.091639:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789117800.091642:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2e00/0xaa253ed19be20a0c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.091649:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2e00/0xaa253ed19be20a0c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117800.091887:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+24:12724:x1876025572179840:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 48358us (54456us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1789117800.091901:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 247 00000020:00080000:0.0:1789117800.091910:0:6519:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789117800.093964:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000040:00080000:2.0:1789117800.094484:0:14501:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789117800.094492:0:14501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789117800.095004:0:14501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789117800.095014:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789117800.099875:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572180224 00000100:00100000:0.0:1789117800.099906:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572180224 00000100:00100000:0.0:1789117800.100024:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 61 00000100:00100000:0.0:1789117800.100041:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+24:12723:x1876025572180224:12345-192.168.204.30@tcp:49:lfs.0 00000100:00100000:0.0:1789117800.100297:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+24:12723:x1876025572180224:12345-192.168.204.30@tcp:49:lfs.0 Request processed in 259us (6346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117800.100307:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 61 00000100:00100000:2.0:1789117800.110467:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117800.110561:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572180480 00000100:00100000:0.0:1789117800.110575:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572180480 00000100:00100000:0.0:1789117800.110666:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 62 00000100:00100000:0.0:1789117800.110681:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962baeaa5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+24:12724:x1876025572180480:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789117800.111139:0:6523:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789117800.111195:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:0.0:1789117800.111239:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20a21 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.111260:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20a21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.111275:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20a21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.111285:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20a21 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.111293:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20a21 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.111299:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20a21 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.111323:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789117800.111461:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962baeaa5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+26:12724:x1876025572180480:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 783us (1013us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1789117800.111471:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 62 00000020:00080000:0.0:1789117800.111478:0:6523:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789117800.111734:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117800.111744:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20a21 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117800.111752:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4400 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789117800.111757:0:9523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20a21 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117800.111766:0:9523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20a21 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117800.111782:0:9523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff962b832d0600) 00010000:00010000:3.0:1789117800.111786:0:9523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789117800.111792:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20a21 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117800.111799:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4400/0xaa253ed19be20a21 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117800.111816:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117800.111818:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117800.111820:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117800.114415:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117800.114598:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572180736 00000100:00100000:3.0:1789117800.114624:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572180736 00000100:00100000:3.0:1789117800.114705:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 248 00000100:00100000:3.0:1789117800.114719:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+26:12723:x1876025572180736:12345-192.168.204.30@tcp:58:lfs.0 00000040:00080000:3.0:1789117800.114964:0:9533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1789117800.115402:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+26:12723:x1876025572180736:12345-192.168.204.30@tcp:58:lfs.0 Request processed in 683us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117800.115413:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 248 00000100:00100000:3.0:1789117800.154535:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117800.155326:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572180864 00000100:00100000:0.0:1789117800.155346:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572180864 00000100:00100000:1.0:1789117800.158864:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 249 00000100:00100000:1.0:1789117800.158884:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+26:12726:x1876025572180864:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1789117800.158920:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117800.158949:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20a28 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f1de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117800.159036:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20a2f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117800.159100:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20a2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117800.159118:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20a2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117800.159179:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20a36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117800.159188:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20a36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117800.159195:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20a36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117800.159344:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20a3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117800.159360:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20948 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f19f expref: 27 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117800.159372:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20a3d lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117800.159435:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20948 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f19f expref: 27 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117800.159454:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20948 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f19f expref: 27 pid: 14247 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117800.159474:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593215104:192.168.204.30@tcp:104: 00000100:00100000:1.0:1789117800.159636:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117800.171949:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117800.172102:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572181120 00000100:00100000:0.0:1789117800.172115:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572181120 00000100:00100000:0.0:1789117800.172191:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 63 00000100:00100000:0.0:1789117800.172203:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+28:6178:x1876025572181120:12345-192.168.204.30@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789117800.172530:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+29:6178:x1876025572181120:12345-192.168.204.30@tcp:35:ldlm_bl.0 Request processed in 329us (598us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1789117800.172539:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 63 00000100:00100000:1.0:1789117800.172874:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876025593215104:192.168.204.30@tcp:104: 00010000:00010000:1.0:1789117800.172913:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20a3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117800.177887:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117800.177989:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572181248 00000100:00100000:1.0:1789117800.178004:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572181248 00010000:00010000:1.0:1789117800.178099:0:7470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20948 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f19f expref: 29 pid: 14247 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117800.178161:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 118 00000100:00100000:1.0:1789117800.178183:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+29:2406:x1876025572181248:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117800.178204:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117800.178212:0:7470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20948 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f19f expref: 29 pid: 14247 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117800.178228:0:7470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20948 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f19f expref: 29 pid: 14247 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117800.178267:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be20948 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f19f expref: 29 pid: 14247 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117800.178289:0:7470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:1.0:1789117800.178295:0:7470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20a3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117800.178305:0:7470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20a3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117800.178315:0:7470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20a3d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117800.178348:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117800.181913:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20a3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.181942:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20a3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117800.182028:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789117800.182035:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789117800.182229:0:6521:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20a3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.182252:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20a3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.182265:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20a2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.182273:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20a2f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.182282:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20a2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.182289:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dba00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117800.182294:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20a2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.182302:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20a2f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.182354:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:0.0:1789117800.182358:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117800.182364:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20a2f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.182372:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be20a2f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.182395:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20a36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.182402:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20a36 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.182408:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20a36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.182413:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813daa00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117800.182417:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20a36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.182423:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20a36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.182432:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff962b84d70a00) 00010000:00010000:0.0:1789117800.182435:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117800.182438:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20a36 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.182444:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813daa00/0xaa253ed19be20a36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.182522:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dbe00/0xaa253ed19be20a28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1de expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.182540:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20a3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1de expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117800.182549:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:0.0:1789117800.182551:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117800.182555:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813db600, rc 0) 00000100:00100000:1.0:1789117800.182827:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+28:2406:x1876025572181248:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 4641us (4957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117800.182841:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 118 00000100:00100000:0.0:1789117800.187150:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+27:12726:x1876025572180864:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 28249us (32610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117800.187169:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 249 00010000:00010000:0.0:1789117800.428731:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789117801.075132:0:15364:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789117801.075146:0:15364:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789117801.075188:0:15364:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789117801.075196:0:15364:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789117801.125347:0:14501:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789117801.125366:0:14501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789117801.125411:0:14501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789117801.125422:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789117801.125629:0:14501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a492c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14501:1876025593215232:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789117801.125809:0:14501:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b829ea000 going to sleep for 11 seconds 00000100:00100000:2.0:1789117801.135930:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117801.136132:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572181376 00000100:00100000:0.0:1789117801.136275:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572181376 00000100:00100000:0.0:1789117801.136402:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 250 00000100:00100000:0.0:1789117801.136424:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+28:12739:x1876025572181376:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789117801.136494:0:6519:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789117801.136694:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+28:12739:x1876025572181376:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 278us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117801.136705:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 250 00000100:00080000:2.0:1789117801.137146:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117801.138659:0:14501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a492c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14501:1876025593215232:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789117801.142826:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117801.144094:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572181632 00000100:00100000:0.0:1789117801.144487:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572181632 00000100:00100000:0.0:1789117801.145656:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 251 00000100:00100000:0.0:1789117801.145673:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+27:12739:x1876025572181632:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789117801.145720:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117801.145758:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20a44 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f1e5 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117801.145936:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20a4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117801.145959:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20a4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117801.145979:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20a4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117801.145996:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789117801.146192:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4c00/0xaa253ed19be20a44 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1e5 expref: 30 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117801.146217:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20a4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1e5 expref: 29 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117801.146228:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:0.0:1789117801.146232:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117801.146237:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f4200, rc 0) 00000100:00100000:0.0:1789117801.146346:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+29:12739:x1876025572181632:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 678us (3536us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1789117801.146356:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 251 00000100:00100000:3.0:1789117801.149886:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117801.149948:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572181760 00000100:00100000:3.0:1789117801.149964:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572181760 00000100:00100000:3.0:1789117801.150115:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:3.0:1789117801.150131:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae57e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+29:2406:x1876025572181760:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117801.150167:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117801.150205:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bc20f4200/0xaa253ed19be20a4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1e5 expref: 29 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117801.150226:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:3.0:1789117801.150233:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117801.150320:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae57e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+28:2406:x1876025572181760:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 190us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117801.150330:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:1.0:1789117801.157522:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117801.157649:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572182016 00000100:00100000:2.0:1789117801.157666:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572182016 00000100:00100000:2.0:1789117801.157759:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 252 00000100:00100000:2.0:1789117801.157773:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+28:12739:x1876025572182016:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789117801.157904:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3c00/0xaa253ed19be20a59 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117801.157931:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3c00/0xaa253ed19be20a59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117801.157951:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3c00/0xaa253ed19be20a59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117801.158519:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3c00/0xaa253ed19be20a59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117801.158530:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3c00/0xaa253ed19be20a59 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117801.158537:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3c00/0xaa253ed19be20a59 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117801.158545:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f3c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117801.158552:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3c00/0xaa253ed19be20a59 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117801.158561:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3c00/0xaa253ed19be20a59 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117801.158579:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:2.0:1789117801.158582:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789117801.158601:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3c00/0xaa253ed19be20a59 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117801.158609:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3c00/0xaa253ed19be20a59 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117801.158803:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+29:12739:x1876025572182016:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 1028us (1294us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1789117801.158816:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 252 00000040:00080000:1.0:1789117801.158948:0:14501:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789117801.158956:0:14501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789117801.162958:0:14501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789117801.162992:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789117801.164505:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117801.164867:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572182272 00000100:00100000:1.0:1789117801.164881:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572182272 00000100:00100000:1.0:1789117801.165157:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 64 00000100:00100000:1.0:1789117801.165172:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+29:12739:x1876025572182272:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789117801.165572:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+30:12739:x1876025572182272:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 389us (1067us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1789117801.165583:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 64 00000100:00100000:3.0:1789117801.319982:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789117801.320153:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593215488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789117801.320261:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117801.320390:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593215488 00000100:00100000:2.0:1789117801.320402:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593215488 00000100:00100000:2.0:1789117801.320495:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789117801.320507:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593215488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789117801.320553:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789117801.320620:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593215488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117801.320629:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:2.0:1789117801.320658:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789117801.320705:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593215488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789117801.325957:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593215360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117801.326165:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117801.326606:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593215360 00000100:00100000:1.0:1789117801.326619:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593215360 00000100:00100000:1.0:1789117801.326710:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789117801.326723:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593215360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789117801.326762:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117801.326842:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593215360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117801.326853:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789117801.326905:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1789117801.326912:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:1.0:1789117801.326937:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff962a88679e00, transno 4294967308 00000004:00080000:1.0:1789117801.326949:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:1.0:1789117801.326982:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff962a88625680, transno 4294967311 00000100:00100000:1.0:1789117801.326999:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593215360:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789117801.327349:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789117801.446697:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117801.830328:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593215744:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117801.830447:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117801.831728:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593215616:0@lo:400:kworker.0 00000100:00100000:0.0:1789117801.831814:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117801.831825:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593215744 00000100:00100000:3.0:1789117801.831838:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593215744 00000100:00100000:3.0:1789117801.832027:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789117801.832042:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593215744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789117801.832125:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789117801.832797:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593215744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 754us (2345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117801.832810:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789117801.832810:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593216000:0@lo:400:kworker.0 00000100:00100000:2.0:1789117801.832892:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117801.832922:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593215872:0@lo:400:kworker.0 00000100:00100000:3.0:1789117801.832958:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117801.833160:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593216000 00000100:00100000:2.0:1789117801.833228:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593216000 00000100:00100000:2.0:1789117801.833289:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593215872 00000100:00100000:2.0:1789117801.833293:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593215872 00000100:00100000:2.0:1789117801.833402:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1789117801.833412:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593216000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117801.833479:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593216000:12345-0@lo:400:kworker.0 Request processed in 69us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117801.833489:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:3.0:1789117801.833502:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:2.0:1789117801.833535:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593215616 00000100:00100000:2.0:1789117801.833540:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593215616 00000100:00100000:2.0:1789117801.833589:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:2.0:1789117801.833616:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593215616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117801.833658:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3645:x1876025593215616:12345-0@lo:400:kworker.0 Request processed in 45us (1846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117801.833666:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1789117801.833840:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593215872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117801.833899:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593215872:12345-0@lo:400:kworker.0 Request processed in 388us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117801.833906:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:0.0:1789117801.836312:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593215616:0@lo:400:kworker.0 00000100:00100000:0.0:1789117801.836337:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593216128:0@lo:400:kworker.0 00000100:00100000:0.0:1789117801.836439:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117801.836612:0:14928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593216128 00000100:00100000:2.0:1789117801.836622:0:14928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593216128 00000100:00100000:0.0:1789117801.837843:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593216640:0@lo:400:kworker.0 00000100:00100000:2.0:1789117801.838085:0:14928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789117801.838107:0:14928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf776580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593216128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117801.838631:0:14928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf776580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593216128:12345-0@lo:400:kworker.0 Request processed in 532us (2193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117801.838642:0:14928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789117801.839493:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593215744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789117801.839540:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593216256:0@lo:400:kworker.0 00000100:00100000:3.0:1789117801.839612:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117801.839659:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f72580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593216768:0@lo:400:kworker.0 00000100:00100000:3.0:1789117801.839692:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117801.839733:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593216256 00000100:00100000:3.0:1789117801.839742:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593216256 00000100:00100000:3.0:1789117801.839827:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593216768 00000100:00100000:3.0:1789117801.839831:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593216768 00000100:00100000:3.0:1789117801.839854:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:3.0:1789117801.839864:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593216256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117801.839918:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593216256:12345-0@lo:400:kworker.0 Request processed in 54us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117801.839925:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:3.0:1789117801.839942:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:3.0:1789117801.839948:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593216768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117801.839974:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593216768:12345-0@lo:400:kworker.0 Request processed in 27us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117801.839980:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00080000:3.0:1789117801.840000:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117801.840027:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f72580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593216768:0@lo:400:kworker.0 00000100:00100000:3.0:1789117801.840050:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593216256:0@lo:400:kworker.0 00000100:00100000:2.0:1789117801.840482:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593216000:0@lo:400:kworker.0 00000100:00100000:0.0:1789117801.840815:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117801.840864:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593217152:0@lo:400:kworker.0 00000100:00100000:0.0:1789117801.840904:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117801.840955:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593216128:0@lo:400:kworker.0 00000100:00100000:1.0:1789117801.840964:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593216640 00000100:00100000:1.0:1789117801.840973:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593216640 00000100:00100000:0.0:1789117801.840987:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593217152 00000100:00100000:0.0:1789117801.840993:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593217152 00000100:00100000:1.0:1789117801.841032:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789117801.841048:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593216640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117801.841048:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789117801.841083:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf776d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3645:x1876025593217152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117801.841134:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf776d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3645:x1876025593217152:12345-0@lo:400:kworker.0 Request processed in 57us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117801.841143:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:0.0:1789117801.841172:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789117801.841191:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593217152:0@lo:400:kworker.0 00000100:00100000:1.0:1789117801.841966:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593216640:12345-0@lo:400:kworker.0 Request processed in 924us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117801.841977:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789117801.842638:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88625680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593216512:0@lo:400:kworker.0 00000100:00100000:3.0:1789117801.842878:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593215872:0@lo:400:kworker.0 00000100:00100000:3.0:1789117801.842889:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876025593216384:0@lo:400:kworker.0 00000100:00100000:2.0:1789117801.845097:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117801.845190:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593217024:0@lo:400:kworker.0 00000100:00100000:2.0:1789117801.845230:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117801.845625:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593216512 00000100:00100000:1.0:1789117801.845638:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593216512 00000100:00100000:1.0:1789117801.845769:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593217024 00000100:00100000:1.0:1789117801.845773:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593217024 00000100:00100000:1.0:1789117801.845826:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789117801.845838:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593216512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117801.845989:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593216512:12345-0@lo:400:kworker.0 Request processed in 153us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117801.845999:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789117801.846020:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789117801.846027:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88679e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593217024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117801.846087:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88679e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593217024:12345-0@lo:400:kworker.0 Request processed in 60us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117801.846094:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:1.0:1789117801.846201:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117801.846328:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88625680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593216512:0@lo:400:kworker.0 00000100:00100000:2.0:1789117801.846344:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593217024:0@lo:400:kworker.0 00000100:00100000:0.0:1789117801.848874:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593216640:0@lo:400:kworker.0 00000100:00100000:3.0:1789117801.849658:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117801.850316:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f71a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876025593216896:0@lo:400:kworker.0 00000100:00100000:3.0:1789117801.850469:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117801.851864:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593216384 00000100:00100000:2.0:1789117801.851896:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593216384 00000100:00100000:2.0:1789117801.852358:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593216896 00000100:00100000:2.0:1789117801.852364:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593216896 00000100:00100000:2.0:1789117801.852417:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1789117801.852432:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876025593216384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117801.852586:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876025593216384:12345-0@lo:400:kworker.0 Request processed in 144us (2918us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117801.852616:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1789117801.852637:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:2.0:1789117801.852644:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876025593216896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117801.852691:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876025593216896:12345-0@lo:400:kworker.0 Request processed in 48us (2222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117801.852697:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00010000:00080000:3.0:1789117801.853097:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b988a0f00 x1876025593216384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117801.853125:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876025593216384:0@lo:400:kworker.0 00010000:00080000:3.0:1789117801.853157:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f71a40 x1876025593216896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117801.853178:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f71a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876025593216896:0@lo:400:kworker.0 00000100:00080000:1.0:1789117801.853227:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789117802.344469:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf776940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593217408:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117802.344531:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593217280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117802.344606:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117802.344908:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593217280 00000100:00100000:2.0:1789117802.344922:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593217280 00000100:00100000:2.0:1789117802.345291:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789117802.345307:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876025593217280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789117802.345366:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789117802.345436:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117802.345506:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593217408 00000100:00100000:3.0:1789117802.345511:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593217408 00000100:00100000:3.0:1789117802.345540:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789117802.345548:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593217408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789117802.345560:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789117802.345619:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876025593217280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 315us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117802.345627:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789117802.345705:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593217280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117802.346349:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593217408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 796us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117802.346354:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf776940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593217408:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117802.346366:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00010000:00010000:1.0:1789117802.475870:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789117802.977141:0:15415:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789117802.977168:0:15415:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789117802.977248:0:15415:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789117802.977262:0:15415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789117803.204210:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117803.204260:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572182528 00000100:00100000:2.0:1789117803.204271:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572182528 00000100:00080000:0.0:1789117803.204588:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117803.204601:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 253 00000100:00100000:2.0:1789117803.204618:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf776940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+30:12759:x1876025572182528:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789117803.204654:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117803.204680:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be20a60 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f1ec expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117803.204904:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3000/0xaa253ed19be20a67 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117803.204935:0:9533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3000/0xaa253ed19be20a67 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117803.204953:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3000/0xaa253ed19be20a67 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117803.204968:0:9533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789117803.205143:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be20a60 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1ec expref: 33 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117803.205163:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3000/0xaa253ed19be20a67 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1ec expref: 32 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117803.205172:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:2.0:1789117803.205176:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789117803.205180:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f3000, rc 0) 00000100:00100000:3.0:1789117803.205387:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf776940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+32:12759:x1876025572182528:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 771us (1187us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1789117803.205397:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 253 00000100:00100000:3.0:1789117803.214587:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117803.215399:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572182656 00000100:00100000:2.0:1789117803.215413:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572182656 00000100:00100000:2.0:1789117803.215486:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 254 00000100:00100000:2.0:1789117803.215498:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+32:12759:x1876025572182656:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:2.0:1789117803.215587:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20a75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117803.215610:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20a75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117803.215624:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20a75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117803.215672:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20a75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117803.215679:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20a75 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117803.215686:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20a75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117803.215693:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f2400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117803.215698:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20a75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117803.215705:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20a75 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117803.215720:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:2.0:1789117803.215723:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789117803.215728:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20a75 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117803.215733:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2400/0xaa253ed19be20a75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117803.215870:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+32:12759:x1876025572182656:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 374us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117803.215879:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 254 00000100:00100000:0.0:1789117803.320264:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117803.320476:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572182784 00000100:00100000:1.0:1789117803.320488:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572182784 00000100:00100000:1.0:1789117803.320635:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 79 00000100:00100000:1.0:1789117803.320647:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf774780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2407:x1876025572182784:12345-192.168.204.30@tcp:101:cat.0 00010000:00010000:1.0:1789117803.320667:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117803.320690:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c253a89f/0xaa253ed19be20a7c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f1f3 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789117803.320730:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aa3c568, atime: 0x6aa3c567, ctime: 0x6aa3c568, blocks: 0x8 00010000:00010000:1.0:1789117803.320757:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1789117803.320762:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117803.320773:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c253a89f/0xaa253ed19be20a7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1f3 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117803.320810:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c253a89f/0xaa253ed19be20a7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1f3 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117803.320831:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813dba00, rc 0) 00000100:00100000:1.0:1789117803.320918:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf774780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2407:x1876025572182784:12345-192.168.204.30@tcp:101:cat.0 Request processed in 272us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117803.320925:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 79 00000100:00080000:0.0:1789117803.322644:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789117803.324851:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117803.325019:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572182912 00000100:00100000:1.0:1789117803.325124:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572182912 00002000:00100000:1.0:1789117803.325175:0:8441:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff962bbf775a40 x1876025572182912/t0(0) o3->35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp:354/0 lens 488/0 e 0 to 0 dl 1789117814 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789117803.325199:0:8441:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962bbf775a40 with x1876025572182912 ext(0->4095) 00002000:00010000:1.0:1789117803.325206:0:8441:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff962bbf775a40 00000100:00100000:1.0:1789117803.325232:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:1.0:1789117803.325241:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf775a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2404:x1876025572182912:12345-192.168.204.30@tcp:3:cat.0 00000100:00100000:1.0:1789117803.325885:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf775a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+8:2404:x1876025572182912:12345-192.168.204.30@tcp:3:cat.0 Request processed in 640us (1039us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789117803.325893:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00002000:00100000:1.0:1789117803.325900:0:8441:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff962bbf775a40 x1876025572182912/t0(0) o3->35e670b1-2cce-4394-8cb4-d5255c6a6a93@192.168.204.30@tcp:354/0 lens 488/4536 e 0 to 0 dl 1789117814 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789117803.325909:0:8441:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962bbf775a40 with x1876025572182912 ext(0->4095) 00002000:00010000:1.0:1789117803.325913:0:8441:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff962bbf775a40 00000100:00100000:1.0:1789117803.361373:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117803.361523:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117803.361571:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117803.361620:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117803.361649:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572183296 00000100:00100000:0.0:1789117803.361661:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572183296 00000100:00100000:1.0:1789117803.361706:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117803.361743:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 157 00000100:00100000:0.0:1789117803.361756:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f73c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2405:x1876025572183296:12345-192.168.204.30@tcp:400:kworker.0 00000100:00080000:1.0:1789117803.361768:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117803.361845:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f73c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2405:x1876025572183296:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 91us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117803.361847:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572183552 00000100:00100000:0.0:1789117803.361856:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 157 00000100:00100000:1.0:1789117803.361857:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572183552 00000100:00100000:1.0:1789117803.361914:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572183168 00000100:00100000:1.0:1789117803.361917:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572183168 00000100:00100000:1.0:1789117803.361936:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572183424 00000100:00100000:1.0:1789117803.361938:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572183424 00000100:00100000:1.0:1789117803.361953:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 423 00000100:00100000:1.0:1789117803.361959:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572183552:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117803.362044:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572183552:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 79us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117803.362101:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 423 00000100:00100000:1.0:1789117803.362138:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 424 00000100:00100000:1.0:1789117803.362155:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2405:x1876025572183168:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117803.362226:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2405:x1876025572183168:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 75us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117803.362238:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 424 00000100:00100000:1.0:1789117803.362259:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 425 00000100:00100000:1.0:1789117803.362270:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572183424:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117803.362322:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:100c793d-0063-4934-90f0-b04fc41ff903+5:2405:x1876025572183424:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 53us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117803.362332:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 425 00000100:00080000:1.0:1789117803.362363:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789117803.362370:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789117803.365962:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572183040 00000100:00100000:3.0:1789117803.365983:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572183040 00000100:00100000:3.0:1789117803.366126:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 469 00000100:00100000:3.0:1789117803.366138:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2405:x1876025572183040:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117803.366272:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2405:x1876025572183040:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 136us (4916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117803.366504:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 469 00010000:00010000:0.0:1789117803.493445:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117804.389282:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789117804.389307:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593217536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789117804.389384:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117804.389509:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593217536 00000100:00100000:3.0:1789117804.389521:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593217536 00000100:00100000:3.0:1789117804.389608:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789117804.389619:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593217536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789117804.389658:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789117804.389836:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593217536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 218us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117804.389843:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789117804.390101:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593217536:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789117804.521242:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117805.542305:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789117805.933591:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:3.0:1789117805.933629:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1789117805.946275:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:0.0:1789117805.946341:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff962bae4706c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789117805.946348:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962b90353d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff962bae470a80 00000020:00080000:0.0:1789117805.946353:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962b90353500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff962a86c49800 00000020:00080000:0.0:1789117805.946391:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1789117805.946457:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1789117805.946599:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1789117805.946676:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be209f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117805.946690:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be209f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117805.946719:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be209f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117805.946727:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f2200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117805.946732:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be209f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117805.946743:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be209f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117805.946771:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff962b832d0600) 00010000:00010000:1.0:1789117805.946775:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117805.946782:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be209f7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117805.946791:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be209f7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117806.437909:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593217664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117806.438034:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117806.438279:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593217664 00000100:00100000:3.0:1789117806.438290:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593217664 00000100:00080000:0.0:1789117806.438374:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789117806.438383:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789117806.438400:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88565680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593217664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789117806.438450:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117806.438536:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88565680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593217664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117806.438546:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789117806.438651:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593217664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117806.438960:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593217792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789117806.439001:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117806.439283:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593217792 00000100:00100000:0.0:1789117806.439289:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593217792 00000100:00100000:0.0:1789117806.439400:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789117806.439410:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593217792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789117806.439428:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789117806.439468:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593217792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117806.439501:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789117806.439539:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593217792:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789117806.440215:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789117806.566693:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117806.951293:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789117806.951319:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593218304:0@lo:400:kworker.0 00000100:00100000:1.0:1789117806.951378:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593218176:0@lo:400:kworker.0 00000100:00100000:2.0:1789117806.951395:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117806.951420:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117806.951457:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a886783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593217920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117806.951495:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117806.951530:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f71a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593218816:0@lo:400:kworker.0 00000100:00100000:0.0:1789117806.951535:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593218432:0@lo:400:kworker.0 00000100:00100000:2.0:1789117806.951559:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117806.951581:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117806.951591:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f72580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593219328:0@lo:400:kworker.0 00000100:00100000:0.0:1789117806.951608:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593218944:0@lo:400:kworker.0 00000100:00100000:2.0:1789117806.951620:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117806.951641:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117806.951665:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593218304 00000100:00100000:0.0:1789117806.951667:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b989cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593219456:0@lo:400:kworker.0 00000100:00100000:2.0:1789117806.951673:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593218304 00000100:00100000:0.0:1789117806.951693:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117806.951728:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593217920 00000100:00100000:2.0:1789117806.951732:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593217920 00000100:00100000:2.0:1789117806.951752:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789117806.951762:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593218176 00000100:00100000:2.0:1789117806.951763:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a886792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1876025593218304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117806.951767:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593218176 00000100:00100000:0.0:1789117806.951800:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593218816 00000100:00100000:0.0:1789117806.951803:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593218816 00000100:00100000:2.0:1789117806.951825:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a886792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1876025593218304:12345-0@lo:400:kworker.0 Request processed in 64us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117806.951831:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593218432 00000100:00100000:0.0:1789117806.951835:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593218432 00000100:00100000:2.0:1789117806.951836:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789117806.951850:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593219328 00000100:00100000:0.0:1789117806.951854:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593219328 00000100:00100000:2.0:1789117806.951860:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789117806.951869:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88678b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593217920:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117806.951875:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1789117806.951884:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593218176:12345-0@lo:400:kworker.0 00000004:00000024:2.0:1789117806.951893:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789117806.951922:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593218176:12345-0@lo:400:kworker.0 Request processed in 39us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117806.951931:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:2.0:1789117806.951937:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88678b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593217920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117806.951946:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789117806.951950:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1789117806.951959:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593218816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117806.951986:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593218816:12345-0@lo:400:kworker.0 Request processed in 29us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117806.951993:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1789117806.952020:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1789117806.952027:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593218432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117806.952072:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593218048:0@lo:400:kworker.0 00000100:00100000:0.0:1789117806.952082:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593218432:12345-0@lo:400:kworker.0 Request processed in 54us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117806.952089:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1789117806.952103:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:0.0:1789117806.952114:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8867a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593219328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117806.952115:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117806.952157:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593218560:0@lo:400:kworker.0 00000100:00100000:0.0:1789117806.952159:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8867a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593219328:12345-0@lo:400:kworker.0 Request processed in 47us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117806.952170:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:0.0:1789117806.952191:0:15326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593218944 00000100:00100000:3.0:1789117806.952193:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117806.952195:0:15326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593218944 00000100:00100000:3.0:1789117806.952211:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593219072:0@lo:400:kworker.0 00000100:00100000:0.0:1789117806.952224:0:15326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593219456 00000100:00100000:0.0:1789117806.952229:0:15326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593219456 00000100:00100000:3.0:1789117806.952239:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117806.952294:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593218560 00000100:00100000:2.0:1789117806.952304:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593218560 00000100:00100000:2.0:1789117806.952325:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789117806.952331:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593218560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117806.952364:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593218560:12345-0@lo:400:kworker.0 Request processed in 34us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117806.952372:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789117806.952401:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593218048 00000100:00100000:2.0:1789117806.952405:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593218048 00000100:00100000:2.0:1789117806.952431:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:2.0:1789117806.952438:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593218048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117806.952468:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593218048:12345-0@lo:400:kworker.0 Request processed in 31us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117806.952487:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00010000:00080000:2.0:1789117806.952535:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f71a40 x1876025593218816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117806.952550:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f71a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593218816:0@lo:400:kworker.0 00010000:00080000:2.0:1789117806.952571:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f72580 x1876025593219328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117806.952580:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f72580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593219328:0@lo:400:kworker.0 00000100:00100000:2.0:1789117806.952591:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593218304:0@lo:400:kworker.0 00000100:00100000:2.0:1789117806.952605:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a886783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593217920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117806.953632:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593218176:0@lo:400:kworker.0 00000100:00100000:1.0:1789117806.953651:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593218688:0@lo:400:kworker.0 00000100:00100000:1.0:1789117806.953711:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117806.953749:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593219200:0@lo:400:kworker.0 00000100:00100000:1.0:1789117806.953774:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117806.953827:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593218688 00000100:00100000:1.0:1789117806.953834:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593218688 00000100:00100000:1.0:1789117806.955041:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593219200 00000100:00100000:1.0:1789117806.955073:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593219200 00000100:00100000:1.0:1789117806.955101:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1789117806.955109:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593218688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117806.955181:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593218688:12345-0@lo:400:kworker.0 Request processed in 73us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117806.955188:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1789117806.955205:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1789117806.955211:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593219200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117806.955239:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593219200:12345-0@lo:400:kworker.0 Request processed in 28us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117806.955245:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1789117806.955291:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593218688:0@lo:400:kworker.0 00000100:00100000:1.0:1789117806.955303:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593219200:0@lo:400:kworker.0 00000100:00080000:1.0:1789117806.955348:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117806.957824:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b989cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593219584:0@lo:400:kworker.0 00000100:00100000:3.0:1789117806.957909:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117806.958516:0:15326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593219072 00000100:00080000:1.0:1789117806.958523:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789117806.958526:0:15326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593219072 00000100:00080000:1.0:1789117806.958533:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789117806.958598:0:15326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789117806.958602:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593218432:0@lo:400:kworker.0 00000100:00100000:0.0:1789117806.958610:0:15326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593218944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117806.958662:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789117806.958670:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593219456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117806.958692:0:15326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593218944:12345-0@lo:400:kworker.0 Request processed in 86us (7052us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117806.958699:0:15326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789117806.958706:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593219456:12345-0@lo:400:kworker.0 Request processed in 38us (7014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117806.958711:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789117806.958716:0:15326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789117806.958722:0:15326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f69680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593219072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117806.958735:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593218944:0@lo:400:kworker.0 00000100:00100000:1.0:1789117806.958747:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b989cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593219456:0@lo:400:kworker.0 00000100:00100000:0.0:1789117806.958749:0:15326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f69680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593219072:12345-0@lo:400:kworker.0 Request processed in 29us (6511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117806.958754:0:15326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789117806.968030:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593218048:0@lo:400:kworker.0 00000100:00100000:3.0:1789117806.968050:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593218560:0@lo:400:kworker.0 00000100:00100000:3.0:1789117806.968096:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593219072:0@lo:400:kworker.0 00000100:00100000:1.0:1789117806.969366:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593219584 00000100:00100000:1.0:1789117806.969378:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593219584 00000100:00080000:2.0:1789117806.969567:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789117806.969696:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789117806.969709:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593219584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117806.969810:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593219584:12345-0@lo:400:kworker.0 Request processed in 103us (11900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117806.969819:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789117806.969902:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1789117806.969908:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff962bc1a49e00, transno 4294967323 00000004:00080000:3.0:1789117806.969926:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1789117806.969969:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b989cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593219584:0@lo:400:kworker.0 00000100:00100000:0.0:1789117807.462301:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593219712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117807.462406:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117807.462743:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593219712 00000100:00100000:3.0:1789117807.462751:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593219712 00000100:00100000:3.0:1789117807.462801:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789117807.462810:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593219712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789117807.462838:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789117807.462894:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593219712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117807.462901:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789117807.463103:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593219712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117807.463619:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789117807.463691:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593219840:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789117807.463734:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117807.463823:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593219840 00000100:00100000:2.0:1789117807.463840:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593219840 00000100:00100000:2.0:1789117807.463916:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789117807.463924:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593219840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789117807.463947:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789117807.463992:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593219840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117807.463999:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789117807.464093:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593219840:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789117807.590400:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117808.492616:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117808.492664:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117808.492701:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117808.492750:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117808.492799:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117808.492836:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117808.492871:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117808.492909:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117808.492946:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572183936 00000100:00100000:0.0:1789117808.492956:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572183936 00000100:00100000:3.0:1789117808.492958:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572183680 00000100:00100000:3.0:1789117808.492973:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572183680 00000100:00100000:0.0:1789117808.493045:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572184448 00000100:00100000:0.0:1789117808.493133:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572184448 00000100:00100000:3.0:1789117808.493143:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 471 00000100:00100000:3.0:1789117808.493159:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2406:x1876025572183680:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117808.493181:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572183808 00000100:00100000:0.0:1789117808.493188:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572183808 00000100:00100000:0.0:1789117808.493219:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572184320 00000100:00100000:0.0:1789117808.493225:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572184320 00000100:00100000:0.0:1789117808.493254:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572184576 00000100:00100000:0.0:1789117808.493260:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572184576 00000100:00100000:0.0:1789117808.493286:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 432 00000100:00100000:0.0:1789117808.493300:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572183936:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117808.493551:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572183936:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 253us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117808.493560:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 432 00000100:00100000:0.0:1789117808.493579:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 433 00000100:00100000:0.0:1789117808.493586:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+5:2406:x1876025572184448:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117808.493613:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+5:2406:x1876025572184448:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 29us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117808.493636:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 433 00000100:00100000:0.0:1789117808.493650:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 434 00000100:00100000:0.0:1789117808.493657:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+19:2406:x1876025572183808:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117808.493691:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+19:2406:x1876025572183808:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 35us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117808.493696:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 434 00000100:00100000:0.0:1789117808.493708:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 435 00000100:00100000:0.0:1789117808.493713:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+5:2406:x1876025572184320:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117808.493735:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+5:2406:x1876025572184320:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 21us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117808.493741:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 435 00000100:00100000:0.0:1789117808.493753:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 255 00000100:00100000:0.0:1789117808.493760:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+18:12412:x1876025572184576:12345-192.168.204.30@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789117808.493858:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+18:12412:x1876025572184576:12345-192.168.204.30@tcp:60:lhsmtool_posix.0 Request processed in 98us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117808.493865:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 255 00000100:00100000:1.0:1789117808.494677:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572184192 00000100:00100000:1.0:1789117808.494687:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572184192 00000100:00100000:1.0:1789117808.494735:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572184064 00000100:00100000:1.0:1789117808.494740:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572184064 00000100:00100000:1.0:1789117808.494777:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 162 00000100:00100000:1.0:1789117808.494786:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2406:x1876025572184192:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117808.494834:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2406:x1876025572184192:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 49us (2132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117808.494839:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 162 00000100:00100000:1.0:1789117808.494854:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 163 00000100:00100000:1.0:1789117808.494859:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572184064:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117808.494881:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572184064:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 22us (2046us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117808.494902:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 163 00000100:00100000:3.0:1789117808.495372:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2406:x1876025572183680:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 2207us (2755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117808.497001:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 471 00000100:00080000:2.0:1789117808.497521:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789117808.497538:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789117808.497548:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789117808.497554:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789117808.506290:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117808.506597:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572184704 00000100:00100000:2.0:1789117808.506610:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572184704 00000100:00100000:2.0:1789117808.506694:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 256 00000100:00100000:2.0:1789117808.506707:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:12412:x1876025572184704:12345-192.168.204.30@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789117808.506856:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:12412:x1876025572184704:12345-192.168.204.30@tcp:60:lhsmtool_posix.0 Request processed in 151us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117808.506866:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 256 00000100:00100000:1.0:1789117808.510755:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117808.510922:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572184960 00000100:00100000:0.0:1789117808.510943:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572184960 00000100:00100000:0.0:1789117808.511025:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 65 00000100:00100000:0.0:1789117808.511038:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+18:12412:x1876025572184960:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789117808.511753:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+19:12412:x1876025572184960:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 716us (1014us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1789117808.511790:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 65 00010000:00010000:1.0:1789117808.619760:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117808.856327:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117808.856477:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572185088 00000100:00100000:2.0:1789117808.856493:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572185088 00000100:00100000:2.0:1789117808.856589:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 257 00000100:00100000:2.0:1789117808.856603:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100c793d-0063-4934-90f0-b04fc41ff903+5:13216:x1876025572185088:12345-192.168.204.30@tcp:101:lsof.0 00010000:00010000:2.0:1789117808.856637:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117808.856666:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be20a83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f1fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117808.856765:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be20a8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117808.856795:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be20a8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117808.856814:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be20a8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117808.857116:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789117808.857125:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789117808.857168:0:6521:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be20a8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117808.857208:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2200/0xaa253ed19be20a83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1fa expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117808.857235:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be20a8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1fa expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117808.857246:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4aeb00) 00010000:00010000:2.0:1789117808.857249:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789117808.857254:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f2a00, rc 0) 00000100:00100000:2.0:1789117808.857461:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100c793d-0063-4934-90f0-b04fc41ff903+6:13216:x1876025572185088:12345-192.168.204.30@tcp:101:lsof.0 Request processed in 858us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117808.857471:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 257 00000040:00080000:0.0:1789117809.383930:0:14501:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789117809.383947:0:14501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789117809.384130:0:14501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1789117809.384140:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789117809.511187:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789117809.511218:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593219968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789117809.511312:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117809.512960:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593219968 00000100:00100000:3.0:1789117809.512983:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593219968 00000100:00100000:3.0:1789117809.513113:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789117809.513125:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593219968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789117809.513175:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789117809.513294:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593219968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 171us (1981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117809.513302:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789117809.514117:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593219968:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1789117809.574309:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789117809.637774:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117810.661440:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117811.558445:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a886783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593220224:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789117811.558676:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117811.558796:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789117811.558805:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b989cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593220096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117811.558924:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593220224 00000100:00100000:1.0:1789117811.558935:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593220224 00000100:00100000:1.0:1789117811.559018:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789117811.559032:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8867a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593220224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789117811.559115:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117811.559189:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8867a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593220224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 160us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117811.559318:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117811.559401:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789117811.559493:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a886783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593220224:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789117811.559887:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789117811.563954:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593220096 00000100:00100000:1.0:1789117811.563979:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593220096 00000100:00100000:1.0:1789117811.564084:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789117811.564098:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8867b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593220096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789117811.564137:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789117811.564292:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8867b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593220096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 197us (4972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117811.564301:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789117811.564418:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b989cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593220096:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789117811.565007:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789117811.565681:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:0.0:1789117811.565696:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1789117811.565737:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1789117811.565751:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1789117811.685984:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117812.069346:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b989cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593220352:0@lo:400:kworker.0 00000100:00100000:1.0:1789117812.069441:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117812.069502:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b989cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593220864:0@lo:400:kworker.0 00000100:00100000:1.0:1789117812.069540:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117812.069567:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593221376:0@lo:400:kworker.0 00000100:00100000:1.0:1789117812.069589:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117812.069608:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a30780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593221888:0@lo:400:kworker.0 00000100:00100000:1.0:1789117812.069640:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117812.069665:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789117812.069672:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b989ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593220480:0@lo:400:kworker.0 00000100:00100000:1.0:1789117812.069697:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117812.069714:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b989cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593220992:0@lo:400:kworker.0 00000100:00100000:2.0:1789117812.069720:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593220352 00000100:00100000:2.0:1789117812.069729:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593220352 00000100:00100000:1.0:1789117812.069739:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117812.069759:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a32d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593221504:0@lo:400:kworker.0 00000100:00100000:2.0:1789117812.069787:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:1.0:1789117812.069787:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117812.069803:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3646:x1876025593220352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117812.069827:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b989cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593220608:0@lo:400:kworker.0 00000100:00100000:1.0:1789117812.069863:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117812.069876:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3646:x1876025593220352:12345-0@lo:400:kworker.0 Request processed in 76us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117812.069885:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:1.0:1789117812.069888:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a33840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593221120:0@lo:400:kworker.0 00000100:00100000:1.0:1789117812.069932:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117812.069936:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593220864 00000100:00100000:2.0:1789117812.069941:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593220864 00000100:00100000:1.0:1789117812.069963:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a32940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593221632:0@lo:400:kworker.0 00000100:00100000:2.0:1789117812.069971:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593220608 00000100:00100000:2.0:1789117812.069976:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593220608 00000100:00100000:1.0:1789117812.069991:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117812.069996:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789117812.070010:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593220864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117812.070014:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789117812.070021:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b989cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593220736:0@lo:400:kworker.0 00000100:00100000:2.0:1789117812.070096:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593220864:12345-0@lo:400:kworker.0 Request processed in 92us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117812.070102:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789117812.070114:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789117812.070120:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593220608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117812.070524:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593222016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117812.072394:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117812.072452:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a32580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593221248:0@lo:400:kworker.0 00000100:00100000:1.0:1789117812.072525:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117812.072552:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593221760:0@lo:400:kworker.0 00000100:00100000:2.0:1789117812.072640:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593220608:12345-0@lo:400:kworker.0 Request processed in 2518us (2775us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117812.072652:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789117812.072720:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593220480 00000100:00100000:2.0:1789117812.072729:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593220480 00000100:00100000:2.0:1789117812.072767:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593220992 00000100:00100000:2.0:1789117812.072770:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593220992 00000100:00100000:2.0:1789117812.072820:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593221504 00000100:00100000:2.0:1789117812.072823:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593221504 00000100:00100000:2.0:1789117812.072842:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593221120 00000100:00100000:2.0:1789117812.072845:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593221120 00000100:00100000:2.0:1789117812.072863:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593221632 00000100:00100000:2.0:1789117812.072866:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593221632 00000100:00100000:2.0:1789117812.072886:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593220736 00000100:00100000:2.0:1789117812.072888:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593220736 00000100:00100000:2.0:1789117812.072905:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1789117812.072915:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593220480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117812.072975:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593220480:12345-0@lo:400:kworker.0 Request processed in 62us (3278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117812.072984:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1789117812.073001:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:2.0:1789117812.073009:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593220992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117812.073043:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593220992:12345-0@lo:400:kworker.0 Request processed in 35us (3303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117812.073050:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:2.0:1789117812.073088:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1789117812.073096:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593221504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117812.073132:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593221504:12345-0@lo:400:kworker.0 Request processed in 37us (3346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117812.073139:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1789117812.073155:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:2.0:1789117812.073163:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593221120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117812.073202:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593221120:12345-0@lo:400:kworker.0 Request processed in 41us (3270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117812.073219:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:2.0:1789117812.073234:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:2.0:1789117812.073242:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593221632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117812.073280:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593221632:12345-0@lo:400:kworker.0 Request processed in 41us (3290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117812.073286:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:2.0:1789117812.073301:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:2.0:1789117812.073309:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593220736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117812.073360:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593220736:12345-0@lo:400:kworker.0 Request processed in 52us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117812.073368:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:2.0:1789117812.073742:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b989ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593220480:0@lo:400:kworker.0 00000100:00100000:2.0:1789117812.073761:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b989cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593220992:0@lo:400:kworker.0 00000100:00100000:2.0:1789117812.073771:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a32d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593221504:0@lo:400:kworker.0 00000100:00100000:2.0:1789117812.073782:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b989cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593220352:0@lo:400:kworker.0 00000100:00100000:2.0:1789117812.073797:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b989cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593220864:0@lo:400:kworker.0 00000100:00100000:1.0:1789117812.074203:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117812.074252:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b989cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593220608:0@lo:400:kworker.0 00010000:00080000:1.0:1789117812.074268:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b98a33840 x1876025593221120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117812.074280:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a33840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593221120:0@lo:400:kworker.0 00010000:00080000:1.0:1789117812.074293:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b98a32940 x1876025593221632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117812.074300:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a32940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593221632:0@lo:400:kworker.0 00000100:00100000:1.0:1789117812.074321:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b989cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593220736:0@lo:400:kworker.0 00000100:00100000:1.0:1789117812.074357:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593221376 00000100:00100000:2.0:1789117812.074358:0:15326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593221888 00000100:00100000:1.0:1789117812.074362:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593221376 00000100:00100000:2.0:1789117812.074365:0:15326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593221888 00000100:00100000:1.0:1789117812.074648:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593221248 00000100:00100000:1.0:1789117812.074653:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593221248 00000100:00100000:0.0:1789117812.075156:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789117812.075202:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789117812.075208:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789117812.075212:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117812.075226:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593222016 00000100:00100000:0.0:1789117812.075230:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593222016 00000100:00100000:0.0:1789117812.075263:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789117812.075273:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593222016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789117812.075321:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789117812.075369:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593222016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117812.075998:0:15326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593221760 00000100:00100000:2.0:1789117812.076008:0:15326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593221760 00000100:00100000:2.0:1789117812.076071:0:15326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789117812.076083:0:15326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593221376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117812.076160:0:15326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593221376:12345-0@lo:400:kworker.0 Request processed in 80us (6568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117812.076184:0:15326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789117812.076204:0:15326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789117812.076212:0:15326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a30f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593221888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117812.076257:0:15326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a30f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593221888:12345-0@lo:400:kworker.0 Request processed in 46us (6616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117812.076264:0:15326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789117812.076282:0:15326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789117812.076290:0:15326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593221760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117812.076611:0:15326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593221760:12345-0@lo:400:kworker.0 Request processed in 50us (2135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117812.076621:0:15326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789117812.076674:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593221376:0@lo:400:kworker.0 00000100:00100000:2.0:1789117812.076686:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a30780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593221888:0@lo:400:kworker.0 00000100:00100000:1.0:1789117812.077358:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789117812.077370:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593221248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117812.077433:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593221248:12345-0@lo:400:kworker.0 Request processed in 67us (4907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117812.077440:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789117812.077516:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a32580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593221248:0@lo:400:kworker.0 00000100:00100000:1.0:1789117812.077528:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593221760:0@lo:400:kworker.0 00000100:00100000:1.0:1789117812.079195:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593222016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117812.079636:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:0.0:1789117812.079672:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:0.0:1789117812.457357:0:15613:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 05:10:11 (1789117811) 00000100:00100000:1.0:1789117812.583303:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a886783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593222144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117812.583421:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117812.583819:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593222144 00000100:00100000:2.0:1789117812.583831:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593222144 00000100:00100000:2.0:1789117812.583913:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789117812.583925:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593222144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789117812.583966:0:8439:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789117812.584026:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593222144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117812.584034:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789117812.584232:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a886783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593222144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117812.584412:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593222272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789117812.584449:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117812.584695:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593222272 00000100:00100000:0.0:1789117812.584711:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593222272 00000100:00100000:0.0:1789117812.584754:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789117812.584763:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593222272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789117812.584778:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789117812.584814:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593222272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117812.584821:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789117812.584976:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593222272:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789117812.714305:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117813.601040:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117813.601126:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117813.601159:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117813.601216:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117813.601240:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117813.601262:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117813.601286:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117813.601321:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572185344 00000100:00100000:2.0:1789117813.601333:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572185344 00000100:00100000:2.0:1789117813.601425:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572185472 00000100:00100000:2.0:1789117813.601430:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572185472 00000100:00100000:2.0:1789117813.601449:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572185856 00000100:00100000:2.0:1789117813.601452:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572185856 00000100:00100000:2.0:1789117813.601475:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572185984 00000100:00100000:2.0:1789117813.601477:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572185984 00000100:00100000:2.0:1789117813.601498:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 442 00000100:00100000:2.0:1789117813.601509:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a886783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+18:2407:x1876025572185344:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117813.601619:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a886783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+18:2407:x1876025572185344:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 111us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117813.601628:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 442 00000100:00100000:2.0:1789117813.601648:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 443 00000100:00100000:2.0:1789117813.601655:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572185472:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117813.601681:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2407:x1876025572185472:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 27us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117813.601688:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 443 00000100:00100000:2.0:1789117813.601700:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 444 00000100:00100000:2.0:1789117813.601706:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100c793d-0063-4934-90f0-b04fc41ff903+6:2406:x1876025572185856:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117813.601731:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100c793d-0063-4934-90f0-b04fc41ff903+6:2406:x1876025572185856:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 26us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117813.601748:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 444 00000100:00100000:2.0:1789117813.601761:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 445 00000100:00100000:2.0:1789117813.601768:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572185984:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117813.601795:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100c793d-0063-4934-90f0-b04fc41ff903+5:2407:x1876025572185984:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 28us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117813.601800:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 445 00000100:00100000:2.0:1789117813.601821:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572185600 00000100:00100000:2.0:1789117813.601825:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572185600 00000100:00100000:1.0:1789117813.601981:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572185728 00000100:00100000:1.0:1789117813.601986:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572185728 00000100:00100000:1.0:1789117813.602024:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 168 00000100:00100000:1.0:1789117813.602031:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a30780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2407:x1876025572185728:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117813.602080:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a30780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2407:x1876025572185728:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 50us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117813.602086:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 168 00000100:00080000:1.0:1789117813.602121:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789117813.602127:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789117813.602129:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117813.602230:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572185216 00000100:00100000:3.0:1789117813.602235:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572185216 00000100:00100000:3.0:1789117813.602282:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 473 00000100:00100000:3.0:1789117813.602289:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2406:x1876025572185216:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117813.602315:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2406:x1876025572185216:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 29us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117813.602321:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 473 00000100:00100000:2.0:1789117813.602587:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 169 00000100:00100000:2.0:1789117813.602595:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a32580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572185600:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117813.602624:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a32580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2406:x1876025572185600:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 31us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117813.602630:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 169 00000100:00080000:1.0:1789117813.611540:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789117813.736854:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117814.629919:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593222400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789117814.630014:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117814.630265:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593222400 00000100:00100000:3.0:1789117814.630274:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593222400 00000100:00100000:3.0:1789117814.630342:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789117814.630354:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593222400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789117814.630401:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789117814.630471:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593222400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117814.630479:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789117814.630632:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593222400:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789117814.759882:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117815.781195:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117816.677679:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117816.677712:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593222528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117816.677814:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117816.678357:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593222528 00000100:00100000:1.0:1789117816.678366:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593222528 00000100:00100000:3.0:1789117816.678372:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789117816.678384:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593222656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789117816.678422:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117816.678432:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593222656 00000100:00100000:1.0:1789117816.678435:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593222656 00000100:00100000:1.0:1789117816.678455:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789117816.678464:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593222528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789117816.678507:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117816.678580:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789117816.678592:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf774f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593222656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789117816.678602:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117816.678636:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf774f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593222656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117816.678643:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:3.0:1789117816.678663:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789117816.678715:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593222656:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789117816.683250:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593222528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4767us (5416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117816.683270:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789117816.683441:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593222528:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789117816.805351:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117816.904313:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117816.904427:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572186240 00000100:00100000:0.0:1789117816.904437:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572186240 00000100:00100000:0.0:1789117816.904529:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 66 00000100:00100000:0.0:1789117816.904543:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+18:13439:x1876025572186240:12345-192.168.204.30@tcp:35:umount.0 00000100:00080000:3.0:1789117816.904635:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117816.911268:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+19:13439:x1876025572186240:12345-192.168.204.30@tcp:35:umount.0 Request processed in 6718us (6953us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1789117816.911299:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 66 00000100:00100000:2.0:1789117816.920371:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117816.920592:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572186496 00000100:00100000:3.0:1789117816.920604:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572186496 00000100:00100000:3.0:1789117816.920674:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00100000:3.0:1789117816.920686:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+19:13439:x1876025572186496:12345-192.168.204.30@tcp:35:umount.0 00000100:00100000:3.0:1789117816.926232:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+20:13439:x1876025572186496:12345-192.168.204.30@tcp:35:umount.0 Request processed in 5529us (5853us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1789117816.926337:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00100000:2.0:1789117816.947045:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117816.947533:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572186752 00000100:00100000:0.0:1789117816.947544:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572186752 00000100:00100000:0.0:1789117816.947630:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 68 00000100:00100000:0.0:1789117816.947641:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962baeaa5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+20:13439:x1876025572186752:12345-192.168.204.30@tcp:35:umount.0 00000100:00100000:0.0:1789117816.948129:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962baeaa5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+21:13439:x1876025572186752:12345-192.168.204.30@tcp:35:umount.0 Request processed in 488us (1097us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789117816.948139:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 68 00000100:00100000:1.0:1789117816.954119:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117816.954233:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572187008 00000100:00100000:3.0:1789117816.954243:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572187008 00000100:00100000:3.0:1789117816.954318:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 69 00000100:00100000:3.0:1789117816.954345:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+21:13439:x1876025572187008:12345-192.168.204.30@tcp:35:umount.0 00000100:00100000:3.0:1789117816.955133:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+22:13439:x1876025572187008:12345-192.168.204.30@tcp:35:umount.0 Request processed in 784us (1017us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1789117816.955144:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 69 00000100:00100000:2.0:1789117816.970807:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117816.970858:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117816.970887:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117816.970926:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117816.970971:0:15326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572187776 00000100:00100000:2.0:1789117816.970982:0:15326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572187776 00000100:00100000:2.0:1789117816.971047:0:15326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 80 00000100:00100000:2.0:1789117816.971084:0:15326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+7:2403:x1876025572187776:12345-192.168.204.30@tcp:9:umount.0 00000020:00000080:2.0:1789117816.971140:0:15326:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1fff5 00000020:00010000:2.0:1789117816.971150:0:15326:0:(genops.c:1921:obd_stale_export_put()) Put export ffff962bc1bc3000: total 0 00000100:00080000:2.0:1789117816.971156:0:15326:0:(import.c:65:import_set_state_nolock()) ffff962bc1bc4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789117816.971207:0:15326:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1789117816.971408:0:15326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2403:x1876025572187776:12345-192.168.204.30@tcp:9:umount.0 Request processed in 350us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117816.971416:0:15326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 80 00000100:00100000:1.0:1789117816.971652:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572187136 00000100:00100000:1.0:1789117816.971657:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572187136 00000100:00100000:1.0:1789117816.971704:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572187392 00000100:00100000:1.0:1789117816.971707:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572187392 00000100:00100000:1.0:1789117816.971732:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572187264 00000100:00100000:1.0:1789117816.971735:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572187264 00000100:00100000:1.0:1789117816.971752:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:1.0:1789117816.971759:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a32d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6b51ebb8-b89b-4376-982e-072902ca33a8+15:2406:x1876025572187136:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117816.971771:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117816.971795:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b89b69c00/0xaa253ed19be1f949 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed31 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117816.971826:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117816.971850:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a32d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6b51ebb8-b89b-4376-982e-072902ca33a8+14:2406:x1876025572187136:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 92us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117816.971858:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:1.0:1789117816.971874:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:1.0:1789117816.971880:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989cc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6b51ebb8-b89b-4376-982e-072902ca33a8+13:2406:x1876025572187392:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117816.971887:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117816.971897:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bbf70c600/0xaa253ed19be1fc7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee26 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117816.971908:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117816.971925:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989cc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6b51ebb8-b89b-4376-982e-072902ca33a8+12:2406:x1876025572187392:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 46us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117816.971939:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:1.0:1789117816.971955:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:1.0:1789117816.971961:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6b51ebb8-b89b-4376-982e-072902ca33a8+11:2406:x1876025572187264:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117816.971968:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117816.971977:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962baea9b200/0xaa253ed19be1f90a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ecf2 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117816.971986:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117816.972005:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2406:x1876025572187264:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 45us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117816.972011:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 23 00000020:00010000:1.0:1789117816.972032:0:9523:0:(genops.c:1907:obd_stale_export_get()) Get export ffff962bc1bc3000: total 0 00010000:00010000:1.0:1789117816.972091:0:9523:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff962bc1bc3000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1789117816.972138:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c253a89f/0xaa253ed19be20a7c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1f3 expref: 4 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117816.972168:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003841785b/0xaa253ed19be203ad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f010 expref: 3 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117816.972185:0:9523:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff962bc1bc3000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1789117816.972199:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117816.972201:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117816.972202:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789117816.972600:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117816.981178:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117816.981373:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572187904 00000100:00100000:1.0:1789117816.981385:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572187904 00000100:00100000:1.0:1789117816.981494:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 81 00000100:00100000:1.0:1789117816.981520:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2403:x1876025572187904:12345-192.168.204.30@tcp:9:umount.0 00000020:00000080:1.0:1789117816.981566:0:8434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1fd7f 00000100:00080000:1.0:1789117816.981577:0:8434:0:(import.c:65:import_set_state_nolock()) ffff962bae85e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789117816.981645:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:0.0:1789117816.982040:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789117816.982135:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789117816.982359:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35e670b1-2cce-4394-8cb4-d5255c6a6a93+2:2403:x1876025572187904:12345-192.168.204.30@tcp:9:umount.0 Request processed in 838us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117816.982369:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 81 00000100:00100000:1.0:1789117816.993708:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117816.994597:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572188928 00000100:00100000:2.0:1789117816.994607:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572188928 00000100:00100000:2.0:1789117816.994662:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 258 00000100:00100000:2.0:1789117816.994671:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+22:2403:x1876025572188928:12345-192.168.204.30@tcp:39:umount.0 00000020:00000080:2.0:1789117816.994703:0:6521:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f918 00000020:00010000:2.0:1789117816.994721:0:6521:0:(genops.c:1921:obd_stale_export_put()) Put export ffff962a87eb6000: total 0 00000100:00080000:2.0:1789117816.994726:0:6521:0:(import.c:65:import_set_state_nolock()) ffff962a87eb1000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789117816.994759:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1789117816.995368:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35e670b1-2cce-4394-8cb4-d5255c6a6a93+21:2403:x1876025572188928:12345-192.168.204.30@tcp:39:umount.0 Request processed in 694us (1668us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1789117816.995378:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 258 00000020:00010000:3.0:1789117816.999090:0:6507:0:(genops.c:1907:obd_stale_export_get()) Get export ffff962a87eb6000: total 0 00010000:00010000:3.0:1789117816.999176:0:6507:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff962a87eb6000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1789117816.999231:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:3.0:1789117816.999236:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789117816.999250:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68c00/0xaa253ed19be2036e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0effb expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117816.999274:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:3.0:1789117816.999276:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789117816.999280:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be2071f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f10c expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117816.999308:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4aeb00) 00010000:00010000:3.0:1789117816.999310:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789117816.999315:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be20416 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f02c expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117816.999328:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:3.0:1789117816.999330:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789117816.999334:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3200/0xaa253ed19be2095d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1a6 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117816.999373:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:3.0:1789117816.999375:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789117816.999379:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be20398 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f009 expref: 16 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117816.999392:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:3.0:1789117816.999395:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789117816.999398:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92600/0xaa253ed19be20050 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ef29 expref: 15 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117816.999412:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff962bbe7ec500) 00010000:00010000:3.0:1789117816.999414:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117816.999417:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be1fcfa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee3b expref: 14 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117816.999436:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff962b84d70400) 00010000:00010000:3.0:1789117816.999438:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789117816.999442:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da800/0xaa253ed19be20432 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f033 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117816.999458:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962b832d0000) 00010000:00010000:3.0:1789117816.999461:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789117816.999465:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b69e00/0xaa253ed19be2028e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0efc3 expref: 12 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117816.999479:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff962b832c8f00) 00010000:00010000:3.0:1789117816.999482:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789117816.999505:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db200/0xaa253ed19be1fcde lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee34 expref: 11 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117816.999522:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:3.0:1789117816.999525:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789117816.999528:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db600/0xaa253ed19be20a3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1de expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117816.999538:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff962b900db900) 00010000:00010000:3.0:1789117816.999540:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789117816.999543:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f3000/0xaa253ed19be20a67 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1ec expref: 9 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117816.999556:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962b832d0c00) 00010000:00010000:3.0:1789117816.999559:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789117816.999562:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b89b68a00/0xaa253ed19be1fd55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee50 expref: 8 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117816.999574:0:6507:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff962a87eb6000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1789117816.999590:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117816.999592:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117816.999594:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117817.022202:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117817.023104:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572189056 00000100:00100000:1.0:1789117817.023118:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572189056 00000100:00100000:1.0:1789117817.023202:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 259 00000100:00100000:1.0:1789117817.023214:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+5:2403:x1876025572189056:12345-192.168.204.30@tcp:39:umount.0 00000020:00000080:1.0:1789117817.023255:0:6519:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f91f 00000100:00080000:1.0:1789117817.023276:0:6519:0:(import.c:65:import_set_state_nolock()) ffff962a87e9f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789117817.023322:0:6519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:0.0:1789117817.023626:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117817.024212:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35e670b1-2cce-4394-8cb4-d5255c6a6a93+3:2403:x1876025572189056:12345-192.168.204.30@tcp:39:umount.0 Request processed in 994us (2017us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789117817.024233:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 259 00000100:00080000:3.0:1789117817.026094:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789117817.189350:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117817.189471:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789117817.189505:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593223168:0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.189578:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117817.189658:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593223040:0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.189688:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117817.189736:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789117817.189742:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593222912:0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.189766:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117817.189799:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593223168 00000100:00100000:3.0:1789117817.189806:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593223168 00000100:00100000:3.0:1789117817.189850:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593222912 00000100:00100000:3.0:1789117817.189853:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593222912 00000100:00100000:3.0:1789117817.189875:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1789117817.189882:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593223168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.189931:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593223168:12345-0@lo:400:kworker.0 Request processed in 49us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117817.189937:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1789117817.189953:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1789117817.189959:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593222912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.189986:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593222912:12345-0@lo:400:kworker.0 Request processed in 27us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117817.189992:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1789117817.190027:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593222912:0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.190085:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593223168:0@lo:400:kworker.0 00000100:00100000:2.0:1789117817.191096:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593223040 00000100:00100000:2.0:1789117817.191104:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593223040 00000100:00100000:2.0:1789117817.191141:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789117817.191149:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593223040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117817.191206:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593223040:12345-0@lo:400:kworker.0 Request processed in 58us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117817.191213:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789117817.191271:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593223040:0@lo:400:kworker.0 00000100:00100000:2.0:1789117817.191339:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593223296:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117817.191372:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117817.191416:0:14928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593223296 00000100:00100000:2.0:1789117817.191420:0:14928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593223296 00000100:00100000:2.0:1789117817.191442:0:14928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789117817.191448:0:14928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593223296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789117817.191474:0:14928:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789117817.191538:0:14928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593223296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117817.191545:0:14928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789117817.191551:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593222784:0@lo:400:kworker.0 00000100:00100000:2.0:1789117817.191580:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593223296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789117817.191597:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117817.191633:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593222784 00000100:00100000:2.0:1789117817.191637:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593222784 00000100:00100000:2.0:1789117817.191668:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:2.0:1789117817.191676:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593222784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117817.191718:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593222784:12345-0@lo:400:kworker.0 Request processed in 44us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117817.191725:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:3.0:1789117817.193583:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593222784:0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.201964:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593223424:0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.202046:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117817.202112:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8867bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593223936:0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.202155:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117817.202176:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593224448:0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.202202:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117817.202241:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789117817.202247:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593223552:0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.202273:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117817.202308:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a75680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593224064:0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.202334:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117817.202372:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593223936 00000100:00100000:3.0:1789117817.202380:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593223936 00000100:00100000:3.0:1789117817.202450:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593224448 00000100:00100000:3.0:1789117817.202454:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593224448 00000100:00100000:3.0:1789117817.202487:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789117817.202497:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593223936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.202559:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593223936:12345-0@lo:400:kworker.0 Request processed in 64us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117817.202567:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789117817.202584:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789117817.202591:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593224448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.202619:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593224448:12345-0@lo:400:kworker.0 Request processed in 29us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117817.202625:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:3.0:1789117817.202651:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789117817.202665:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593223552 00000100:00100000:3.0:1789117817.202668:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593223552 00000100:00100000:3.0:1789117817.202696:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593224064 00000100:00100000:3.0:1789117817.202700:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593224064 00000100:00100000:3.0:1789117817.202736:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1789117817.202743:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593223552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.202776:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593223552:12345-0@lo:400:kworker.0 Request processed in 34us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117817.202782:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1789117817.202795:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:3.0:1789117817.202802:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593224064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.202830:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593224064:12345-0@lo:400:kworker.0 Request processed in 30us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117817.202835:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00080000:3.0:1789117817.202853:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117817.202887:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593223552:0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.202897:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a75680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593224064:0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.202905:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8867bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593223936:0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.202912:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593224448:0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.202943:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593223680:0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.202969:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117817.202986:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593224192:0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.203006:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117817.203025:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789117817.203031:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593223808:0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.203081:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117817.203099:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593224320:0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.203130:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117817.203154:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593223808 00000100:00100000:3.0:1789117817.203158:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593223808 00000100:00100000:3.0:1789117817.203179:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593224320 00000100:00100000:3.0:1789117817.203181:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593224320 00000100:00100000:3.0:1789117817.203200:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789117817.203205:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9277e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593223808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.203239:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9277e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593223808:12345-0@lo:400:kworker.0 Request processed in 33us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117817.203244:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789117817.203256:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789117817.203261:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0719e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593224320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.203306:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0719e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593224320:12345-0@lo:400:kworker.0 Request processed in 44us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117817.203314:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:3.0:1789117817.203331:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789117817.203338:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593223680 00000100:00100000:3.0:1789117817.203341:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593223680 00000100:00100000:3.0:1789117817.203364:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593224192 00000100:00100000:3.0:1789117817.203367:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593224192 00000100:00100000:3.0:1789117817.203383:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1789117817.203388:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8867bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593223680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.203418:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8867bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593223680:12345-0@lo:400:kworker.0 Request processed in 29us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117817.203423:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1789117817.203434:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1789117817.203440:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593224192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.203477:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593224192:12345-0@lo:400:kworker.0 Request processed in 37us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117817.203483:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00080000:3.0:1789117817.203500:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789117817.203522:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593223808:0@lo:400:kworker.0 00000100:00100000:3.0:1789117817.203531:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593224320:0@lo:400:kworker.0 00010000:00080000:3.0:1789117817.203541:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a4e580 x1876025593223680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117817.203551:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593223680:0@lo:400:kworker.0 00010000:00080000:3.0:1789117817.203561:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a743c0 x1876025593224192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117817.203569:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593224192:0@lo:400:kworker.0 00000100:00100000:1.0:1789117817.204199:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593223424 00000100:00100000:1.0:1789117817.204206:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593223424 00000100:00100000:1.0:1789117817.204252:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789117817.204259:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593223424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117817.204314:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593223424:12345-0@lo:400:kworker.0 Request processed in 56us (2268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117817.204320:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789117817.205967:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593223424:0@lo:400:kworker.0 00000100:00100000:2.0:1789117817.701565:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789117817.701592:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593224576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789117817.701676:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117817.701820:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b989cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593224704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117817.701848:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117817.707146:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593224576 00000100:00100000:3.0:1789117817.707162:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593224576 00000100:00100000:3.0:1789117817.707234:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593224704 00000100:00100000:3.0:1789117817.707238:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593224704 00000100:00100000:3.0:1789117817.707260:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789117817.707269:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593224576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789117817.707328:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789117817.707470:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593224576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 202us (5794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117817.707479:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789117817.707499:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789117817.707523:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593224704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789117817.707533:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789117817.707563:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593224704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (5714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117817.707569:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789117817.710396:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593224576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789117817.710418:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b989cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593224704:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789117817.829518:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117818.618607:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117818.618699:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117818.618815:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572189184 00000100:00100000:0.0:1789117818.618827:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572189184 00000100:00100000:0.0:1789117818.618899:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572189312 00000100:00100000:0.0:1789117818.618903:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572189312 00000100:00100000:0.0:1789117818.618939:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:0.0:1789117818.618950:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6b51ebb8-b89b-4376-982e-072902ca33a8+11:2404:x1876025572189184:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117818.618973:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117818.618996:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b89b68600/0xaa253ed19be1fa1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed46 expref: 11 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117818.619015:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117818.619131:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6b51ebb8-b89b-4376-982e-072902ca33a8+10:2404:x1876025572189184:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 183us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117818.619139:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:0.0:1789117818.619158:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:0.0:1789117818.619165:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6b51ebb8-b89b-4376-982e-072902ca33a8+9:2404:x1876025572189312:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117818.619174:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117818.619184:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bbf70cc00/0xaa253ed19be1fa22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed77 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117818.619198:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117818.619216:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6b51ebb8-b89b-4376-982e-072902ca33a8+8:2404:x1876025572189312:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 51us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117818.619232:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:3.0:1789117818.619590:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117818.619804:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572189440 00000100:00100000:3.0:1789117818.619810:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572189440 00000100:00100000:3.0:1789117818.619845:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:3.0:1789117818.619852:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6b51ebb8-b89b-4376-982e-072902ca33a8+8:2407:x1876025572189440:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117818.619861:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117818.619871:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bbf70de00/0xaa253ed19be1fc75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ee1f expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117818.619882:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117818.619908:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6b51ebb8-b89b-4376-982e-072902ca33a8+7:2407:x1876025572189440:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 57us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117818.619915:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:3.0:1789117818.630992:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117818.631111:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572189696 00000100:00100000:0.0:1789117818.631122:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572189696 00000100:00100000:0.0:1789117818.631210:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 260 00000100:00100000:0.0:1789117818.631224:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+6:2403:x1876025572189696:12345-192.168.204.30@tcp:39:umount.0 00000020:00000080:0.0:1789117818.631307:0:6520:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1fa30 00000020:00010000:0.0:1789117818.631316:0:6520:0:(genops.c:1921:obd_stale_export_put()) Put export ffff962a87eb5000: total 0 00000100:00080000:0.0:1789117818.631322:0:6520:0:(import.c:65:import_set_state_nolock()) ffff962a87eb0800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789117818.631343:0:6520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:0.0:1789117818.631502:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:100c793d-0063-4934-90f0-b04fc41ff903+5:2403:x1876025572189696:12345-192.168.204.30@tcp:39:umount.0 Request processed in 283us (519us total) trans 4294967529 rc 0/0 00000100:00100000:0.0:1789117818.631510:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 260 00000100:00080000:3.0:1789117818.631607:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1789117818.631616:0:6507:0:(genops.c:1907:obd_stale_export_get()) Get export ffff962a87eb5000: total 0 00010000:00010000:3.0:1789117818.631620:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117818.631671:0:6507:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff962a87eb5000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789117818.631702:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4aeb00) 00010000:00010000:3.0:1789117818.631705:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789117818.631713:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f2a00/0xaa253ed19be20a8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f1fa expref: 4 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117818.631749:0:6507:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff962a87eb5000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789117818.631760:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117818.631762:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117818.631764:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117818.647589:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117818.647697:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572189824 00000100:00100000:3.0:1789117818.647709:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572189824 00000100:00100000:3.0:1789117818.647882:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 261 00000100:00100000:3.0:1789117818.647898:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100c793d-0063-4934-90f0-b04fc41ff903+5:2403:x1876025572189824:12345-192.168.204.30@tcp:39:umount.0 00000020:00000080:3.0:1789117818.647967:0:6521:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1fa37 00000100:00080000:3.0:1789117818.647982:0:6521:0:(import.c:65:import_set_state_nolock()) ffff962a87eb3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789117818.648025:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789117818.648273:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:100c793d-0063-4934-90f0-b04fc41ff903+3:2403:x1876025572189824:12345-192.168.204.30@tcp:39:umount.0 Request processed in 381us (701us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789117818.648283:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 261 00000100:00080000:0.0:1789117818.648497:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789117818.649209:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117818.669995:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117818.670097:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572190080 00000100:00100000:3.0:1789117818.670107:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572190080 00000100:00100000:3.0:1789117818.670163:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 475 00000100:00100000:3.0:1789117818.670172:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+7:2403:x1876025572190080:12345-192.168.204.30@tcp:251:umount.0 00000020:00000080:3.0:1789117818.670214:0:9525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f8f5 00000020:00010000:3.0:1789117818.670220:0:9525:0:(genops.c:1921:obd_stale_export_put()) Put export ffff962bc1aee000: total 0 00000100:00080000:3.0:1789117818.670225:0:9525:0:(import.c:65:import_set_state_nolock()) ffff962bc1aef800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789117818.670316:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6b51ebb8-b89b-4376-982e-072902ca33a8+3:2403:x1876025572190080:12345-192.168.204.30@tcp:251:umount.0 Request processed in 144us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117818.670324:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 475 00000020:00010000:0.0:1789117818.670574:0:6508:0:(genops.c:1907:obd_stale_export_get()) Get export ffff962bc1aee000: total 0 00010000:00010000:0.0:1789117818.670623:0:6508:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff962bc1aee000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789117818.670653:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bbf70c000/0xaa253ed19be1f950 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0ed38 expref: 2 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117818.670669:0:6508:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff962bc1aee000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1789117818.670677:0:6508:0:(genops.c:885:class_export_put()) final put ffff962bc1aee000/6b51ebb8-b89b-4376-982e-072902ca33a8 00010000:00010000:0.0:1789117818.670695:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117818.670698:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117818.670700:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789117818.670734:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bc1aee000/6b51ebb8-b89b-4376-982e-072902ca33a8 for MGS 00000020:00000080:2.0:1789117818.670770:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bc1aef800 for MGS 00010000:00010000:3.0:1789117818.853338:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789117819.621419:0:14501:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789117819.621436:0:14501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789117819.621536:0:14501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1789117819.621543:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789117819.749956:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789117819.749988:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0718780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593224832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789117819.750093:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117819.752545:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593224832 00000100:00100000:3.0:1789117819.752565:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593224832 00000100:00100000:3.0:1789117819.752638:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789117819.752651:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0719680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593224832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789117819.752705:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789117819.755311:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0719680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593224832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2641us (5195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117819.755324:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789117819.756916:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0718780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593224832:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1789117819.813700:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789117819.880599:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789117820.662595:0:15808:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1789117820.677244:0:15808:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1789117820.677319:0:15808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be1f9ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f9b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117820.677336:0:15808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be1f9ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f9b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117820.677343:0:15808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be1f9ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1f9b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117820.677351:0:15808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be1f9ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1f9b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117820.677378:0:15808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789117820.677384:0:15808:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789117820.677415:0:15808:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789117820.677420:0:15808:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789117820.677427:0:15808:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789117820.677469:0:15808:0:(import.c:65:import_set_state_nolock()) ffff962bbcf26000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1789117820.677627:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117820.677636:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be1f9ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1f9b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.677654:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9a000 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117820.677658:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be1f9ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1f9b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.677667:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be1f9ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be1f9b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117820.677687:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be1f9ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be1f9b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117820.677694:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789117820.677696:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789117820.677699:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789117820.677732:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be1f9ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1f9b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.677738:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117820.677767:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be1f9ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1f9b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.677775:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be1f9ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1f9b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.677788:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117820.677789:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117820.677791:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117820.677802:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789117820.677831:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593225088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117820.678092:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117820.678717:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593225088 00000100:00100000:0.0:1789117820.678736:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593225088 00000100:00100000:3.0:1789117820.678779:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876025593224960:0@lo:39:umount.0 00000100:00100000:0.0:1789117820.678807:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789117820.678817:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae57d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3644:x1876025593225088:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789117820.678827:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789117820.678834:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117820.678853:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b89b68800/0xaa253ed19be1f9b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be1f9ab expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.678868:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117820.678869:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593224960 00000100:00100000:3.0:1789117820.678872:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593224960 00000100:00100000:3.0:1789117820.678909:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789117820.678917:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876025593224960:12345-0@lo:39:umount.0 00000100:00100000:0.0:1789117820.678922:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae57d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7945443b-b7e4-4157-aee9-c9b2172613e6+23:3644:x1876025593225088:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117820.678929:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000020:00000080:3.0:1789117820.678943:0:14247:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f50c 00000100:00080000:3.0:1789117820.678953:0:14247:0:(import.c:65:import_set_state_nolock()) ffff962bbd04e000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789117820.678998:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593225088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789117820.679576:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3643:x1876025593224960:12345-0@lo:39:umount.0 Request processed in 657us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117820.679583:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1789117820.679593:0:14247:0:(genops.c:885:class_export_put()) final put ffff962bbd048000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1789117820.679672:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789117820.679694:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbcf26000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789117820.679708:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876025593224960:0@lo:39:umount.0 00000100:00080000:0.0:1789117820.683199:0:15808:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789117820.683209:0:15808:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789117820.683229:0:15808:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789117820.684406:0:15808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b89b68400/0xaa253ed19be1f9b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f9c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.684421:0:15808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b89b68400/0xaa253ed19be1f9b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f9c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.684429:0:15808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b89b68400/0xaa253ed19be1f9b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1f9c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.684436:0:15808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962b89b68400/0xaa253ed19be1f9b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1f9c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.684481:0:15808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789117820.684497:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117820.684503:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b89b68400/0xaa253ed19be1f9b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1f9c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.684510:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b89b68400 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117820.684513:0:9523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b89b68400/0xaa253ed19be1f9b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1f9c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.684521:0:9523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b89b68400/0xaa253ed19be1f9b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be1f9c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117820.684529:0:9523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b89b68400/0xaa253ed19be1f9b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be1f9c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117820.684535:0:9523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789117820.684537:0:9523:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1789117820.687923:0:9523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b89b68400/0xaa253ed19be1f9b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1f9c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.687937:0:9523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117820.687973:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b89b68400/0xaa253ed19be1f9b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1f9c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117820.687979:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1789117820.687981:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b89b68400/0xaa253ed19be1f9b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1f9c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117820.688003:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593225216:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789117820.688009:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117820.688011:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117820.688019:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117820.688044:0:15808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b80030800/0xaa253ed19be1f8af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f8b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.688066:0:15808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b80030800/0xaa253ed19be1f8af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f8b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.688074:0:15808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b80030800/0xaa253ed19be1f8af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1f8b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.688080:0:15808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962b80030800/0xaa253ed19be1f8af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1f8b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.688098:0:15808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789117820.688106:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789117820.688108:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789117820.688113:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b80030800/0xaa253ed19be1f8af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1f8b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.688121:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b80030800 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117820.688125:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b80030800/0xaa253ed19be1f8af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1f8b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.688132:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b80030800/0xaa253ed19be1f8af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be1f8b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117820.688139:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b80030800/0xaa253ed19be1f8af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be1f8b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117820.688144:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789117820.688147:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789117820.688149:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789117820.688174:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b80030800/0xaa253ed19be1f8af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1f8b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.688179:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117820.688196:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b80030800/0xaa253ed19be1f8af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1f8b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117820.688202:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593225344:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789117820.688203:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b80030800/0xaa253ed19be1f8af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1f8b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.688212:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117820.688226:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117820.688228:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117820.688239:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789117820.688240:0:15808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d93a00/0xaa253ed19be1fcad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fcb4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.688247:0:15808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d93a00/0xaa253ed19be1fcad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1fcb4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.688254:0:15808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d93a00/0xaa253ed19be1fcad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1fcb4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.688260:0:15808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962a87d93a00/0xaa253ed19be1fcad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1fcb4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.688273:0:15808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789117820.688276:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593225216 00010000:00010000:0.0:1789117820.688279:0:15808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be1f46b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f472 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117820.688284:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593225216 00010000:00010000:0.0:1789117820.688286:0:15808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be1f46b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f472 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.688300:0:15808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be1f46b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1f472 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.688306:0:15808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be1f46b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1f472 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.688319:0:15808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789117820.688323:0:15808:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1789117820.688326:0:15808:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:3.0:1789117820.688347:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593225344 00000100:00100000:3.0:1789117820.688350:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593225344 00010000:00010000:0.0:1789117820.688371:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1789117820.688373:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1789117820.688375:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962a87d93a00/0xaa253ed19be1fcad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1fcb4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.688381:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93a00 already unused, calling callback (ffffffffc13d9c20) 00000100:00100000:3.0:1789117820.688382:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+24:3647:x1876025593225216:12345-0@lo:103:ldlm_bl.0 10000000:00010000:0.0:1789117820.688384:0:9523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962a87d93a00/0xaa253ed19be1fcad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1fcb4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.688391:0:9523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962a87d93a00/0xaa253ed19be1fcad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be1fcb4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117820.688397:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:00010000:0.0:1789117820.688397:0:9523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962a87d93a00/0xaa253ed19be1fcad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be1fcb4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117820.688403:0:9523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789117820.688405:0:9523:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789117820.688406:0:9523:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789117820.688417:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b89b68e00/0xaa253ed19be1f9c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be1f9b9 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.688418:0:9523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962a87d93a00/0xaa253ed19be1fcad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1fcb4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.688424:0:9523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789117820.688431:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117820.688445:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962a87d93a00/0xaa253ed19be1fcad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1fcb4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.688452:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962a87d93a00/0xaa253ed19be1fcad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1fcb4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.688461:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789117820.688464:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+23:3647:x1876025593225216:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (356us total) trans 0 rc 0/0 00010000:00010000:0.0:1789117820.688464:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be1f46b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1f472 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.688471:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9ae00 already unused, calling callback (ffffffffc13d9c20) 00000100:00100000:3.0:1789117820.688473:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 10000000:00010000:0.0:1789117820.688474:0:9523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be1f46b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1f472 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.688480:0:9523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be1f46b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be1f472 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117820.688487:0:9523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be1f46b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be1f472 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117820.688490:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 10000000:01000000:0.0:1789117820.688493:0:9523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789117820.688495:0:9523:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00000100:00100000:3.0:1789117820.688497:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0718b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+22:3647:x1876025593225344:12345-0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1789117820.688497:0:9523:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789117820.688504:0:7470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117820.688507:0:9523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be1f46b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1f472 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117820.688512:0:7470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b80031000/0xaa253ed19be1f8b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be1f8af expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117820.688513:0:9523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117820.688519:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be1f46b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1f472 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117820.688521:0:7470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117820.688526:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be1f46b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1f472 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117820.688539:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0718b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7945443b-b7e4-4157-aee9-c9b2172613e6+21:3647:x1876025593225344:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (299us total) trans 0 rc 0/0 00010000:00010000:0.0:1789117820.688543:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117820.688553:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1789117820.688571:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117820.688605:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593225344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789117820.688615:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593225216:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1789117820.689628:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbd048000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:1.0:1789117820.689689:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593225600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117820.689743:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117820.689775:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789117820.689781:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593225472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117820.689815:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117820.689854:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593225600 00000100:00100000:1.0:1789117820.689861:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593225600 00000100:00100000:1.0:1789117820.689914:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593225472 00000100:00100000:1.0:1789117820.689917:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593225472 00000100:00100000:1.0:1789117820.689941:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789117820.689949:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a76580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7945443b-b7e4-4157-aee9-c9b2172613e6+22:3645:x1876025593225600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789117820.689961:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117820.689976:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813da000/0xaa253ed19be1f472 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be1f46b expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117820.689993:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117820.690025:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a76580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7945443b-b7e4-4157-aee9-c9b2172613e6+21:3645:x1876025593225600:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117820.690031:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789117820.690047:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789117820.690080:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7945443b-b7e4-4157-aee9-c9b2172613e6+20:3645:x1876025593225472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789117820.690088:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117820.690097:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d92800/0xaa253ed19be1fcb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be1fcad expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117820.690104:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117820.690125:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7945443b-b7e4-4157-aee9-c9b2172613e6+19:3645:x1876025593225472:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117820.690131:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789117820.690183:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593225472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117820.690192:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593225600:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1789117820.690271:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bbd04e000 for lustre-MDT0000 00000020:01000004:1.0:1789117820.691614:0:15808:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1789117820.691622:0:15808:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1789117820.691628:0:15808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789117820.691635:0:15808:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1789117820.691643:0:15808:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff962a87891000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789117820.691651:0:15808:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff962bbd042000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789117820.691655:0:15808:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff962bbd044800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789117820.691661:0:15808:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff962bbf4b9800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1789117820.691669:0:15808:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff962a87eb5000 100c793d-0063-4934-90f0-b04fc41ff903 192.168.204.30@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789117820.691674:0:15808:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff962a87eb6000 35e670b1-2cce-4394-8cb4-d5255c6a6a93 192.168.204.30@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967523 stale:0 00000020:00080000:1.0:1789117820.691680:0:15808:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff962b8e9c8000) has exports, disconnecting them 00000020:00080000:1.0:1789117820.691685:0:15808:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff962a87891000), last request at 1789117817 00000020:00000080:1.0:1789117820.691692:0:15808:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f81c 00000100:00080000:1.0:1789117820.691711:0:15808:0:(import.c:65:import_set_state_nolock()) ffff962a87896000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789117820.691776:0:15808:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962a87891000): rc 0 00000020:00000080:1.0:1789117820.691778:0:15808:0:(genops.c:885:class_export_put()) final put ffff962a87891000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1789117820.691789:0:15808:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff962bbd042000), last request at 1789117817 00000020:00000080:1.0:1789117820.691792:0:15808:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f6f6 00000100:00080000:1.0:1789117820.691801:0:15808:0:(import.c:65:import_set_state_nolock()) ffff962bbd042800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789117820.691821:0:15808:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962bbd042000): rc 0 00000020:00000080:1.0:1789117820.691823:0:15808:0:(genops.c:885:class_export_put()) final put ffff962bbd042000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1789117820.691829:0:15808:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff962bbd044800), last request at 1789117535 00000020:00000080:1.0:1789117820.691833:0:15808:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f5f3 00000100:00080000:1.0:1789117820.691837:0:15808:0:(import.c:65:import_set_state_nolock()) ffff962bbd044000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789117820.691844:0:15808:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962bbd044800): rc 0 00000020:00000080:1.0:1789117820.691860:0:15808:0:(genops.c:885:class_export_put()) final put ffff962bbd044800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1789117820.691867:0:15808:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff962bbf4b9800), last request at 1789117535 00000020:00000080:1.0:1789117820.691872:0:15808:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f5c2 00000100:00080000:1.0:1789117820.691877:0:15808:0:(import.c:65:import_set_state_nolock()) ffff962bbf4ba000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789117820.691885:0:15808:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000020:00000080:2.0:1789117820.691914:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962a87891000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1789117820.691965:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbd042000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00080000:1.0:1789117820.691968:0:15808:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962bbf4b9800): rc 0 00000004:00000080:1.0:1789117820.691977:0:15808:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbc5cc831bae0 00000020:00000080:2.0:1789117820.691987:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbd044800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1789117820.692004:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a87896000 for lustre-MDT0000 00000020:00000080:2.0:1789117820.692008:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bbd042800 for lustre-MDT0000 00000100:00080000:1.0:1789117820.692009:0:15808:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000020:00000080:2.0:1789117820.692012:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bbd044000 for lustre-MDT0000 00000100:00100000:1.0:1789117820.692014:0:15808:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:0.0:1789117820.692232:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117820.692243:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117820.692245:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789117820.692899:0:15808:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789117820.692928:0:15808:0:(import.c:65:import_set_state_nolock()) ffff962bbf6a6000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789117820.693713:0:15808:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789117820.693718:0:15808:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1789117820.693740:0:15808:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789117820.693807:0:15808:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789117820.693824:0:15808:0:(import.c:65:import_set_state_nolock()) ffff962bbf8f5800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789117820.693833:0:15808:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789117820.693835:0:15808:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1789117820.693844:0:15808:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789117820.693900:0:15808:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789117820.693908:0:15808:0:(import.c:65:import_set_state_nolock()) ffff962a87e9a000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1789117820.693937:0:15808:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff962b8e9c8000) has no exports 00000100:00100000:0.0:1789117820.695098:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593225728:0@lo:39:umount.0 00000100:00100000:0.0:1789117820.695181:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117820.695233:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593225856:0@lo:9:umount.0 00000100:00100000:0.0:1789117820.695259:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117820.695282:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593225984:0@lo:9:umount.0 00000100:00100000:0.0:1789117820.695302:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117820.695729:0:14928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593225728 00000100:00100000:1.0:1789117820.695740:0:14928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593225728 00000100:00100000:1.0:1789117820.695797:0:14928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789117820.695807:0:14928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876025593225728:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789117820.695844:0:14928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f64e 00000100:00080000:1.0:1789117820.695853:0:14928:0:(import.c:65:import_set_state_nolock()) ffff962bbcfef000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789117820.695891:0:14928:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1789117820.696853:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117820.696872:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593225856 00000100:00100000:3.0:1789117820.696879:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593225856 00000100:00100000:3.0:1789117820.696954:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593225984 00000100:00100000:3.0:1789117820.696958:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593225984 00000100:00100000:3.0:1789117820.696981:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789117820.697653:0:14928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3643:x1876025593225728:12345-0@lo:39:umount.0 Request processed in 1844us (2468us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789117820.697663:0:14928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00010000:00010000:1.0:1789117820.697706:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117820.697818:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876025593225856:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789117820.697849:0:8434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f79e 00000100:00080000:3.0:1789117820.697861:0:8434:0:(import.c:65:import_set_state_nolock()) ffff962bc1a2e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789117820.697913:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00080000:2.0:1789117820.698311:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbf6a6000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789117820.698321:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593225728:0@lo:39:umount.0 00010000:00010000:1.0:1789117820.700126:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117820.700268:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3643:x1876025593225856:12345-0@lo:9:umount.0 Request processed in 3272us (4999us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117820.700283:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789117820.700324:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789117820.700341:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876025593225984:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789117820.700374:0:8434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f8e0 00000100:00080000:3.0:1789117820.700385:0:8434:0:(import.c:65:import_set_state_nolock()) ffff962a87eb0000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789117820.700447:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00010000:00010000:1.0:1789117820.701144:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789117820.701484:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbf8f5800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789117820.701508:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789117820.701511:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789117820.701517:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593225856:0@lo:9:umount.0 00000100:00100000:3.0:1789117820.701926:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3643:x1876025593225984:12345-0@lo:9:umount.0 Request processed in 1592us (6620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117820.701935:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1789117820.702392:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789117820.702416:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789117820.709937:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a87e9a000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789117820.709972:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789117820.709974:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789117820.709983:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593225984:0@lo:9:umount.0 00000020:00080000:2.0:1789117820.722658:0:15808:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff962b8e9c8000) has no exports 00000020:00000080:2.0:1789117820.787080:0:15808:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f4c6 00000020:00000080:2.0:1789117820.787096:0:15808:0:(genops.c:885:class_export_put()) final put ffff962b8e275000/lustre-QMT0000_UUID 00000020:01000000:2.0:1789117820.787117:0:15808:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1789117820.787255:0:15808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789117820.787267:0:15808:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789117820.787272:0:15808:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff962bbcddced8) has no exports 00000020:00000080:1.0:1789117820.787420:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962b8e275000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789117820.790506:0:15808:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f4bf 00000020:00000080:2.0:1789117820.790522:0:15808:0:(genops.c:885:class_export_put()) final put ffff962bbce12000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789117820.790611:0:15808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789117820.790623:0:15808:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789117820.790626:0:15808:0:(genops.c:885:class_export_put()) final put ffff962b87282000/lustre-QMT0000_UUID 00000020:00000080:2.0:1789117820.790629:0:15808:0:(genops.c:844:class_export_destroy()) destroying export ffff962b87282000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789117820.790635:0:15808:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1789117820.790895:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbce12000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1789117820.901357:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117821.797472:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0718f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593226112:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789117821.797551:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117821.798929:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593226112 00000100:00100000:3.0:1789117821.798942:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593226112 00000100:00100000:3.0:1789117821.799222:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789117821.799235:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593226112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789117821.799268:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789117821.799358:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593226112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (1807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117821.799365:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789117821.799462:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0718f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593226112:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789117821.800225:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789117821.926393:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117822.309594:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593226240:0@lo:400:kworker.0 00000100:00100000:1.0:1789117822.309692:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117822.309771:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876025593226752:0@lo:400:kworker.0 00000100:00100000:1.0:1789117822.309805:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117822.309836:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789117822.309842:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593226624:0@lo:400:kworker.0 00000100:00100000:1.0:1789117822.309866:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117822.309886:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593227136:0@lo:400:kworker.0 00000100:00100000:1.0:1789117822.309914:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117822.309967:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593226752 00000100:00100000:1.0:1789117822.309974:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593226752 00000100:00100000:1.0:1789117822.310039:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593226624 00000100:00100000:1.0:1789117822.310042:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593226624 00000100:00100000:1.0:1789117822.310100:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1789117822.310109:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876025593226752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117822.310181:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876025593226752:12345-0@lo:400:kworker.0 Request processed in 73us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117822.310201:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1789117822.310222:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789117822.310227:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1876025593226624:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789117822.310232:0:9533:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789117822.310256:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1876025593226624:12345-0@lo:400:kworker.0 Request processed in 28us (389us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789117822.310261:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789117822.310294:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593226496:0@lo:400:kworker.0 00000100:00100000:1.0:1789117822.310318:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117822.310332:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593227008:0@lo:400:kworker.0 00000100:00100000:1.0:1789117822.310349:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117822.310364:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789117822.310368:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593226368:0@lo:400:kworker.0 00000100:00100000:1.0:1789117822.310388:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117822.310401:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593226880:0@lo:400:kworker.0 00000100:00100000:1.0:1789117822.310419:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117822.310439:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593226496 00000100:00100000:1.0:1789117822.310443:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593226496 00000100:00100000:1.0:1789117822.310460:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593227008 00000100:00100000:1.0:1789117822.310463:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593227008 00000100:00100000:1.0:1789117822.310480:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593226880 00000100:00100000:1.0:1789117822.310483:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593226880 00000100:00100000:1.0:1789117822.310492:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:1.0:1789117822.310498:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593227008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117822.310534:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593227008:12345-0@lo:400:kworker.0 Request processed in 35us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117822.310546:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:1.0:1789117822.310559:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789117822.310563:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1876025593226496:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789117822.310568:0:6521:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789117822.310592:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1876025593226496:12345-0@lo:400:kworker.0 Request processed in 27us (273us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789117822.310598:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789117822.310608:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789117822.310612:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1876025593226880:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789117822.310616:0:6521:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789117822.310635:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1876025593226880:12345-0@lo:400:kworker.0 Request processed in 22us (215us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789117822.310641:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:1.0:1789117822.310658:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789117822.310683:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789117822.310689:0:3645:0:(import.c:65:import_set_state_nolock()) ffff962bbf941000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789117822.310692:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1789117822.311411:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593226368 00000100:00100000:3.0:1789117822.311419:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593226368 00000100:00100000:3.0:1789117822.311468:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789117822.311474:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1876025593226368:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789117822.311480:0:6525:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789117822.311523:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1876025593226368:12345-0@lo:400:kworker.0 Request processed in 49us (1134us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789117822.311529:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00080000:3.0:1789117822.311588:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789117822.311592:0:3647:0:(import.c:65:import_set_state_nolock()) ffff962a86831000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789117822.311596:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789117822.311601:0:3647:0:(import.c:65:import_set_state_nolock()) ffff962a86831000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789117822.311605:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 212 00000100:00080000:3.0:1789117822.311611:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff962a86831000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789117822.311641:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962ba071a580 x1876025593227264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789117822.311673:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593226624:0@lo:400:kworker.0 00010000:00080000:3.0:1789117822.311690:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f73840 x1876025593226752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117822.311701:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876025593226752:0@lo:400:kworker.0 00000100:00100000:0.0:1789117822.311948:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789117822.311967:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593227392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117822.312008:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117822.312044:0:14928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593227392 00000100:00100000:0.0:1789117822.312047:0:14928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593227392 00000100:00100000:0.0:1789117822.312111:0:14928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789117822.312117:0:14928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf6fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1876025593227392:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1789117822.312122:0:14928:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789117822.312152:0:14928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf6fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1876025593227392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 34us (144us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789117822.312158:0:14928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:02020000:0.0:1789117822.312197:0:3646:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:2.0:1789117822.312273:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593226240 00000100:00100000:2.0:1789117822.312278:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593226240 00000100:00100000:2.0:1789117822.312317:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:2.0:1789117822.312323:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b86216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+19:3647:x1876025593226240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117822.312361:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b86216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7945443b-b7e4-4157-aee9-c9b2172613e6+19:3647:x1876025593226240:12345-0@lo:400:kworker.0 Request processed in 39us (2672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117822.312366:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:2.0:1789117822.312391:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593227136 00000100:00100000:2.0:1789117822.312394:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593227136 00000100:00100000:2.0:1789117822.312430:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789117822.312437:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593227136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117822.312472:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593227136:12345-0@lo:400:kworker.0 Request processed in 37us (2557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117822.312478:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789117822.312502:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876025593227264:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1789117822.312530:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789117822.312568:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117822.312579:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593227264 00000100:00100000:2.0:1789117822.312583:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593227264 00000100:00100000:2.0:1789117822.312602:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789117822.312607:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876025593227264:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1789117822.312622:0:6521:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789117822.312658:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876025593227264:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 50us (127us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789117822.312664:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:2.0:1789117822.312690:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a86831000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789117822.312695:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789117822.312708:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876025593227264:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1789117822.315655:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593227136:0@lo:400:kworker.0 00000100:00100000:3.0:1789117822.315672:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593226240:0@lo:400:kworker.0 00000100:00080000:0.0:1789117822.350875:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789117822.350905:0:3646:0:(import.c:65:import_set_state_nolock()) ffff962bbf321000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789117822.350911:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789117822.350919:0:3646:0:(import.c:65:import_set_state_nolock()) ffff962bbf321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789117822.350923:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 187 00000100:00080000:0.0:1789117822.350933:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff962bbf321000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1789117822.350984:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbf6ffc00 x1876025593227520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789117822.351449:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593227520:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789117822.351542:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117822.351775:0:14928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593227520 00000100:00100000:3.0:1789117822.351785:0:14928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593227520 00000100:00100000:3.0:1789117822.351835:0:14928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789117822.351845:0:14928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1876025593227520:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1789117822.351866:0:14928:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789117822.351922:0:14928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1876025593227520:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 78us (379us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789117822.351931:0:14928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:2.0:1789117822.352336:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbf321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789117822.352342:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789117822.352346:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593227520:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1789117822.358383:0:3645:0:(import.c:65:import_set_state_nolock()) ffff962bbf941000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789117822.358621:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 240 00000100:00080000:1.0:1789117822.358631:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff962bbf941000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789117822.358746:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bc1a743c0 x1876025593227648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789117822.358788:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593226880:0@lo:400:kworker.0 00000100:00080000:1.0:1789117822.358830:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789117822.358853:0:3645:0:(import.c:65:import_set_state_nolock()) ffff962bbf4b5800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789117822.358857:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789117822.358860:0:3645:0:(import.c:65:import_set_state_nolock()) ffff962bbf4b5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789117822.358864:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 187 00000100:00080000:1.0:1789117822.358868:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff962bbf4b5800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789117822.358881:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bc1a77840 x1876025593227776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789117822.358893:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593226496:0@lo:400:kworker.0 00010000:00080000:1.0:1789117822.358912:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f70b40 x1876025593227008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117822.358923:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593227008:0@lo:400:kworker.0 00000100:00080000:1.0:1789117822.359023:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789117822.359028:0:3645:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff962bbf321000 already not connected (conn 2, was 1): DISCONN 00000100:00100000:1.0:1789117822.359032:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593226368:0@lo:400:kworker.0 00000100:00100000:2.0:1789117822.359548:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876025593227648:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1789117822.359627:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117822.359694:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876025593227776:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1789117822.359718:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117822.359948:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593227648 00000100:00100000:0.0:1789117822.359970:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593227648 00000100:00100000:0.0:1789117822.360018:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593227776 00000100:00100000:0.0:1789117822.360022:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593227776 00000100:00100000:0.0:1789117822.360046:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789117822.360236:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789117822.360244:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1876025593227776:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1789117822.360262:0:9533:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789117822.360322:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1876025593227776:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 77us (601us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789117822.360331:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:2.0:1789117822.360438:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbf4b5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789117822.360443:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789117822.360447:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876025593227776:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1789117822.360610:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876025593227648:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1789117822.360620:0:6520:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789117822.360854:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876025593227648:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 246us (1227us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789117822.360861:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:0.0:1789117822.360927:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbf941000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789117822.360931:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789117822.360934:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876025593227648:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1789117822.822784:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf6ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593227904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789117822.822896:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117822.823195:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593227904 00000100:00100000:3.0:1789117822.823207:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593227904 00000100:00100000:3.0:1789117822.823275:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789117822.823287:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593227904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789117822.823344:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789117822.824550:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593227904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1257us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117822.824563:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789117822.825116:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593227904:0@lo:13:osp-pre-1-1.0 00000001:00100000:2.0:1789117822.826118:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789117822.826124:0:8429:0:(genops.c:885:class_export_put()) final put ffff962bc1a32800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789117822.826140:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 35e670b1-2cce-4394-8cb4-d5255c6a6a93 00000020:00000080:2.0:1789117822.826143:0:8429:0:(genops.c:885:class_export_put()) final put ffff962bae85f000/35e670b1-2cce-4394-8cb4-d5255c6a6a93 00000001:00100000:0.0:1789117822.826208:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789117822.826211:0:6498:0:(genops.c:885:class_export_put()) final put ffff962bbf4b9800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789117822.826222:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 100c793d-0063-4934-90f0-b04fc41ff903 00000001:00080000:0.0:1789117822.826230:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:0.0:1789117822.826233:0:6498:0:(genops.c:885:class_export_put()) final put ffff962a87eb5000/100c793d-0063-4934-90f0-b04fc41ff903 00000001:00100000:0.0:1789117822.826237:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 35e670b1-2cce-4394-8cb4-d5255c6a6a93 00000001:00080000:0.0:1789117822.826241:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1789117822.826246:0:6498:0:(genops.c:885:class_export_put()) final put ffff962a87eb6000/35e670b1-2cce-4394-8cb4-d5255c6a6a93 00000001:00100000:0.0:1789117822.826426:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789117822.826442:0:9514:0:(genops.c:885:class_export_put()) final put ffff962a87eb4800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789117822.826449:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35e670b1-2cce-4394-8cb4-d5255c6a6a93 00000020:00000080:0.0:1789117822.826451:0:9514:0:(genops.c:885:class_export_put()) final put ffff962bc1bc3000/35e670b1-2cce-4394-8cb4-d5255c6a6a93 00000001:00100000:2.0:1789117822.826679:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1789117822.826687:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1789117822.826690:0:7451:0:(genops.c:885:class_export_put()) final put ffff962bbf4b2000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789117822.826695:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 100c793d-0063-4934-90f0-b04fc41ff903 00000001:00080000:2.0:1789117822.826699:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1789117822.826706:0:7451:0:(genops.c:885:class_export_put()) final put ffff962a87eb6800/100c793d-0063-4934-90f0-b04fc41ff903 00000001:00100000:2.0:1789117822.826712:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 35e670b1-2cce-4394-8cb4-d5255c6a6a93 00000001:00080000:2.0:1789117822.826716:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1789117822.826718:0:7451:0:(genops.c:885:class_export_put()) final put ffff962bc1aec800/35e670b1-2cce-4394-8cb4-d5255c6a6a93 00000020:00000080:1.0:1789117822.826903:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bc1a32800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789117822.830562:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bae85f000/35e670b1-2cce-4394-8cb4-d5255c6a6a93 for lustre-OST0000 00000020:00000080:1.0:1789117822.830741:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf4b9800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1789117822.830930:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962a87eb5000/100c793d-0063-4934-90f0-b04fc41ff903 for lustre-MDT0000 00000020:00000080:1.0:1789117822.831033:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962a87eb6000/35e670b1-2cce-4394-8cb4-d5255c6a6a93 for lustre-MDT0000 00000020:00000080:1.0:1789117822.831195:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962a87eb4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789117822.831297:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bc1bc3000/35e670b1-2cce-4394-8cb4-d5255c6a6a93 for lustre-OST0001 00000020:00000080:1.0:1789117822.831395:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf4b2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1789117822.831580:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962a87eb6800/100c793d-0063-4934-90f0-b04fc41ff903 for lustre-MDT0001 00000020:00000080:1.0:1789117822.831699:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bc1aec800/35e670b1-2cce-4394-8cb4-d5255c6a6a93 for lustre-MDT0001 00000020:00000080:1.0:1789117822.831936:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bc1a2e000 for lustre-OST0000 00000020:00000080:1.0:1789117822.831943:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bae85e800 for lustre-OST0000 00000020:00000080:1.0:1789117822.831947:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bbf4ba000 for lustre-MDT0000 00000020:00000080:1.0:1789117822.831950:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a87eb0800 for lustre-MDT0000 00000020:00000080:1.0:1789117822.831954:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a87eb1000 for lustre-MDT0000 00000020:00000080:1.0:1789117822.831956:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a87eb0000 for lustre-OST0001 00000020:00000080:1.0:1789117822.831960:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bc1bc4000 for lustre-OST0001 00000020:00000080:1.0:1789117822.831963:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bbcfef000 for lustre-MDT0001 00000020:00000080:1.0:1789117822.831969:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a87eb3800 for lustre-MDT0001 00000020:00000080:1.0:1789117822.831971:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a87e9f000 for lustre-MDT0001 00010000:00010000:1.0:1789117822.951136:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117823.973321:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117824.999908:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117826.022420:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789117826.853433:0:15808:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff962bbfa92060 - data ffff962b9cb4dca8/ffff962bbfa7bc00 00000020:01000000:0.0:1789117826.853650:0:15808:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff962bae4e98a0 - data ffff962b91c4f000/ffff962bbd079c00 00000001:00000004:0.0:1789117826.866560:0:15808:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00100000:1.0:1789117826.919524:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789117826.919551:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a75680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593228032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789117826.919636:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117826.919720:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593228032 00000100:00100000:1.0:1789117826.919729:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593228032 00000100:00100000:1.0:1789117826.919814:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789117826.919825:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593228032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789117826.919868:0:8438:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789117826.919909:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789117826.919927:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593228032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117826.919954:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789117826.920005:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a75680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593228032:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789117826.981997:0:15808:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789117826.982008:0:15808:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1789117826.982068:0:15808:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff962bc1a74b40 x1876025593225728/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789117830 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117826.982117:0:15808:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789117826.987755:0:15808:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789117826.987763:0:15808:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1789117826.987781:0:15808:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789117826.987785:0:15808:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789117826.989345:0:8830:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789117826.989356:0:8830:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1789117826.989371:0:8830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789117826.990386:0:15808:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789117826.990393:0:15808:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1789117826.990420:0:15808:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789117826.990423:0:15808:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789117826.991374:0:9921:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789117826.991381:0:9921:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1789117826.991392:0:9921:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789117826.993143:0:15808:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f48e 00000020:00000080:0.0:1789117826.993157:0:15808:0:(genops.c:885:class_export_put()) final put ffff962b872f3800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789117826.993336:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962b872f3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789117826.997751:0:15808:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f4a3 00000020:00000080:0.0:1789117826.997767:0:15808:0:(genops.c:885:class_export_put()) final put ffff962b872f0000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789117826.997927:0:15808:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789117826.997936:0:15808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789117826.997947:0:15808:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789117826.997954:0:15808:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff962b8e9c9a48) has no exports 00000004:01000000:0.0:1789117826.998221:0:15808:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789117826.998232:0:15808:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f8d9 00000020:00000080:0.0:1789117826.998238:0:15808:0:(genops.c:885:class_export_put()) final put ffff962bc1ae8000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789117827.005383:0:15808:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789117827.005403:0:15808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789117827.005421:0:15808:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789117827.005427:0:15808:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff962a87e21a48) has no exports 00000020:00000080:0.0:1789117827.005439:0:15808:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f8d2 00000020:00000080:0.0:1789117827.005449:0:15808:0:(genops.c:885:class_export_put()) final put ffff962a87e9f800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789117827.005626:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962b872f0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1789117827.005638:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962bc1ae8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789117827.005643:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962a87e9f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789117827.006232:0:15808:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789117827.006239:0:15808:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789117827.006243:0:15808:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1789117827.006249:0:15808:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789117827.006263:0:15808:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789117827.006403:0:15808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789117827.006415:0:15808:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789117827.006424:0:15808:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f797 00000020:00000080:0.0:1789117827.006430:0:15808:0:(genops.c:885:class_export_put()) final put ffff962bc1a37000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789117827.006436:0:15808:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789117827.006440:0:15808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789117827.006444:0:15808:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789117827.006448:0:15808:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff962bb082b490) has no exports 00000020:00000080:0.0:1789117827.006452:0:15808:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f790 00000020:00000080:0.0:1789117827.006456:0:15808:0:(genops.c:885:class_export_put()) final put ffff962bbf8f5000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789117827.006636:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a87e9a000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789117827.006644:0:14597:0:(genops.c:885:class_export_put()) final put ffff962a87e9c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789117827.006647:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962a87e9c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1789117827.006657:0:14597:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789117827.006748:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bc1a37000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789117827.006753:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf8f5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789117827.010800:0:15808:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789117827.010808:0:15808:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789117827.010812:0:15808:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1789117827.010819:0:15808:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789117827.010822:0:15808:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789117827.011244:0:15808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789117827.011258:0:15808:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1789117827.011273:0:15808:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1789117827.011281:0:15808:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f647 00000020:00000080:0.0:1789117827.011290:0:15808:0:(genops.c:885:class_export_put()) final put ffff962bbd045000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789117827.011314:0:15808:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1789117827.011351:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bbf8f5800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789117827.011360:0:14597:0:(genops.c:885:class_export_put()) final put ffff962bbf946800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789117827.011363:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf946800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1789117827.011370:0:14597:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789117827.011457:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbd045000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789117827.011489:0:15808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789117827.011496:0:15808:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789117827.011500:0:15808:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff962bbf36b490) has no exports 00000020:00000080:0.0:1789117827.011508:0:15808:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f640 00000020:00000080:0.0:1789117827.011514:0:15808:0:(genops.c:885:class_export_put()) final put ffff962bbf6a2800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789117827.011635:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf6a2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789117827.017390:0:15808:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1789117827.017404:0:15808:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789117827.017410:0:15808:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1789117827.017422:0:15808:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789117827.017490:0:15808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789117827.017507:0:15808:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789117827.017559:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bbf6a6000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789117827.017658:0:15808:0:(genops.c:885:class_export_put()) final put ffff962bbf6a4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789117827.017662:0:15808:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf6a4000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1789117827.017676:0:15808:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789117827.017796:0:15808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789117827.017816:0:15808:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789117827.017819:0:15808:0:(genops.c:885:class_export_put()) final put ffff962bb5c48000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789117827.017822:0:15808:0:(genops.c:844:class_export_destroy()) destroying export ffff962bb5c48000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789117827.017826:0:15808:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789117827.017877:0:15808:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f4aa 00000020:00000080:1.0:1789117827.017897:0:15808:0:(genops.c:885:class_export_put()) final put ffff962b872f0800/lustre-MDD0000_UUID 00000020:01000000:1.0:1789117827.017912:0:15808:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789117827.017916:0:15808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789117827.017921:0:15808:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789117827.017925:0:15808:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff962b8e9cced8) has no exports 00000020:00000080:1.0:1789117827.017944:0:15808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789117827.017947:0:15808:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789117827.017951:0:15808:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f4b1 00000020:00000080:1.0:1789117827.017955:0:15808:0:(genops.c:885:class_export_put()) final put ffff962b872f6800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789117827.017964:0:15808:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962b9832f800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789117827.017973:0:15808:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962b9832f800 3 00000020:01000004:1.0:1789117827.017976:0:15808:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff962b9832f800 from lustre-MDT0000 00000020:00000080:1.0:1789117827.017996:0:15808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789117827.017999:0:15808:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789117827.018001:0:15808:0:(genops.c:885:class_export_put()) final put ffff962b872f1000/lustre-MDT0000_UUID 00000020:00000080:1.0:1789117827.018003:0:15808:0:(genops.c:844:class_export_destroy()) destroying export ffff962b872f1000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789117827.018009:0:15808:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789117827.018037:0:15808:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1789117827.018041:0:15808:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789117827.018044:0:15808:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789117827.018046:0:15808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789117827.018049:0:15808:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789117827.018083:0:15808:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff962bb5cea000 7945443b-b7e4-4157-aee9-c9b2172613e6 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789117827.018088:0:15808:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff962b8e9cb490) has exports, disconnecting them 00000020:00080000:1.0:1789117827.018092:0:15808:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff962bb5cea000), last request at 1789117512 00000020:00000080:1.0:1789117827.018117:0:15808:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f44f 00000020:00010000:1.0:1789117827.018121:0:15808:0:(genops.c:1921:obd_stale_export_put()) Put export ffff962bb5cea000: total 2 00000100:00080000:1.0:1789117827.018125:0:15808:0:(import.c:65:import_set_state_nolock()) ffff962bb5ce9000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789117827.018139:0:15808:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962bb5cea000): rc 0 00000020:00080000:1.0:1789117827.018143:0:15808:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff962b8e9cb490) has no exports 00000020:00010000:1.0:1789117827.018155:0:6508:0:(genops.c:1907:obd_stale_export_get()) Get export ffff962bb5cea000: total 2 00010000:00010000:1.0:1789117827.018179:0:6508:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff962bb5cea000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789117827.018224:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d93800/0xaa253ed19be1f95e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be1f957 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117827.018241:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813dae00/0xaa253ed19be1f870 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be1f869 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117827.018258:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b89b69200/0xaa253ed19be1fc8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be1fc83 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117827.018268:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b89b68000/0xaa253ed19be1f96c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be1f965 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117827.018277:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d93400/0xaa253ed19be1fc98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be1fc91 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117827.018286:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bbf70dc00/0xaa253ed19be1f9ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be1f9c7 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789117827.018367:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962b872f0800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1789117827.018378:0:14597:0:(genops.c:885:class_export_put()) final put ffff962b872f3000/lustre-MDD0000_UUID 00000020:00000080:2.0:1789117827.018380:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962b872f3000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1789117827.018386:0:14597:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00010000:00010000:1.0:1789117827.018421:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962baea9a200/0xaa253ed19be1f988 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be1f981 expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117827.018431:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962baea9b600/0xaa253ed19be1f97a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be1f973 expref: 7 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117827.018440:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bbf70d000/0xaa253ed19be1fca6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be1fc9f expref: 6 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117827.018452:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962baea9b000/0xaa253ed19be1f559 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be1f552 expref: 5 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117827.018463:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962baea9a400/0xaa253ed19be1f996 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be1f98f expref: 4 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117827.018489:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bbbc10e00/0xaa253ed19be1f54b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be1f544 expref: 3 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117827.018502:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d93e00/0xaa253ed19be1f9a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be1f99d expref: 2 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117827.018513:0:6508:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff962bb5cea000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1789117827.018528:0:6508:0:(genops.c:885:class_export_put()) final put ffff962bb5cea000/7945443b-b7e4-4157-aee9-c9b2172613e6 00010000:00010000:1.0:1789117827.018540:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117827.018543:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117827.018544:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117827.018688:0:6513:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff962bb5d4ec00:6513] 1 exiting: rc = 0 00000100:00100000:2.0:1789117827.018890:0:6514:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff962bb5c60200:6514] 2 exiting: rc = 0 00000100:00100000:2.0:1789117827.018962:0:6512:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff962bb5c63000:6512] 0 exiting: rc = 1 00000020:00000080:2.0:1789117827.019081:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962b872f6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789117827.019088:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bb5cea000/7945443b-b7e4-4157-aee9-c9b2172613e6 for MGS 00000020:00000080:2.0:1789117827.019123:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bb5ce9000 for MGS 00000100:00100000:2.0:1789117827.020251:0:9525:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff962a8788fe00:9525] 3 exiting: rc = 0 00000100:00100000:1.0:1789117827.020510:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020518:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020536:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020543:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020549:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020555:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020561:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020566:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020572:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020590:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020596:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020602:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020607:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020613:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020618:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020623:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020629:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020634:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020641:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020662:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020947:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020964:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020971:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020977:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020982:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020987:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020995:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.020999:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021005:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021015:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021021:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021026:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021032:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021038:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021044:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021049:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021085:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021092:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021112:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021117:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021123:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021127:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021132:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021137:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021142:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021148:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021153:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021158:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021164:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021170:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021175:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021181:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021186:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021192:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021207:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021212:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021217:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021223:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021228:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021233:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021239:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021244:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021250:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117827.021256:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1789117827.025626:0:15808:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff962bbf656cc0 - data ffff962b9cb705e8/ffff962a87e6cc00 00000020:01000000:2.0:1789117827.025774:0:15808:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff962b83243c60 - data ffff962b9c8c2a20/ffff962bb093fc00 00000020:00000080:2.0:1789117827.038218:0:15808:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f433 00000020:00000080:2.0:1789117827.038244:0:15808:0:(genops.c:885:class_export_put()) final put ffff962b82aa8000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789117827.038275:0:15808:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962b9832f800 from MGS, refs=2 00000020:01000004:2.0:1789117827.038279:0:15808:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962b9832f800 2 00000020:01000004:2.0:1789117827.038282:0:15808:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff962b9832f800 from MGS 00000020:00000080:2.0:1789117827.038330:0:15808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789117827.038342:0:15808:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1789117827.038346:0:15808:0:(genops.c:885:class_export_put()) final put ffff962b82aaf800/MGS 00000020:00000080:2.0:1789117827.038350:0:15808:0:(genops.c:844:class_export_destroy()) destroying export ffff962b82aaf800/MGS for MGS 00000020:01000000:2.0:1789117827.038362:0:15808:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1789117827.038450:0:15808:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1789117827.038455:0:15808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789117827.038462:0:15808:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789117827.038470:0:15808:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff962bbcf22800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789117827.038476:0:15808:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff962b8802ced8) has exports, disconnecting them 00000020:00080000:2.0:1789117827.038482:0:15808:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff962bbcf22800), last request at 1789117513 00000020:00000080:2.0:1789117827.038489:0:15808:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f4fe 00000020:00080000:2.0:1789117827.038503:0:15808:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962bbcf22800): rc 0 00000020:00000080:2.0:1789117827.038511:0:15808:0:(genops.c:885:class_export_put()) final put ffff962bbcf22800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789117827.038654:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962b82aa8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789117827.038662:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbcf22800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1789117827.084817:0:15808:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789117827.084833:0:15808:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789117827.084839:0:15808:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789117827.084849:0:15808:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789117827.084896:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bbcf26000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789117827.085159:0:15808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789117827.085169:0:15808:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789117827.085178:0:15808:0:(genops.c:885:class_export_put()) final put ffff962bb5c86000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789117827.085182:0:15808:0:(genops.c:844:class_export_destroy()) destroying export ffff962bb5c86000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789117827.085193:0:15808:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789117827.085288:0:15808:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962b9832f800 1 00000020:00000080:1.0:1789117827.085302:0:15808:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f425 00000020:00000080:1.0:1789117827.085309:0:15808:0:(genops.c:885:class_export_put()) final put ffff962b82aae000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1789117827.085319:0:15808:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789117827.085331:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962b82aae000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789117827.085340:0:15808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789117827.085344:0:15808:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789117827.085348:0:15808:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff962b88029a48) has no exports 00010000:00010000:1.0:1789117827.217136:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789117827.219962:0:15808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789117827.219977:0:15808:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789117827.219983:0:15808:0:(genops.c:885:class_export_put()) final put ffff962b9832b000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789117827.219989:0:15808:0:(genops.c:844:class_export_destroy()) destroying export ffff962b9832b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789117827.219995:0:15808:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789117827.220469:0:15808:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff962b9832d800 00000020:02000400:3.0:1789117827.220535:0:15808:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00080000:2.0:1789117827.431827:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789117827.431836:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789117827.431842:0:36:0:(import.c:65:import_set_state_nolock()) ffff962bbf321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789117827.431851:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 474 00000100:00080000:2.0:1789117827.431857:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789117827.431866:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff962bbf321000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789117827.431893:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87f70b40 x1876025593228288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789117827.431918:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789117827.431921:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789117827.431923:0:36:0:(import.c:65:import_set_state_nolock()) ffff962bbf4b5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789117827.431928:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 474 00000100:00080000:2.0:1789117827.431930:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789117827.431934:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff962bbf4b5800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789117827.431945:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87f70f00 x1876025593228416/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789117827.431953:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789117827.431956:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789117827.431958:0:36:0:(import.c:65:import_set_state_nolock()) ffff962a86831000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789117827.431960:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 474 00000100:00080000:2.0:1789117827.431963:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789117827.431966:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff962a86831000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789117827.431976:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87f730c0 x1876025593228544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789117827.431992:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789117827.432004:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789117827.432006:0:36:0:(import.c:65:import_set_state_nolock()) ffff962bbf941000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789117827.432009:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 474 00000100:00080000:2.0:1789117827.432012:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789117827.432014:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff962bbf941000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789117827.432026:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87f73840 x1876025593228800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789117827.432119:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593228160:0@lo:400:kworker.0 00000400:00000100:2.0:1789117827.432181:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876025593228160 offset 0 length 224: 4 00000100:00100000:2.0:1789117827.432238:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789117827.432244:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593228672:0@lo:400:kworker.0 00000100:00100000:2.0:1789117827.432282:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117827.432316:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593228928:0@lo:400:kworker.0 00000100:00100000:2.0:1789117827.432342:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117827.432361:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117827.432367:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88625680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593229056:0@lo:400:kworker.0 00000100:00100000:2.0:1789117827.432393:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117827.432423:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593228672 00000100:00100000:2.0:1789117827.432431:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593228672 00000100:00100000:2.0:1789117827.432489:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593228928 00000100:00100000:2.0:1789117827.432492:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593228928 00000100:00100000:2.0:1789117827.432518:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:2.0:1789117827.432526:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593228672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117827.432760:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593228672:12345-0@lo:400:kworker.0 Request processed in 233us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117827.432769:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:2.0:1789117827.432797:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:2.0:1789117827.432810:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593228928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117827.432847:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593228928:12345-0@lo:400:kworker.0 Request processed in 38us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117827.432854:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00010000:00080000:2.0:1789117827.432901:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff962a87f72d00 x1876025593228672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117827.432918:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593228672:0@lo:400:kworker.0 00010000:00080000:2.0:1789117827.432949:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff962a87f721c0 x1876025593228928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117827.432958:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593228928:0@lo:400:kworker.0 00000100:00100000:3.0:1789117827.433373:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593229056 00000100:00100000:3.0:1789117827.433378:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593229056 00000100:00100000:3.0:1789117827.433413:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789117827.433423:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593229056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117827.433473:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593229056:12345-0@lo:400:kworker.0 Request processed in 54us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117827.433480:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:3.0:1789117827.433500:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789117827.433504:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789117827.433528:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88625680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593229056:0@lo:400:kworker.0 00000100:00100000:0.0:1789117827.434432:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593228288:0@lo:38:kworker.0 00000100:00100000:0.0:1789117827.434499:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117827.434535:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876025593228416:0@lo:38:kworker.0 00000100:00100000:0.0:1789117827.434564:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117827.434606:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876025593228544:0@lo:38:kworker.0 00000100:00100000:0.0:1789117827.434630:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117827.434649:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876025593228800:0@lo:38:kworker.0 00000100:00100000:0.0:1789117827.434673:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117827.434795:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593228416 00000100:00100000:0.0:1789117827.434818:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593228416 00000100:00100000:0.0:1789117827.434850:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593228544 00000100:00100000:0.0:1789117827.434853:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593228544 00000100:00100000:0.0:1789117827.434867:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593228800 00000100:00100000:0.0:1789117827.434870:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593228800 00000100:00100000:0.0:1789117827.434883:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789117827.434889:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876025593228416:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789117827.434912:0:6520:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789117827.434956:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876025593228416:12345-0@lo:38:kworker.0 Request processed in 65us (391us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789117827.434963:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789117827.434978:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789117827.434982:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876025593228544:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789117827.434991:0:6520:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789117827.435014:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876025593228544:12345-0@lo:38:kworker.0 Request processed in 31us (383us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789117827.435020:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789117827.435030:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789117827.435034:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b989cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876025593228800:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789117827.435043:0:6520:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789117827.435084:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b989cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876025593228800:12345-0@lo:38:kworker.0 Request processed in 49us (410us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789117827.435107:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:0.0:1789117827.435149:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbf4b5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789117827.435153:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789117827.435157:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876025593228416:0@lo:38:kworker.0 00000100:00080000:0.0:1789117827.435165:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a86831000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789117827.435168:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789117827.435171:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876025593228544:0@lo:38:kworker.0 00000100:00080000:0.0:1789117827.435179:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbf941000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789117827.435182:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789117827.435185:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876025593228800:0@lo:38:kworker.0 00000100:00100000:2.0:1789117827.436239:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593228288 00000100:00100000:2.0:1789117827.436251:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593228288 00000100:00100000:2.0:1789117827.436287:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789117827.436294:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876025593228288:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789117827.436310:0:6524:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789117827.436378:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876025593228288:12345-0@lo:38:kworker.0 Request processed in 83us (1879us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789117827.436384:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00080000:0.0:1789117827.436773:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbf321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789117827.436778:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789117827.436782:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593228288:0@lo:38:kworker.0 00000100:00100000:1.0:1789117827.943535:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593229184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789117827.943616:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117827.944039:0:11101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593229184 00000100:00100000:2.0:1789117827.944048:0:11101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593229184 00000100:00100000:2.0:1789117827.944142:0:11101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789117827.944153:0:11101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a76d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593229184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789117827.944189:0:11101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789117827.944244:0:11101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a76d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593229184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117827.944261:0:11101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789117827.944308:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593229184:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789117828.262246:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789117829.030201:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789117829.286323:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117830.311445:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117831.334990:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789117831.931493:0:16009:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1789117831.940500:0:16009:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1789117831.940556:0:16009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9a600/0xaa253ed19be1f98f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f996 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117831.940570:0:16009:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9a600/0xaa253ed19be1f98f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f996 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117831.940577:0:16009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9a600/0xaa253ed19be1f98f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1f996 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117831.940584:0:16009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962baea9a600/0xaa253ed19be1f98f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1f996 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117831.940612:0:16009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789117831.940618:0:16009:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789117831.940645:0:16009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789117831.940649:0:16009:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789117831.940654:0:16009:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789117831.940661:0:16009:0:(import.c:65:import_set_state_nolock()) ffff962bbf4b5800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789117831.940666:0:16009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789117831.940667:0:16009:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789117831.940670:0:16009:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789117831.940767:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117831.940779:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962baea9a600/0xaa253ed19be1f98f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1f996 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117831.940789:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9a600 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:3.0:1789117831.940793:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962baea9a600/0xaa253ed19be1f98f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1f996 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117831.940817:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962baea9a600/0xaa253ed19be1f98f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be1f996 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789117831.940827:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962baea9a600/0xaa253ed19be1f98f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be1f996 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117831.940832:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789117831.940836:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789117831.940838:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789117831.940885:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962baea9a600/0xaa253ed19be1f98f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1f996 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117831.940892:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789117831.940917:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962baea9a600/0xaa253ed19be1f98f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1f996 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117831.940924:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962baea9a600/0xaa253ed19be1f98f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1f996 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117831.940935:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117831.940937:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117831.940939:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117831.940957:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593229312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789117831.941046:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117831.941146:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593229312 00000100:00100000:3.0:1789117831.941153:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593229312 00000100:00100000:3.0:1789117831.941189:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789117831.941197:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0718780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3647:x1876025593229312:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789117831.941203:0:9524:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789117831 with bad export cookie 12260274630570406991 00010000:00010000:2.0:1789117831.942697:0:16009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70c400/0xaa253ed19be1f99d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f9a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117831.942715:0:16009:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70c400/0xaa253ed19be1f99d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f9a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117831.942732:0:16009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70c400/0xaa253ed19be1f99d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1f9a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117831.942739:0:16009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962bbf70c400/0xaa253ed19be1f99d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1f9a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117831.942759:0:16009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789117831.942766:0:16009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70ce00/0xaa253ed19be1f869 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f870 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117831.942773:0:16009:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70ce00/0xaa253ed19be1f869 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f870 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117831.942778:0:16009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70ce00/0xaa253ed19be1f869 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1f870 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117831.942783:0:16009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962bbf70ce00/0xaa253ed19be1f869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1f870 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117831.942796:0:16009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789117831.942802:0:16009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d92400/0xaa253ed19be1fc9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fca6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117831.942808:0:16009:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d92400/0xaa253ed19be1fc9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1fca6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117831.942813:0:16009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d92400/0xaa253ed19be1fc9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1fca6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117831.942828:0:16009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962a87d92400/0xaa253ed19be1fc9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1fca6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117831.942840:0:16009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789117831.942845:0:16009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbbc11800/0xaa253ed19be1f552 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f559 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117831.942852:0:16009:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbbc11800/0xaa253ed19be1f552 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f559 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117831.942858:0:16009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbbc11800/0xaa253ed19be1f552 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1f559 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117831.942863:0:16009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962bbbc11800/0xaa253ed19be1f552 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1f559 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117831.942868:0:16009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1789117831.942871:0:16009:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1789117831.942895:0:16009:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1789117831.942899:0:16009:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1789117831.942903:0:16009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789117831.942908:0:16009:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1789117831.942914:0:16009:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff962bae85b800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789117831.942919:0:16009:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff962bbcfe9000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789117831.942924:0:16009:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff962bbd2b1a48) has exports, disconnecting them 00000020:00080000:2.0:1789117831.942928:0:16009:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff962bae85b800), last request at 1789117827 00000020:00000080:2.0:1789117831.942935:0:16009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f831 00000100:00080000:2.0:1789117831.942950:0:16009:0:(import.c:65:import_set_state_nolock()) ffff962bae859000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789117831.942998:0:16009:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962bae85b800): rc 0 00000020:00000080:2.0:1789117831.943012:0:16009:0:(genops.c:885:class_export_put()) final put ffff962bae85b800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1789117831.943021:0:16009:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff962bbcfe9000), last request at 1789117827 00000020:00000080:2.0:1789117831.943025:0:16009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f70b 00000100:00080000:2.0:1789117831.943030:0:16009:0:(import.c:65:import_set_state_nolock()) ffff962bbcfea000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789117831.943035:0:16009:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962bbcfe9000): rc 0 00000020:00000080:2.0:1789117831.943037:0:16009:0:(genops.c:885:class_export_put()) final put ffff962bbcfe9000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1789117831.943044:0:16009:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbc5cc1c3fae0 00000100:00080000:2.0:1789117831.943081:0:16009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789117831.943089:0:16009:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff962bbf6fc780 x1876025593227392/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789117838 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117831.943103:0:16009:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000020:00000080:1.0:1789117831.943225:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bae85b800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00010000:00010000:0.0:1789117831.943241:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789117831.943249:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bbf70c400/0xaa253ed19be1f99d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1f9a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789117831.943270:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbcfe9000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1789117831.943290:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bae859000 for lustre-MDT0001 00000020:00000080:1.0:1789117831.943294:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bbcfea000 for lustre-MDT0001 00010000:00010000:0.0:1789117831.943326:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c400 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117831.943330:0:9523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70c400/0xaa253ed19be1f99d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1f9a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117831.943339:0:9523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bbf70c400/0xaa253ed19be1f99d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be1f9a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117831.943356:0:9523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70c400/0xaa253ed19be1f99d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be1f9a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117831.943362:0:9523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789117831.943365:0:9523:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1789117831.943367:0:9523:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1789117831.943396:0:9523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962bbf70c400/0xaa253ed19be1f99d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1f9a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117831.943403:0:9523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789117831.943465:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593229440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117831.943571:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789117831.944277:0:16009:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789117831.944283:0:16009:0:(import.c:65:import_set_state_nolock()) ffff962bbf321000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1789117831.944294:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bbf70c400/0xaa253ed19be1f99d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1f9a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117831.944304:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bbf70c400/0xaa253ed19be1f99d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1f9a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117831.944321:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789117831.944324:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bbf70ce00/0xaa253ed19be1f869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1f870 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117831.944330:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70ce00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117831.944333:0:9523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70ce00/0xaa253ed19be1f869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1f870 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117831.944334:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593229440 00010000:00010000:0.0:1789117831.944340:0:9523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bbf70ce00/0xaa253ed19be1f869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be1f870 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117831.944341:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593229440 10000000:00010000:0.0:1789117831.944346:0:9523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70ce00/0xaa253ed19be1f869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be1f870 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117831.944363:0:9523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789117831.944365:0:9523:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789117831.944368:0:9523:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00100000:2.0:1789117831.944377:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789117831.944384:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a75680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1876025593229440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789117831.944388:0:9523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962bbf70ce00/0xaa253ed19be1f869 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1f870 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00020000:2.0:1789117831.944390:0:6506:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789117831 with bad export cookie 12260274630570406991 00010000:00010000:0.0:1789117831.944394:0:9523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117831.946077:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bbf70ce00/0xaa253ed19be1f869 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1f870 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117831.946092:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bbf70ce00/0xaa253ed19be1f869 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1f870 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117831.946112:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789117831.946201:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962a87d92400/0xaa253ed19be1fc9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1fca6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117831.946210:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92400 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117831.946214:0:9523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962a87d92400/0xaa253ed19be1fc9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1fca6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117831.946224:0:9523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962a87d92400/0xaa253ed19be1fc9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be1fca6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117831.946230:0:9523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962a87d92400/0xaa253ed19be1fc9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be1fca6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117831.946236:0:9523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789117831.946239:0:9523:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789117831.946242:0:9523:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789117831.946293:0:9523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962a87d92400/0xaa253ed19be1fc9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1fca6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117831.946299:0:9523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117831.946323:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962a87d92400/0xaa253ed19be1fc9f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1fca6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117831.946330:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962a87d92400/0xaa253ed19be1fc9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1fca6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117831.946339:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117831.946343:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bbbc11800/0xaa253ed19be1f552 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1f559 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117831.946348:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc11800 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117831.946351:0:9523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bbbc11800/0xaa253ed19be1f552 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1f559 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117831.946357:0:9523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bbbc11800/0xaa253ed19be1f552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be1f559 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117831.946363:0:9523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bbbc11800/0xaa253ed19be1f552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be1f559 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117831.946367:0:9523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789117831.946369:0:9523:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789117831.946371:0:9523:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789117831.946382:0:9523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962bbbc11800/0xaa253ed19be1f552 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1f559 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117831.946386:0:9523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117831.946392:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bbbc11800/0xaa253ed19be1f552 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1f559 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117831.946404:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bbbc11800/0xaa253ed19be1f552 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be1f559 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117831.946415:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117831.946416:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117831.946418:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117831.946427:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117831.946449:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593229568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789117831.946518:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117831.946573:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593229568 00000100:00100000:0.0:1789117831.946581:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593229568 00000100:00100000:0.0:1789117831.946616:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789117831.946623:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bae57c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3645:x1876025593229568:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789117831.946629:0:6504:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789117831 with bad export cookie 12260274630570406991 00000100:00100000:0.0:1789117831.946670:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bae57c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3645:x1876025593229568:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (152us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789117831.946677:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789117831.946703:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593229696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789117831.946727:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117831.946749:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf6fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593227392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117831.946767:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789117831.946772:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593229824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789117831.946792:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117831.946817:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593229696 00000100:00100000:0.0:1789117831.946821:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593229696 00000100:00100000:0.0:1789117831.946845:0:7470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593229824 00000100:00100000:0.0:1789117831.946847:0:7470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593229824 00000100:00100000:0.0:1789117831.946858:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789117831.946862:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1876025593229696:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789117831.946866:0:7470:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789117831 with bad export cookie 12260274630570406991 00000100:00100000:0.0:1789117831.946896:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1876025593229696:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (168us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789117831.946902:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789117831.946913:0:7470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789117831.946917:0:7470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fabc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1876025593229824:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789117831.946921:0:7470:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789117831 with bad export cookie 12260274630570406991 00000100:00100000:0.0:1789117831.946943:0:7470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fabc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1876025593229824:12345-0@lo:103:ldlm_bl.0 Request processed in 25us (151us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789117831.946949:0:7470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789117831.946976:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789117831.946981:0:3645:0:(import.c:65:import_set_state_nolock()) ffff962bae542800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789117831.946985:0:3645:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:2.0:1789117831.947222:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a75680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1876025593229440:12345-0@lo:103:ldlm_bl.0 Request processed in 2836us (3649us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789117831.947230:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1789117831.947303:0:16009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789117831.947308:0:16009:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:2.0:1789117831.947321:0:16009:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789117831.947383:0:16009:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789117831.947400:0:16009:0:(import.c:65:import_set_state_nolock()) ffff962bbf97c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789117831.947414:0:16009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789117831.947422:0:16009:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:2.0:1789117831.947431:0:16009:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789117831.947500:0:16009:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789117831.947511:0:16009:0:(import.c:65:import_set_state_nolock()) ffff962a87895000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789117831.947538:0:16009:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff962bbd2b1a48) has no exports 00010000:00010000:2.0:1789117831.947578:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789117831.948272:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789117831.962877:0:3645:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.130@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789117831.962882:0:3645:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789117831.962893:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962a87f73480 x1876025593228160/t0(0) o400->MGC192.168.204.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789117843 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117831.962908:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962ba071b480 x1876025593229312/t0(0) o103->MGC192.168.204.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789117847 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117831.962935:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962a87fa8000 x1876025593229440/t0(0) o103->MGC192.168.204.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789117847 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117831.962944:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962a87fab840 x1876025593229568/t0(0) o103->MGC192.168.204.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789117847 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117831.962979:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962a87faa580 x1876025593229696/t0(0) o103->MGC192.168.204.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789117847 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117831.962986:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962a87fa8b40 x1876025593229824/t0(0) o103->MGC192.168.204.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789117847 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789117831.963047:0:3646:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff962bae542800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1789117831.963082:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593229696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789117831.963091:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593228160:0@lo:400:kworker.0 10000000:01000000:0.0:1789117831.963264:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789117831.963268:0:3645:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789117831.963269:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789117831.963272:0:3645:0:(import.c:65:import_set_state_nolock()) ffff962bae542800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789117831.963277:0:3645:0:(import.c:510:import_select_connection()) MGC192.168.204.130@tcp: connect to NID 0@lo last attempt 164 00000100:00080000:0.0:1789117831.963286:0:3645:0:(import.c:624:import_select_connection()) MGC192.168.204.130@tcp: import ffff962bae542800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1789117831.963311:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7945443b-b7e4-4157-aee9-c9b2172613e6:3647:1876025593229312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789117831.963337:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593229952:0@lo:9:umount.0 00000100:00100000:0.0:1789117831.963397:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117831.963428:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593230080:0@lo:9:umount.0 00000100:00100000:0.0:1789117831.963445:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117831.963564:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7945443b-b7e4-4157-aee9-c9b2172613e6:3646:1876025593229824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789117831.963598:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593229952 00000100:00100000:2.0:1789117831.963606:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593229952 00000100:00100000:2.0:1789117831.963654:0:8833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593230080 00000100:00100000:2.0:1789117831.963658:0:8833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593230080 00000100:00100000:2.0:1789117831.963683:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789117831.963693:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876025593229952:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789117831.963721:0:8833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f758 00000100:00080000:2.0:1789117831.963730:0:8833:0:(import.c:65:import_set_state_nolock()) ffff962bbf942000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789117831.963773:0:8833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1789117831.963912:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3643:x1876025593229952:12345-0@lo:9:umount.0 Request processed in 220us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117831.963920:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789117831.963935:0:8833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789117831.963940:0:8833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876025593230080:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789117831.963950:0:8833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f89a 00000100:00080000:2.0:1789117831.963963:0:8833:0:(import.c:65:import_set_state_nolock()) ffff962a87e9e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789117831.963981:0:8833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1789117831.964084:0:8833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3643:x1876025593230080:12345-0@lo:9:umount.0 Request processed in 143us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117831.964090:0:8833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1789117831.964115:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789117831.964228:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117831.964233:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789117831.964256:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbf97c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789117831.964269:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789117831.964272:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789117831.964276:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593229952:0@lo:9:umount.0 00000100:00080000:0.0:1789117831.964285:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a87895000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789117831.964292:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789117831.964293:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789117831.964295:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593230080:0@lo:9:umount.0 00000100:00080000:2.0:1789117831.964521:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117831.964659:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87faa940 x1876025593230336/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789117831.964730:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7945443b-b7e4-4157-aee9-c9b2172613e6:3643:1876025593230336:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1789117831.964759:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876025593230336 offset 0 length 520: 4 00000100:00100000:0.0:1789117831.964809:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7945443b-b7e4-4157-aee9-c9b2172613e6:3645:1876025593229568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789117831.964821:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:0.0:1789117831.964827:0:3645:0:(client.c:1394:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff962bc1a761c0 x1876025593230208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117831.964841:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:0:1876025593230208:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789117831.965030:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789117831.965034:0:3644:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff962bae542800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:1.0:1789117831.965044:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7945443b-b7e4-4157-aee9-c9b2172613e6:3644:1876025593229440:0@lo:103:ldlm_bl.0 00000400:00000100:3.0:1789117831.976373:0:9524:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1876025593229312 offset 224 length 224: 4 00000100:00100000:3.0:1789117831.976399:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0718780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3647:x1876025593229312:12345-0@lo:103:ldlm_bl.0 Request processed in 35201us (35352us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789117831.976412:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000020:00080000:2.0:1789117831.982169:0:16009:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff962bbd2b1a48) has no exports 00000020:01000000:0.0:1789117832.053838:0:16009:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff962bbf656780 - data ffff962b9cb70af8/ffff962a87e6e000 00000020:01000000:0.0:1789117832.053997:0:16009:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff962b8e9e8a20 - data ffff962b9c9f7af8/ffff962b90bd0000 00000001:00000004:0.0:1789117832.064621:0:16009:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1789117832.128916:0:16009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789117832.128925:0:16009:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1789117832.128935:0:16009:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789117832.133278:0:16009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789117832.133287:0:16009:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:3.0:1789117832.133306:0:16009:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789117832.133308:0:16009:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789117832.134872:0:8826:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789117832.134879:0:8826:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1789117832.135197:0:8826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789117832.144700:0:16009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789117832.144709:0:16009:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:3.0:1789117832.144730:0:16009:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789117832.144733:0:16009:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789117832.145107:0:9916:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789117832.145112:0:9916:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1789117832.145302:0:9916:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1789117832.154107:0:16009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f575 00000020:00000080:3.0:1789117832.154121:0:16009:0:(genops.c:885:class_export_put()) final put ffff962b8e277000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789117832.154585:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962b8e277000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789117832.158691:0:16009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f58a 00000020:00000080:3.0:1789117832.158704:0:16009:0:(genops.c:885:class_export_put()) final put ffff962bb5c83800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789117832.158721:0:16009:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1789117832.158725:0:16009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789117832.158733:0:16009:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789117832.158738:0:16009:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff962b8802b490) has no exports 00000004:01000000:3.0:1789117832.158905:0:16009:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789117832.158912:0:16009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f893 00000020:00000080:3.0:1789117832.158917:0:16009:0:(genops.c:885:class_export_put()) final put ffff962bc1aeb000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789117832.158921:0:16009:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789117832.158924:0:16009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789117832.158930:0:16009:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789117832.158932:0:16009:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff962a878a8000) has no exports 00000020:00000080:3.0:1789117832.158938:0:16009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f88c 00000020:00000080:3.0:1789117832.158949:0:16009:0:(genops.c:885:class_export_put()) final put ffff962a87896800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789117832.159086:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962bb5c83800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1789117832.159097:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962bc1aeb000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789117832.159101:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962a87896800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1789117832.163349:0:16009:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789117832.163358:0:16009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789117832.163362:0:16009:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1789117832.163499:0:16009:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789117832.163502:0:16009:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789117832.163553:0:16009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789117832.163628:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a87895000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1789117832.164076:0:16009:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789117832.164085:0:16009:0:(genops.c:885:class_export_put()) final put ffff962a87895800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789117832.164090:0:16009:0:(genops.c:844:class_export_destroy()) destroying export ffff962a87895800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1789117832.164097:0:16009:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789117832.164225:0:16009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f751 00000020:00000080:3.0:1789117832.164234:0:16009:0:(genops.c:885:class_export_put()) final put ffff962bbf979800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789117832.164248:0:16009:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789117832.164254:0:16009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789117832.164263:0:16009:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789117832.164267:0:16009:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff962bbcdd9a48) has no exports 00000020:00000080:3.0:1789117832.164274:0:16009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f74a 00000020:00000080:3.0:1789117832.164277:0:16009:0:(genops.c:885:class_export_put()) final put ffff962bbf978000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789117832.164769:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf979800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789117832.164781:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf978000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1789117832.166968:0:16009:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789117832.166977:0:16009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789117832.166981:0:16009:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1789117832.166989:0:16009:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789117832.166991:0:16009:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789117832.167085:0:16009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789117832.167100:0:16009:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1789117832.167121:0:16009:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789117832.167131:0:16009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f5ad 00000020:00000080:3.0:1789117832.167144:0:16009:0:(genops.c:885:class_export_put()) final put ffff962bbcfec000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789117832.167151:0:16009:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1789117832.167157:0:16009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789117832.167173:0:16009:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789117832.167177:0:16009:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff962bbf36ced8) has no exports 00000020:00000080:3.0:1789117832.167185:0:16009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f5a6 00000020:00000080:3.0:1789117832.167189:0:16009:0:(genops.c:885:class_export_put()) final put ffff962bbf322000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789117832.168381:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bbf97c800 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789117832.168395:0:37:0:(genops.c:885:class_export_put()) final put ffff962bbd043000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789117832.168399:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbd043000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1789117832.168410:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789117832.168517:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbcfec000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789117832.168528:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf322000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789117832.175262:0:16009:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789117832.175283:0:16009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789117832.175287:0:16009:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789117832.175295:0:16009:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789117832.175357:0:16009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789117832.175370:0:16009:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789117832.175395:0:16009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789117832.175398:0:16009:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789117832.175405:0:16009:0:(genops.c:885:class_export_put()) final put ffff962bbcf24800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789117832.175410:0:16009:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbcf24800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789117832.175418:0:16009:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789117832.175567:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bbf321000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789117832.175576:0:37:0:(genops.c:885:class_export_put()) final put ffff962bbf326800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789117832.175578:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf326800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1789117832.175586:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789117832.175791:0:16009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f591 00000020:00000080:0.0:1789117832.175798:0:16009:0:(genops.c:885:class_export_put()) final put ffff962bb5c87000/lustre-MDD0001_UUID 00000020:01000000:0.0:1789117832.175809:0:16009:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789117832.175824:0:16009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789117832.175829:0:16009:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789117832.175832:0:16009:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff962bbd2b0000) has no exports 00000020:00000080:0.0:1789117832.175861:0:16009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789117832.175865:0:16009:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789117832.175869:0:16009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f598 00000020:00000080:0.0:1789117832.175873:0:16009:0:(genops.c:885:class_export_put()) final put ffff962bb5c83000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789117832.175882:0:16009:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962bbcf27000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789117832.175885:0:16009:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962bbcf27000 2 00000020:01000004:0.0:1789117832.175888:0:16009:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff962bbcf27000 from lustre-MDT0001 00000020:00000080:0.0:1789117832.175905:0:16009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789117832.175908:0:16009:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789117832.175910:0:16009:0:(genops.c:885:class_export_put()) final put ffff962b8e277800/lustre-MDT0001_UUID 00000020:00000080:0.0:1789117832.175912:0:16009:0:(genops.c:844:class_export_destroy()) destroying export ffff962b8e277800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789117832.175918:0:16009:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789117832.175946:0:16009:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789117832.175950:0:16009:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789117832.175952:0:16009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789117832.175960:0:16009:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789117832.175967:0:16009:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff962bbd047800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789117832.175972:0:16009:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff962bbd2b4ed8) has exports, disconnecting them 00000020:00080000:0.0:1789117832.175977:0:16009:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff962bbd047800), last request at 1789117535 00000020:00000080:0.0:1789117832.175981:0:16009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f5ec 00000020:00080000:0.0:1789117832.175992:0:16009:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962bbd047800): rc 0 00000020:00000080:0.0:1789117832.175995:0:16009:0:(genops.c:885:class_export_put()) final put ffff962bbd047800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789117832.177093:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962bb5c87000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1789117832.177102:0:37:0:(genops.c:885:class_export_put()) final put ffff962bbcf22000/lustre-MDD0001_UUID 00000020:00000080:1.0:1789117832.177104:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbcf22000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1789117832.177109:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1789117832.177376:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962bb5c83000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789117832.177381:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbd047800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1789117832.230135:0:16009:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1789117832.230144:0:16009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789117832.230149:0:16009:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789117832.230156:0:16009:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789117832.230197:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bbf4b5800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789117832.230389:0:16009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789117832.230400:0:16009:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1789117832.230408:0:16009:0:(genops.c:885:class_export_put()) final put ffff962bbf4b1000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1789117832.230411:0:16009:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf4b1000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1789117832.230424:0:16009:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1789117832.230504:0:16009:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962bbcf27000 1 00000020:00000080:1.0:1789117832.230511:0:16009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f528 00000020:00000080:1.0:1789117832.230516:0:16009:0:(genops.c:885:class_export_put()) final put ffff962bbcfec800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1789117832.230525:0:16009:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1789117832.230545:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbcfec800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789117832.230555:0:16009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789117832.230560:0:16009:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789117832.230564:0:16009:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff962bbcddb490) has no exports 00010000:00010000:0.0:1789117832.359201:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789117832.438893:0:16009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789117832.438910:0:16009:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1789117832.438916:0:16009:0:(genops.c:885:class_export_put()) final put ffff962bbd04b000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789117832.438922:0:16009:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbd04b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1789117832.438932:0:16009:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1789117832.439190:0:16009:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff962bbd04d000 00000020:01000000:3.0:1789117832.439212:0:16009:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789117832.439217:0:16009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789117832.439221:0:16009:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789117832.439225:0:16009:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff962bb082ced8) has no exports 00000100:00100000:0.0:1789117832.442151:0:6520:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff962bb5d51600:6520] 1 exiting: rc = 0 00000100:00100000:2.0:1789117832.444242:0:6519:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff962bb5c61c00:6519] 0 exiting: rc = 1 00000100:00100000:2.0:1789117832.444583:0:14247:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff962a88591400:14247] 4 exiting: rc = 0 00000100:00100000:1.0:1789117832.445221:0:6521:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff962bb5d51800:6521] 2 exiting: rc = 0 00000100:00100000:3.0:1789117832.449094:0:9533:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff962a87b13e00:9533] 3 exiting: rc = 0 00000100:00100000:2.0:1789117832.449285:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449295:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449301:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449307:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449323:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449330:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449335:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449341:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449346:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449352:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449358:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449363:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449376:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449383:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449389:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449394:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449399:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449405:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449411:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449417:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449455:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449462:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449468:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449659:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449667:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449673:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449679:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449686:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449690:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449696:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449702:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449708:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449713:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449718:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449722:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449728:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449733:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449737:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449743:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449749:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449755:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449760:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449766:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449772:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449778:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449785:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449791:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449797:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449802:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449807:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449812:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449818:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449824:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449829:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449834:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449848:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449855:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449860:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449864:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449870:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449875:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449879:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449884:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.449889:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117832.482114:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff962bb5d50000:6523] 1 exiting: rc = 0 00000100:00100000:3.0:1789117832.485337:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff962bb5d50e00:6522] 0 exiting: rc = 1 00000100:00100000:2.0:1789117832.487287:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487299:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487306:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487325:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487332:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487350:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487358:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487364:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487380:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487387:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487392:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487399:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487405:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487410:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487415:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487421:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487425:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487430:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487436:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487441:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487446:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487451:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487457:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487462:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487467:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487472:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487493:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487498:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487503:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487508:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487514:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487520:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487525:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487529:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487534:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487539:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487544:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487549:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487554:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487559:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487564:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487568:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487573:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487580:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487585:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487590:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487595:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487600:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487605:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487610:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487614:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487631:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487636:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487641:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487646:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487650:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487655:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487660:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487665:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487670:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487675:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487687:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487692:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.487698:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.488210:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff962bb1c12600:6525] 1 exiting: rc = 0 00000100:00100000:1.0:1789117832.488480:0:14928:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff962b87cba400:14928] 2 exiting: rc = 0 00000100:00100000:0.0:1789117832.488824:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff962bb1c12400:6524] 0 exiting: rc = 1 00000100:00100000:2.0:1789117832.489224:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.489240:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.489248:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.489254:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.489260:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.489265:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.489270:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.489276:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.489282:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.489288:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.489293:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.489299:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.489330:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.489337:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.489343:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.489348:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.489354:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.489360:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.489367:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.489372:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490287:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490297:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490303:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490318:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490342:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490349:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490355:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490360:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490377:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490384:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490389:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490406:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490412:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490418:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490424:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490429:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490451:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490459:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490465:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490470:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490476:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490481:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490486:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490492:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490497:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490503:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490508:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490515:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490536:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490542:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490547:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490554:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490559:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490565:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490571:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490576:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490582:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490587:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490593:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490598:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490616:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490636:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.490642:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.491565:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117832.531731:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff962b988cc800:6526] 0 exiting: rc = 1 00000100:00100000:3.0:1789117832.532234:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff962bb0bdfe00:6527] 1 exiting: rc = 0 00000100:00100000:1.0:1789117832.532336:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532343:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532348:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532353:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532358:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532363:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532368:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532373:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532377:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532381:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532386:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532406:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532411:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532416:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532421:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532426:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532431:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532436:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532440:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532446:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532451:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532456:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532461:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532466:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532470:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532474:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532481:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532486:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532491:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532496:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532501:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532507:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532511:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532516:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532522:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532527:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532532:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532537:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532542:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532546:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532551:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532555:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532560:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532565:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532569:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532574:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532587:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532592:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532597:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532601:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532606:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532612:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532617:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532621:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532626:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532630:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532635:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532639:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532657:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532664:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532669:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532674:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532679:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.532684:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117832.533102:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff962bb0bdee00:6528] 0 exiting: rc = 1 00000100:00100000:3.0:1789117832.533163:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff962bb0bdf600:6529] 1 exiting: rc = 0 00000100:00100000:1.0:1789117832.533337:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533344:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533349:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533354:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533358:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533363:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533368:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533372:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533377:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533382:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533386:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533391:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533396:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533401:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533406:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533411:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533416:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533431:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533436:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533441:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533445:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533450:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533455:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533460:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533464:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533468:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533473:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533478:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533482:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533487:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533491:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533496:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533500:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533504:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533509:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533513:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533518:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533523:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533528:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533533:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533538:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533542:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533546:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533551:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533556:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533560:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533565:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533571:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533575:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533581:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533585:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533589:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533602:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533607:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533611:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533616:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533620:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533624:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533629:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533633:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533638:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533643:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533846:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.533853:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.534238:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff962bb0bde000:6531] 1 exiting: rc = 0 00000100:00100000:3.0:1789117832.534466:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff962bb0bdec00:6530] 0 exiting: rc = 1 00000100:00100000:1.0:1789117832.534550:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.534556:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.534561:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.534566:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.534572:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.534577:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.534582:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.534588:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.534593:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.534598:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.534603:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.534608:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.534613:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.534618:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.534623:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.534629:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.534635:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.534640:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535285:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535298:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535303:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535384:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535406:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535411:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535416:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535421:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535426:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535430:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535435:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535440:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535445:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535450:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535455:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535460:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535465:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535471:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535476:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535481:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535486:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535491:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535496:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535501:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535506:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535511:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535516:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535520:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535525:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535530:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535535:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535540:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535545:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535549:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535554:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535559:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535564:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535568:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535573:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535584:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535588:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535593:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535598:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535602:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535607:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.535613:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117832.542978:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff962bb1c18400:6534] 2 exiting: rc = 0 00000100:00100000:3.0:1789117832.543619:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff962bb1c19e00:6532] 0 exiting: rc = 1 00000100:00100000:0.0:1789117832.549269:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff962bb1c19c00:6533] 1 exiting: rc = 0 00000100:00100000:1.0:1789117832.549438:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549447:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549453:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549458:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549474:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549480:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549486:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549492:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549497:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549502:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549508:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549513:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549520:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549541:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549547:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549553:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549558:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549563:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549569:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549574:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549580:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549586:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549593:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549599:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549604:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549608:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549613:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549618:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549638:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549655:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549663:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549669:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549674:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549679:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549684:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549689:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549694:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549715:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549722:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549727:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549732:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549738:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549743:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549749:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549755:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549760:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549765:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549771:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549776:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549781:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549787:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549793:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549798:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549804:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549810:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549816:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549821:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549826:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549832:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549837:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549843:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549849:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549854:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117832.549867:0:16009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:2.0:1789117832.550124:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789117832.550135:0:14597:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789117832.550139:0:14597:0:(import.c:65:import_set_state_nolock()) ffff962a86831000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789117832.550145:0:14597:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 479 00000100:00080000:2.0:1789117832.550151:0:14597:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789117832.550157:0:14597:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff962a86831000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789117832.550195:0:14597:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbfd17480 x1876025593230464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789117832.550250:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789117832.550254:0:14597:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789117832.550256:0:14597:0:(import.c:65:import_set_state_nolock()) ffff962bbf941000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789117832.550259:0:14597:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 479 00000100:00080000:2.0:1789117832.550262:0:14597:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789117832.550266:0:14597:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff962bbf941000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789117832.550277:0:14597:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbfd14780 x1876025593230720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789117832.550337:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593230848:0@lo:400:kworker.0 00000400:00000100:2.0:1789117832.550389:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876025593230848 offset 0 length 224: 4 00000100:00100000:3.0:1789117832.550564:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876025593230464:0@lo:38:kworker.0 00000400:00000100:3.0:1789117832.550592:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876025593230464 offset 0 length 520: 4 00000100:00100000:3.0:1789117832.550607:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876025593230720:0@lo:38:kworker.0 00000400:00000100:3.0:1789117832.550622:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876025593230720 offset 0 length 520: 4 00000100:00100000:0.0:1789117832.551227:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593230592:0@lo:400:kworker.0 00000400:00000100:0.0:1789117832.551259:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876025593230592 offset 0 length 224: 4 00000020:00000080:0.0:1789117832.564110:0:16009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789117832.564122:0:16009:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789117832.564128:0:16009:0:(genops.c:885:class_export_put()) final put ffff962bb5c81000/MDS_uuid 00000020:00000080:0.0:1789117832.564132:0:16009:0:(genops.c:844:class_export_destroy()) destroying export ffff962bb5c81000/MDS_uuid for MDS 00000020:01000000:0.0:1789117832.564138:0:16009:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789117832.564281:0:16009:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1789117833.387862:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117834.406284:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117835.430828:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117836.460753:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117837.477962:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789117837.675275:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7945443b-b7e4-4157-aee9-c9b2172613e6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789117837.675284:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7945443b-b7e4-4157-aee9-c9b2172613e6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789117837.675303:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789117837.675306:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789117837.675353:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789117837.675356:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789117837.675391:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117837.675408:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0718b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593230976:0@lo:400:kworker.0 00000400:00000100:3.0:1789117837.675456:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876025593230976 offset 0 length 224: 4 00000100:00100000:3.0:1789117837.675511:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789117837.675550:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0718780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593231104:0@lo:400:kworker.0 00000400:00000100:3.0:1789117837.675567:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876025593231104 offset 0 length 224: 4 00000001:00100000:1.0:1789117837.689683:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789117837.689695:0:8429:0:(genops.c:885:class_export_put()) final put ffff962bbf941800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789117837.690111:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf941800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789117837.690169:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bbf942000 for lustre-OST0000 00000001:00100000:0.0:1789117837.700960:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789117837.700971:0:9514:0:(genops.c:885:class_export_put()) final put ffff962a87e99800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789117837.701741:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962a87e99800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789117837.701906:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a87e9e000 for lustre-OST0001 00000020:01000004:0.0:1789117838.227995:0:16210:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1789117838.250488:0:16210:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789117838.250544:0:16210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f973 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f97a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117838.250572:0:16210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f973 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f97a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117838.250581:0:16210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f973 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1f97a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117838.250587:0:16210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f973 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1f97a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117838.250651:0:16210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789117838.250658:0:16210:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789117838.250683:0:16210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789117838.250695:0:16210:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962bbfd17480 x1876025593230464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789117852 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117838.250717:0:16210:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789117838.250723:0:16210:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789117838.250730:0:16210:0:(import.c:65:import_set_state_nolock()) ffff962a86831000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789117838.250734:0:16210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789117838.250737:0:16210:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962bbfd17480 x1876025593230464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789117852 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117838.250744:0:16210:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789117838.250746:0:16210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:3.0:1789117838.250811:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876025593230464:0@lo:38:kworker.0 00000100:00080000:0.0:1789117838.251931:0:16210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789117838.251944:0:16210:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962bbfd16940 x1876025593230592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117848 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117838.252025:0:16210:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962ba0718b40 x1876025593230976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117853 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117838.252094:0:16210:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789117838.252099:0:16210:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789117838.252122:0:16210:0:(import.c:65:import_set_state_nolock()) ffff962bc1a2b000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789117838.252213:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0718b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593230976:0@lo:400:kworker.0 00010000:00010000:2.0:1789117838.252285:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117838.252293:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f973 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1f97a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117838.252311:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9b800 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:2.0:1789117838.252314:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f973 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1f97a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117838.252447:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f973 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be1f97a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117838.252464:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f973 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be1f97a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117838.252470:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789117838.252472:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789117838.252476:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789117838.252489:0:6508:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff962bae542800 00010000:00010000:2.0:1789117838.252493:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f973 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be1f97a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117838.252500:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be1f973 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be1f97a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117838.252512:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117838.252514:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117838.252515:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117838.252615:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593230592:0@lo:400:kworker.0 00000100:00100000:3.0:1789117838.252642:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876025593231232:0@lo:39:umount.0 00000400:00000100:3.0:1789117838.252690:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876025593231232 offset 0 length 224: 4 00010000:00010000:0.0:1789117838.510258:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117839.525288:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117840.549358:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117841.317239:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789117831/real 1789117831] req@ffff962a87faa940 x1876025593230336/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789117841 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117841.317273:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962a87faa940 x1876025593230336/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789117841 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789117841.317293:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bae542800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789117841.317341:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1789117841.317346:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7945443b-b7e4-4157-aee9-c9b2172613e6:3643:1876025593230336:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:2.0:1789117841.317406:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7945443b-b7e4-4157-aee9-c9b2172613e6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789117841.317412:0:14597:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1789117841.317415:0:14597:0:(import.c:65:import_set_state_nolock()) ffff962bae542800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789117841.317419:0:14597:0:(import.c:510:import_select_connection()) MGC192.168.204.130@tcp: connect to NID 0@lo last attempt 484 00000100:00080000:2.0:1789117841.317424:0:14597:0:(import.c:589:import_select_connection()) MGC192.168.204.130@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789117841.317431:0:14597:0:(import.c:624:import_select_connection()) MGC192.168.204.130@tcp: import ffff962bae542800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789117841.317461:0:14597:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbfd170c0 x1876025593231360/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789117841.317489:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789117841.317493:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789117841.317583:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593231488:0@lo:400:kworker.0 00000400:00000100:0.0:1789117841.317638:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876025593231488 offset 0 length 224: 4 00000100:00100000:3.0:1789117841.317739:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7945443b-b7e4-4157-aee9-c9b2172613e6:3643:1876025593231360:0@lo:250:kworker.0 00000400:00000100:3.0:1789117841.317763:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876025593231360 offset 0 length 520: 4 00010000:00010000:0.0:1789117841.577449:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117842.597992:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117843.621291:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117844.647953:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117845.673512:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789117846.373319:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7945443b-b7e4-4157-aee9-c9b2172613e6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789117846.373330:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7945443b-b7e4-4157-aee9-c9b2172613e6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789117846.373333:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789117846.373336:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789117846.373459:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593231616:0@lo:400:kworker.0 00000400:00000100:1.0:1789117846.373533:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876025593231616 offset 0 length 224: 4 00010000:00010000:2.0:1789117846.693909:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117847.718648:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1789117848.421222:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789117832/real 1789117832] req@ffff962bbfd152c0 x1876025593230848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789117848 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117848.455416:0:3646:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff962bbfd152c0 x1876025593230848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789117848 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789117848.455431:0:3646:0:(import.c:65:import_set_state_nolock()) ffff962bbd041800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789117848.455434:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789117848.466827:0:3646:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:1.0:1789117848.466906:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593230848:0@lo:400:kworker.0 00000100:00080000:2.0:1789117848.467021:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7945443b-b7e4-4157-aee9-c9b2172613e6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789117848.467027:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7945443b-b7e4-4157-aee9-c9b2172613e6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789117848.467030:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789117848.467034:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789117848.467036:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789117848.467039:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789117848.467042:0:37:0:(import.c:65:import_set_state_nolock()) ffff962bbd041800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789117848.467049:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 240 00000100:00080000:2.0:1789117848.467083:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff962bbd041800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789117848.467129:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbfd15e00 x1876025593231744/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789117848.467234:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789117838/real 1789117838] req@ffff962a87fa8780 x1876025593231232/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789117848 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117848.467259:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962a87fa8780 x1876025593231232/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789117848 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117848.467277:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876025593231744:0@lo:38:kworker.0 00000400:00000100:3.0:1789117848.467622:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876025593231744 offset 0 length 520: 4 00000100:00080000:3.0:1789117848.467717:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bc1a2b000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789117848.467730:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876025593231232:0@lo:39:umount.0 00000100:00080000:0.0:1789117848.467904:0:16210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789117848.467909:0:16210:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789117848.467915:0:16210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789117848.469534:0:16210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9be00/0xaa253ed19be1f981 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f988 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117848.469552:0:16210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9be00/0xaa253ed19be1f981 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f988 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117848.469559:0:16210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9be00/0xaa253ed19be1f981 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1f988 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117848.469581:0:16210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962baea9be00/0xaa253ed19be1f981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1f988 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117848.469618:0:16210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789117848.469626:0:16210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70d600/0xaa253ed19be1fc91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fc98 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117848.469634:0:16210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70d600/0xaa253ed19be1fc91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1fc98 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117848.469641:0:16210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70d600/0xaa253ed19be1fc91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1fc98 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117848.469648:0:16210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962bbf70d600/0xaa253ed19be1fc91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1fc98 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117848.469672:0:16210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789117848.469678:0:16210:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789117848.469714:0:16210:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789117848.469719:0:16210:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789117848.469723:0:16210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789117848.469729:0:16210:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789117848.469733:0:16210:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff962bbfac8000) has no exports 00000020:00080000:0.0:1789117848.469966:0:16210:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff962bbfac8000) has no exports 00010000:00010000:2.0:1789117848.475529:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789117848.475546:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962baea9be00/0xaa253ed19be1f981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1f988 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117848.475559:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9be00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:2.0:1789117848.475563:0:9523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962baea9be00/0xaa253ed19be1f981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1f988 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117848.475575:0:9523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962baea9be00/0xaa253ed19be1f981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be1f988 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117848.475581:0:9523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962baea9be00/0xaa253ed19be1f981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be1f988 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117848.475610:0:9523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789117848.475613:0:9523:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1789117848.475616:0:9523:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1789117848.475639:0:9523:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff962bae542800 00010000:00010000:2.0:1789117848.475644:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962baea9be00/0xaa253ed19be1f981 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be1f988 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117848.475651:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962baea9be00/0xaa253ed19be1f981 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be1f988 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117848.475668:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117848.475672:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bbf70d600/0xaa253ed19be1fc91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1fc98 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117848.475679:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d600 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:2.0:1789117848.475682:0:9523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70d600/0xaa253ed19be1fc91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1fc98 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117848.475699:0:9523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bbf70d600/0xaa253ed19be1fc91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be1fc98 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117848.475706:0:9523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70d600/0xaa253ed19be1fc91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be1fc98 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117848.475711:0:9523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789117848.475713:0:9523:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789117848.475716:0:9523:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789117848.475721:0:9523:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff962bae542800 00010000:00010000:2.0:1789117848.475724:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bbf70d600/0xaa253ed19be1fc91 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be1fc98 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117848.475744:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bbf70d600/0xaa253ed19be1fc91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be1fc98 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117848.475755:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117848.475759:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117848.475761:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117848.475766:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789117848.476438:0:16210:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff962bbf656960 - data ffff962a860c5438/ffff962a87e6c800 00000020:01000000:0.0:1789117848.476596:0:16210:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff962bbfa92480 - data ffff962b9caa8798/ffff962a8680d000 00100000:10000000:0.0:1789117848.490378:0:16210:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789117848.501789:0:16210:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f6c5 00000020:00000080:2.0:1789117848.501801:0:16210:0:(genops.c:885:class_export_put()) final put ffff962a86832000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789117848.501823:0:16210:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962bbf4b3000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789117848.501826:0:16210:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962bbf4b3000 2 00000020:01000004:2.0:1789117848.501829:0:16210:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff962bbf4b3000 from lustre-OST0000 00000020:00000080:2.0:1789117848.501853:0:16210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789117848.501928:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962a86832000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789117848.501957:0:16210:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789117848.501961:0:16210:0:(genops.c:885:class_export_put()) final put ffff962bbf4b4800/lustre-OST0000_UUID 00000020:00000080:2.0:1789117848.501963:0:16210:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf4b4800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789117848.501970:0:16210:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789117848.502019:0:16210:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789117848.502023:0:16210:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789117848.502026:0:16210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789117848.502030:0:16210:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789117848.502037:0:16210:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff962a86831800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789117848.502043:0:16210:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff962bbfacced8) has exports, disconnecting them 00000020:00080000:2.0:1789117848.502047:0:16210:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff962a86831800), last request at 1789117560 00000020:00000080:2.0:1789117848.502076:0:16210:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f6ef 00000020:00080000:2.0:1789117848.502084:0:16210:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962a86831800): rc 0 00000020:00000080:2.0:1789117848.502089:0:16210:0:(genops.c:885:class_export_put()) final put ffff962a86831800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789117848.502291:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962a86831800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1789117848.504343:0:16210:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789117848.504351:0:16210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789117848.504356:0:16210:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789117848.504363:0:16210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789117848.504556:0:16210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789117848.504565:0:16210:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1789117848.504573:0:16210:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789117848.504580:0:16210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789117848.504585:0:16210:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789117848.504593:0:16210:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff962bc1a28000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789117848.504599:0:16210:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff962bbfacb490) has exports, disconnecting them 00000020:00080000:3.0:1789117848.504604:0:16210:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff962bc1a28000), last request at 1789117560 00000020:00000080:3.0:1789117848.504621:0:16210:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f704 00000020:00080000:3.0:1789117848.504637:0:16210:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962bc1a28000): rc 0 00000020:00000080:3.0:1789117848.504642:0:16210:0:(genops.c:885:class_export_put()) final put ffff962bc1a28000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789117848.505590:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a86831000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789117848.505603:0:37:0:(genops.c:885:class_export_put()) final put ffff962a86836800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789117848.505606:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962a86836800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789117848.505613:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789117848.505679:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962bc1a28000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1789117848.612779:0:16210:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789117848.612789:0:16210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789117848.612803:0:16210:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789117848.612810:0:16210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789117848.613016:0:16210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789117848.613024:0:16210:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1789117848.613030:0:16210:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962bbf4b3000 1 00000020:00000080:2.0:1789117848.613036:0:16210:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f68d 00000020:00000080:2.0:1789117848.613044:0:16210:0:(genops.c:885:class_export_put()) final put ffff962bbf8f0800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789117848.613049:0:16210:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789117848.613083:0:16210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789117848.613087:0:16210:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789117848.613090:0:16210:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff962bbd2b3490) has no exports 00000020:00000080:1.0:1789117848.613096:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bc1a2b000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789117848.613104:0:37:0:(genops.c:885:class_export_put()) final put ffff962a86830800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1789117848.613112:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962a86830800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1789117848.613124:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1789117848.613196:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf8f0800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789117848.718602:0:16210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789117848.718626:0:16210:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789117848.718634:0:16210:0:(genops.c:885:class_export_put()) final put ffff962bbf4b4000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789117848.718641:0:16210:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf4b4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789117848.718657:0:16210:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789117848.718798:0:16210:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff962bbf4b2800 00000020:02000400:1.0:1789117848.718852:0:16210:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1789117848.744519:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117849.783429:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117850.789997:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117851.814771:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117852.581246:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789117832/real 1789117832] req@ffff962bbfd14780 x1876025593230720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789117852 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117852.581279:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962bbfd14780 x1876025593230720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789117852 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789117852.581299:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbf941000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789117852.581327:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789117852.581331:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876025593230720:0@lo:38:kworker.0 00000100:00080000:3.0:1789117852.581431:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7945443b-b7e4-4157-aee9-c9b2172613e6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789117852.581436:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7945443b-b7e4-4157-aee9-c9b2172613e6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789117852.581439:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789117852.581442:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789117852.581445:0:37:0:(import.c:65:import_set_state_nolock()) ffff962bbf941000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789117852.581450:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 484 00000100:00080000:3.0:1789117852.581456:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789117852.581463:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff962bbf941000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789117852.581502:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962ba0718f00 x1876025593231872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789117852.581532:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789117852.581536:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789117852.581702:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0718f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876025593231872:0@lo:38:kworker.0 00000400:00000100:0.0:1789117852.581767:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876025593231872 offset 0 length 520: 4 00010000:00010000:2.0:1789117852.837342:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789117853.068686:0:16412:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1789117853.089825:0:16412:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789117853.089917:0:16412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f957 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f95e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117853.089932:0:16412:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f957 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f95e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117853.089938:0:16412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f957 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1f95e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117853.089945:0:16412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f957 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1f95e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117853.089967:0:16412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789117853.089975:0:16412:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789117853.090010:0:16412:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789117853.090029:0:16412:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962ba0718f00 x1876025593231872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789117877 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117853.090106:0:16412:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789117853.090114:0:16412:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789117853.090121:0:16412:0:(import.c:65:import_set_state_nolock()) ffff962bbf941000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789117853.090126:0:16412:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789117853.090131:0:16412:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962ba0718f00 x1876025593231872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789117877 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117853.090138:0:16412:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789117853.090141:0:16412:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 32s for inflight to error out 00000100:00100000:1.0:1789117853.090246:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0718f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876025593231872:0@lo:38:kworker.0 00000100:00080000:0.0:1789117853.091263:0:16412:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789117853.091277:0:16412:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962ba0718780 x1876025593231104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117853 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117853.091308:0:16412:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962bbfd16d00 x1876025593231488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117857 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117853.091317:0:16412:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962a87fab480 x1876025593231616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117862 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117853.091330:0:16412:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962bbfd15e00 x1876025593231744/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789117858 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117853.091339:0:16412:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789117853.091343:0:16412:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789117853.091348:0:16412:0:(import.c:65:import_set_state_nolock()) ffff962bbd041800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789117853.091353:0:16412:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789117853.091357:0:16412:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962ba0718780 x1876025593231104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117853 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117853.091365:0:16412:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962bbfd16d00 x1876025593231488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117857 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117853.091372:0:16412:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962a87fab480 x1876025593231616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117862 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117853.091392:0:16412:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962bbfd15e00 x1876025593231744/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789117858 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117853.091398:0:16412:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789117853.091404:0:16412:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00010000:00010000:3.0:1789117853.091501:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117853.091511:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f957 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1f95e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117853.091521:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9ac00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:3.0:1789117853.091525:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f957 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1f95e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117853.091536:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be1f95e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789117853.091555:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be1f95e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117853.091561:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789117853.091564:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789117853.091567:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789117853.091585:0:6508:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff962bae542800 00010000:00010000:3.0:1789117853.091590:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f957 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be1f95e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117853.091597:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962baea9ac00/0xaa253ed19be1f957 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be1f95e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117853.091624:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117853.091626:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117853.091628:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117853.091709:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593231488:0@lo:400:kworker.0 00000100:00100000:2.0:1789117853.091727:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0718780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593231104:0@lo:400:kworker.0 00000100:00100000:1.0:1789117853.091867:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593231616:0@lo:400:kworker.0 00000100:00100000:1.0:1789117853.091909:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876025593231744:0@lo:38:kworker.0 00010000:00010000:0.0:1789117853.092929:0:16412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9aa00/0xaa253ed19be1f965 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1f96c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117853.092946:0:16412:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9aa00/0xaa253ed19be1f965 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1f96c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117853.092954:0:16412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9aa00/0xaa253ed19be1f965 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1f96c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117853.092962:0:16412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962baea9aa00/0xaa253ed19be1f965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1f96c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117853.095938:0:16412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789117853.096196:0:16412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1fc83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be1fc8a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117853.096212:0:16412:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1fc83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be1fc8a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117853.096219:0:16412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1fc83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1fc8a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117853.096226:0:16412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1fc83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be1fc8a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117853.098679:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789117853.098703:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962baea9aa00/0xaa253ed19be1f965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1f96c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117853.098719:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9aa00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:2.0:1789117853.098723:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962baea9aa00/0xaa253ed19be1f965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1f96c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117853.098737:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962baea9aa00/0xaa253ed19be1f965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be1f96c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117853.098745:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962baea9aa00/0xaa253ed19be1f965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be1f96c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117853.098792:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789117853.098796:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1789117853.098819:0:6507:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff962bae542800 00010000:00010000:2.0:1789117853.098824:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962baea9aa00/0xaa253ed19be1f965 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be1f96c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117853.098832:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962baea9aa00/0xaa253ed19be1f965 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be1f96c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117853.098859:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117853.098864:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1fc83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1fc8a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117853.098870:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d400 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:2.0:1789117853.098873:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1fc83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be1fc8a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117853.098880:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1fc83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be1fc8a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117853.098887:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1fc83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be1fc8a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117853.098892:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789117853.098894:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1789117853.098899:0:6507:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff962bae542800 00010000:00010000:2.0:1789117853.098901:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1fc83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be1fc8a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117853.098922:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117853.098925:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117853.098927:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117853.099617:0:16412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789117853.099635:0:16412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bbf70d400/0xaa253ed19be1fc83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be1fc8a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117853.099654:0:16412:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1789117853.099660:0:16412:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1789117853.099673:0:16412:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1789117853.099721:0:16412:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1789117853.099727:0:16412:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:2.0:1789117853.100399:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789117853.100466:0:16412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789117853.100478:0:16412:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789117853.100483:0:16412:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff962a878a9a48) has no exports 00000020:00080000:3.0:1789117853.100753:0:16412:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff962a878a9a48) has no exports 00000020:01000000:3.0:1789117853.105469:0:16412:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff962a86dec3c0 - data ffff962b9cb5b288/ffff962bbfa2f400 00000020:01000000:3.0:1789117853.105757:0:16412:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff962a87cebea0 - data ffff962b9c9bf288/ffff962bbf7fe000 00100000:10000000:2.0:1789117853.121833:0:16412:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789117853.139374:0:16412:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f7eb 00000020:00000080:3.0:1789117853.139393:0:16412:0:(genops.c:885:class_export_put()) final put ffff962a87893800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1789117853.139414:0:16412:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962b872f5000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1789117853.139417:0:16412:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962b872f5000 2 00000020:01000004:3.0:1789117853.139420:0:16412:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff962b872f5000 from lustre-OST0001 00000020:00000080:3.0:1789117853.139452:0:16412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789117853.139480:0:16412:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1789117853.139483:0:16412:0:(genops.c:885:class_export_put()) final put ffff962a87891800/lustre-OST0001_UUID 00000020:00000080:3.0:1789117853.139486:0:16412:0:(genops.c:844:class_export_destroy()) destroying export ffff962a87891800/lustre-OST0001_UUID for lustre-OST0001 00000020:00000080:0.0:1789117853.139488:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962a87893800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789117853.139494:0:16412:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1789117853.142337:0:16412:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 7945443b-b7e4-4157-aee9-c9b2172613e6->MGS 00010000:00010000:3.0:1789117853.142554:0:16412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bbbc10800/0xaa253ed19be1f544 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be1f54b expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789117853.142759:0:16412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bbbc10800/0xaa253ed19be1f544 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be1f54b expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117853.142931:0:16412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1789117853.142950:0:16412:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1789117853.142954:0:16412:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1789117853.142974:0:16412:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff962bae542800 00010000:00010000:3.0:1789117853.142978:0:16412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bbbc10800/0xaa253ed19be1f544 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be1f54b expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117853.143001:0:16412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b89b68200/0xaa253ed19be1f9c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be1f9ce expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789117853.143008:0:16412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b89b68200/0xaa253ed19be1f9c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be1f9ce expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117853.143012:0:16412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789117853.143014:0:16412:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1789117853.143021:0:16412:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1789117853.143999:0:16412:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff962bae542800 00010000:00010000:3.0:1789117853.144007:0:16412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b89b68200/0xaa253ed19be1f9c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be1f9ce expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789117853.144037:0:16412:0:(import.c:65:import_set_state_nolock()) ffff962bae542800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1789117853.144042:0:16412:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789117853.144045:0:16412:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789117853.144046:0:16412:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789117853.144169:0:16412:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789117853.144182:0:16412:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962bbfd170c0 x1876025593231360/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789117856 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789117853.144362:0:16412:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789117853.144366:0:16412:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:1.0:1789117853.145352:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7945443b-b7e4-4157-aee9-c9b2172613e6:3643:1876025593231360:0@lo:250:kworker.0 10000000:01000000:3.0:1789117853.145420:0:16412:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789117853.145433:0:16412:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f441 00000020:00000080:3.0:1789117853.145443:0:16412:0:(genops.c:885:class_export_put()) final put ffff962bb5c82000/7945443b-b7e4-4157-aee9-c9b2172613e6 00000020:01000000:3.0:1789117853.145462:0:16412:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.130@tcp (flags='') 00000020:00000080:0.0:1789117853.145481:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962bb5c82000/7945443b-b7e4-4157-aee9-c9b2172613e6 for MGC192.168.204.130@tcp 00000020:00000080:3.0:1789117853.145483:0:16412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789117853.145494:0:16412:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.130@tcp: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789117853.145500:0:16412:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff962b88028000) has no exports 10000000:01000000:3.0:1789117853.145520:0:6517:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1789117853.145736:0:16412:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.130@tcp: client import never connected 00000100:00080000:3.0:1789117853.145740:0:16412:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1789117853.145742:0:16412:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789117853.145748:0:16412:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1789117853.145750:0:16412:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789117853.145983:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bae542800 for MGC192.168.204.130@tcp 00000020:00000080:3.0:1789117853.146049:0:16412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789117853.146079:0:16412:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.130@tcp (uuid 7945443b-b7e4-4157-aee9-c9b2172613e6) 00000020:00000080:3.0:1789117853.146082:0:16412:0:(genops.c:885:class_export_put()) final put ffff962bae541000/7945443b-b7e4-4157-aee9-c9b2172613e6 00000020:00000080:3.0:1789117853.146085:0:16412:0:(genops.c:844:class_export_destroy()) destroying export ffff962bae541000/7945443b-b7e4-4157-aee9-c9b2172613e6 for MGC192.168.204.130@tcp 00000020:01000000:3.0:1789117853.146090:0:16412:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.130@tcp (7945443b-b7e4-4157-aee9-c9b2172613e6) 00000020:01000000:3.0:1789117853.147199:0:16412:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789117853.147206:0:16412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789117853.147211:0:16412:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789117853.147218:0:16412:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff962bbf945000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789117853.147224:0:16412:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff962bbf369a48) has exports, disconnecting them 00000020:00080000:3.0:1789117853.147228:0:16412:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff962bbf945000), last request at 1789117588 00000020:00000080:3.0:1789117853.147233:0:16412:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f815 00000020:00080000:3.0:1789117853.147247:0:16412:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962bbf945000): rc 0 00000020:00000080:3.0:1789117853.147251:0:16412:0:(genops.c:885:class_export_put()) final put ffff962bbf945000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789117853.147337:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf945000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789117853.150259:0:16412:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789117853.150269:0:16412:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789117853.150273:0:16412:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789117853.150282:0:16412:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789117853.150367:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bbf941000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789117853.150520:0:16412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789117853.150529:0:16412:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1789117853.150536:0:16412:0:(genops.c:885:class_export_put()) final put ffff962bbcf25800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1789117853.150553:0:16412:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbcf25800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1789117853.150560:0:16412:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1789117853.150806:0:16412:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789117853.150811:0:16412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789117853.150817:0:16412:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789117853.150826:0:16412:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff962bbf945800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789117853.150832:0:16412:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff962bbf368000) has exports, disconnecting them 00000020:00080000:0.0:1789117853.150837:0:16412:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff962bbf945800), last request at 1789117588 00000020:00000080:0.0:1789117853.150841:0:16412:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f82a 00000020:00080000:0.0:1789117853.150855:0:16412:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962bbf945800): rc 0 00000020:00000080:0.0:1789117853.150859:0:16412:0:(genops.c:885:class_export_put()) final put ffff962bbf945800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1789117853.151045:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf945800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1789117853.154276:0:16412:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789117853.154303:0:16412:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789117853.154310:0:16412:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789117853.154319:0:16412:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789117853.154501:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bbd041800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1789117853.194221:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789117853.194565:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1789117853.194717:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1789117853.194889:0:6503:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff962bb5c23e00:6503] 1 exiting: rc = 0 00000100:00100000:2.0:1789117853.195084:0:6502:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff962bb5d4a800:6502] 0 exiting: rc = 1 00000100:00100000:1.0:1789117853.195194:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.195634:0:6505:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff962b8ea77400:6505] 1 exiting: rc = 0 00000100:00100000:2.0:1789117853.195717:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff962bb0bdc800:6506] 2 exiting: rc = 0 00000100:00100000:2.0:1789117853.195790:0:6504:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff962bb0bdda00:6504] 0 exiting: rc = 1 00000100:00100000:2.0:1789117853.201835:0:9524:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff962a86e2f000:9524] 4 exiting: rc = 0 00000100:00100000:0.0:1789117853.204345:0:7470:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff962bbf332e00:7470] 3 exiting: rc = 0 00000100:00100000:1.0:1789117853.204486:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204503:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204512:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204519:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204540:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204546:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204552:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204558:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204565:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204571:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204577:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204582:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204588:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204595:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204612:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204620:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204627:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204634:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204641:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204648:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204654:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204663:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204668:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204673:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204678:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204682:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204686:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204691:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204696:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204700:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204706:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204710:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204714:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204718:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204723:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204727:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204733:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204738:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204742:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204754:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204758:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204763:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204779:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204874:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204882:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204887:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204891:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204896:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204901:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204906:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204911:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204915:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204920:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204925:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204930:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204936:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204943:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204950:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204960:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204965:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204975:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204982:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.204987:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.205023:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789117853.206248:0:16412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789117853.206258:0:16412:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1789117853.206264:0:16412:0:(genops.c:885:class_export_put()) final put ffff962bbf946000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1789117853.206269:0:16412:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf946000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1789117853.206275:0:16412:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1789117853.206332:0:16412:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962b872f5000 1 00000020:00000080:1.0:1789117853.206338:0:16412:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be1f7ba 00000020:00000080:1.0:1789117853.206343:0:16412:0:(genops.c:885:class_export_put()) final put ffff962a86f24800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789117853.206360:0:16412:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1789117853.206398:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962a86f24800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789117853.206485:0:16412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789117853.206490:0:16412:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789117853.206495:0:16412:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff962bbcdd8000) has no exports 00000020:00000080:2.0:1789117853.273449:0:16412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789117853.273466:0:16412:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1789117853.273474:0:16412:0:(genops.c:885:class_export_put()) final put ffff962bbf97b000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1789117853.273480:0:16412:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf97b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789117853.273490:0:16412:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1789117853.273879:0:16412:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff962bbf97f000 00000020:01000000:2.0:1789117853.273905:0:16412:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1789117853.273910:0:16412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789117853.273916:0:16412:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789117853.273921:0:16412:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff962bbfac9a48) has no exports 00000020:00000080:2.0:1789117853.273953:0:16412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789117853.273960:0:16412:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1789117853.273963:0:16412:0:(genops.c:885:class_export_put()) final put ffff962bbf8f0000/OSS_uuid 00000020:00000080:2.0:1789117853.273966:0:16412:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf8f0000/OSS_uuid for OSS 00000020:01000000:2.0:1789117853.273970:0:16412:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1789117853.274108:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff962bbcfa7400:8434] 1 exiting: rc = 0 00000100:00100000:2.0:1789117853.274211:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff962bbce2e800:8437] 2 exiting: rc = 0 00000100:00100000:0.0:1789117853.276863:0:8833:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff962bbfd10000:8833] 3 exiting: rc = 0 00000100:00100000:0.0:1789117853.277010:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff962bbcfdf800:8433] 0 exiting: rc = 1 00000100:00100000:0.0:1789117853.277327:0:15326:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff962a87c28800:15326] 4 exiting: rc = 0 00000100:00100000:2.0:1789117853.281047:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281104:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281112:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281121:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281129:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281136:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281142:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281148:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281155:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281161:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281166:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281171:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281178:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281184:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281188:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281194:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281200:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281205:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281211:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281215:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281220:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281228:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281235:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281240:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281247:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281252:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281258:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281264:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281269:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281276:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281283:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281290:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281297:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281329:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281334:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281339:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281346:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281352:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281357:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281363:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281392:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281401:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281407:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281413:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281418:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281424:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281430:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281435:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281440:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281444:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281449:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.281453:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:3.0:1789117853.283129:0:6515:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789117853.284305:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.284325:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.284330:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.284336:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.284341:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.284346:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.284351:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.284357:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.284363:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.284370:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.284376:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.284979:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.286287:0:11101:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff962a87dc2000:11101] 2 exiting: rc = 0 00000100:00100000:1.0:1789117853.286407:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff962bbf687c00:8439] 1 exiting: rc = 0 00000100:00100000:3.0:1789117853.287174:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff962bbf686400:8438] 0 exiting: rc = 1 00000100:00100000:1.0:1789117853.287415:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287432:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287482:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287489:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287494:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287499:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287504:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287509:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287514:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287519:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287525:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287529:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287534:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287539:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287545:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287550:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287557:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287563:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287568:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287573:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287578:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287584:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287589:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287594:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287612:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287617:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287622:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287627:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287633:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287661:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287667:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287672:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287678:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287684:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287689:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287694:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287701:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287707:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287712:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287718:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287723:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287729:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287734:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287739:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287745:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287751:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287756:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287761:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287767:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287965:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287972:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287978:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287984:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287992:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.287999:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.288005:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.288010:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.288016:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.288022:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.288028:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.288034:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.288040:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.288045:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.288231:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117853.299935:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff962bbf690400:8441] 1 exiting: rc = 0 00000100:00100000:2.0:1789117853.307242:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff962bb5d51a00:8440] 0 exiting: rc = 1 00000100:00100000:1.0:1789117853.307958:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff962bbf690e00:8442] 2 exiting: rc = 0 00000100:00100000:1.0:1789117853.308097:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.308108:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.308115:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.308122:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.308129:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309084:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309096:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309102:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309108:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309114:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309120:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309126:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309132:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309151:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309157:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309164:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309171:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309176:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309182:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309187:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309193:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309199:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309205:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309211:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309241:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309248:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309254:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309260:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309265:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309271:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309277:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309283:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309288:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309294:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309317:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309323:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309328:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309335:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309340:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309346:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309351:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309357:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309362:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309367:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309373:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309378:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309384:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309390:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309409:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309418:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309423:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309428:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309433:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309438:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309444:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309449:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309455:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309461:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309467:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309472:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309478:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309484:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309489:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117853.309495:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.329129:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff962b87300200:8444] 1 exiting: rc = 0 00000100:00100000:3.0:1789117853.329535:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff962b831e9400:8443] 0 exiting: rc = 1 00000100:00100000:0.0:1789117853.329706:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329715:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329720:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329725:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329729:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329734:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329739:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329744:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329748:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329753:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329758:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329763:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329771:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329790:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329796:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329802:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329824:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329829:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329834:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329840:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329846:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329852:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329858:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329864:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329868:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329873:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329878:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329883:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329889:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329893:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329910:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329916:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329921:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329979:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329985:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329990:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329995:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.329999:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330004:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330009:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330013:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330017:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330022:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330027:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330033:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330038:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330042:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330047:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330051:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330080:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330087:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330101:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330105:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330111:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330117:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330122:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330127:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330143:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330150:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330156:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330161:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330166:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330171:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.330176:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117853.331171:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff962bb5d4e400:8445] 0 exiting: rc = 1 00000100:00100000:2.0:1789117853.331279:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff962bb5d4e800:8446] 1 exiting: rc = 0 00000100:00100000:0.0:1789117853.332573:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.332584:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.332590:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.332605:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.332612:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.332618:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.332623:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.332629:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.332635:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.332640:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.332645:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.332651:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.332671:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.332680:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.332686:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.332692:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.332699:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.332705:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.332711:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.332718:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.332723:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.332729:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.332749:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.332755:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.334024:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.334051:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.334071:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.334077:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.334086:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.334092:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.334099:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.334106:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.334117:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.334124:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.335238:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.335261:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.335269:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.335275:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.335881:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.335891:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.335976:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.335986:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.335993:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.335999:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.336005:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.336012:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.336019:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.336025:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.336031:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.336037:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.336088:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.336096:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.336103:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.336109:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.336118:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.336124:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.336130:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.337051:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.337092:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.337099:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.337105:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.337111:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.337117:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117853.339423:0:16412:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789117853.367498:0:16412:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789117878.017477:0:17177:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789117891.347461:0:17777:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789117891.347469:0:17777:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789117891.347470:0:17777:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789117891.347781:0:17777:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff962a88713800 00000020:01000004:3.0:1789117891.347814:0:17777:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789117891.347822:0:17777:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789117891.347839:0:17777:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff962bb0829a48) 00000020:00000080:3.0:1789117891.347856:0:17777:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789117891.467546:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789117891.468665:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789117891.471448:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789117891.472270:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789117891.476219:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789117891.476822:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1789117891.477377:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789117891.477903:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789117891.478757:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789117891.479046:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1789117891.479851:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1789117891.480508:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789117891.482317:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1789117891.483303:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1789117891.486050:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1789117891.487396:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1789117891.487669:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1789117891.487923:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1789117891.488321:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1789117891.488589:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1789117891.488792:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1789117891.489625:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1789117891.489973:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1789117891.490335:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1789117891.490693:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1789117891.490960:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1789117891.491368:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1789117891.491633:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1789117891.491868:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1789117891.492344:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1789117891.492864:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1789117891.493676:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1789117891.494107:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1789117891.494981:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1789117891.495389:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1789117891.495710:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1789117891.495963:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1789117891.496272:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1789117891.496525:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1789117891.496954:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1789117891.497318:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1789117891.497660:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1789117891.498794:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1789117891.500847:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1789117891.501493:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1789117891.501841:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1789117891.502164:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1789117891.504667:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1789117891.507630:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1789117891.508164:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1789117891.508937:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1789117891.509276:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1789117891.510076:0:17777:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:1.0:1789117891.510772:0:17777:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789117891.511661:0:17777:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789117891.511669:0:17777:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789117891.511683:0:17777:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa253ed19be20a98 00000020:01000004:1.0:1789117891.511690:0:17777:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1789117891.511695:0:17777:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789117891.511701:0:17777:0:(tgt_mount.c:101:server_register_mount()) register mount ffff962a88713800 from MGS 00000020:01000004:1.0:1789117891.511704:0:17777:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789117891.511715:0:17777:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff962bbfacb490) 00000020:00000080:1.0:1789117891.511727:0:17777:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789117891.511799:0:17777:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962a88713800 from MGS, refs=2 00080000:01000000:1.0:1789117891.511805:0:17777:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789117891.511810:0:17777:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa253ed19be20aa6 00000100:00100000:1.0:1789117891.511941:0:17777:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789117891.512112:0:17777:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789117891.512117:0:17777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789117891.513752:0:17777:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789117891.513765:0:17777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789117891.514624:0:17777:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789117891.514837:0:17777:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789117891.514842:0:17777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789117891.517346:0:17777:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789117891.517372:0:17777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789117891.518792:0:17777:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789117891.518804:0:17777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789117891.523430:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117891.523438:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117891.523441:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117891.524656:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117891.524660:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117891.524662:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117891.525670:0:17777:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789117891.527291:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789117891.535833:0:17777:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1789117891.538972:0:17789:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789117891.539040:0:17777:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789117891.539121:0:17777:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789117891.540277:0:17777:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789117891.540618:0:17777:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789117891.540801:0:17777:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789117891.540808:0:17777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789117891.541789:0:17777:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789117891.541797:0:17777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789117891.552187:0:17777:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789117891.552199:0:17777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789117891.553135:0:17777:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789117891.553228:0:17777:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.130@tcp' 00000020:01000004:1.0:1789117891.553230:0:17777:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789117891.553260:0:17777:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.130@tcp (typ=mgc) 00000020:00000080:1.0:1789117891.553273:0:17777:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.130@tcp (ffff962bbfacced8) 00000020:00000080:1.0:1789117891.553288:0:17777:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:3.0:1789117891.553476:0:17794:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:1.0:1789117891.553522:0:17777:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962bb5c82000@MGC192.168.204.130@tcp: add connection 192.168.204.130@tcp at head 00010000:00010000:1.0:1789117891.553777:0:17777:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.130@tcp-0 is initialized 00000040:01000000:1.0:1789117891.553785:0:17777:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 1 is initialized 10000000:01000000:2.0:1789117891.560157:0:17796:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789117891.560385:0:17777:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.130@tcp (uuid bf05977c-16b5-4df3-81bb-3835e509f77c) 00000020:00000080:0.0:1789117891.560412:0:17777:0:(genops.c:1385:class_connect()) connect: client bf05977c-16b5-4df3-81bb-3835e509f77c, cookie 0xaa253ed19be20ab4 00000100:00080000:0.0:1789117891.560426:0:17777:0:(import.c:510:import_select_connection()) MGC192.168.204.130@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789117891.560434:0:17777:0:(import.c:624:import_select_connection()) MGC192.168.204.130@tcp: import ffff962bb5c82000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1789117891.560473:0:17777:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87fa8000 x1876025593232000/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789117891.560495:0:17777:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import bf05977c-16b5-4df3-81bb-3835e509f77c->MGS 00000020:01000004:0.0:1789117891.560513:0:17777:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789117891.560529:0:17777:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789117891.560547:0:17777:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff962a87e20000) 00000020:00000080:0.0:1789117891.560562:0:17777:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789117891.565218:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bf05977c-16b5-4df3-81bb-3835e509f77c:3643:1876025593232000:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789117891.565306:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117891.566409:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593232000 00000100:00100000:1.0:1789117891.566426:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593232000 00000100:00100000:1.0:1789117891.566470:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789117891.566478:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1876025593232000:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1789117891.566506:0:17790:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from bf05977c-16b5-4df3-81bb-3835e509f77c@0@lo t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:1.0:1789117891.566534:0:17790:0:(genops.c:1385:class_connect()) connect: client bf05977c-16b5-4df3-81bb-3835e509f77c, cookie 0xaa253ed19be20ac2 00000100:00080000:1.0:1789117891.566681:0:17790:0:(import.c:65:import_set_state_nolock()) ffff962bb5c82800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789117891.566754:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+5:3643:x1876025593232000:12345-0@lo:250:mount.lustre.0 Request processed in 274us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117891.566762:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789117891.566901:0:3643:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.130@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789117891.566909:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.130@tcp: connect to target with instance 0 00000100:00080000:1.0:1789117891.566916:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789117891.566920:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789117891.566922:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bb5c82000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789117891.566925:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789117891.566935:0:3643:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789117891.566940:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bf05977c-16b5-4df3-81bb-3835e509f77c:3643:1876025593232000:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789117891.585268:0:17777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789117891.585493:0:17777:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789117891.585499:0:17777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789117891.589311:0:17777:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789117891.589326:0:17777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789117891.589854:0:17777:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789117891.589860:0:17777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789117891.590565:0:17777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789117891.590735:0:17777:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789117891.590741:0:17777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789117891.593429:0:17777:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789117891.593458:0:17777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789117891.636901:0:17777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789117891.637261:0:17777:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789117891.637269:0:17777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789117891.638973:0:17777:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789117891.638989:0:17777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789117891.639954:0:17777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789117891.640458:0:17777:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789117891.640464:0:17777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789117891.641232:0:17777:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789117891.641241:0:17777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789117891.641981:0:17777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789117891.645695:0:17777:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789117891.645705:0:17777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789117891.646710:0:17777:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789117891.646720:0:17777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789117891.647482:0:17777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789117891.647719:0:17777:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789117891.647724:0:17777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789117891.653919:0:17777:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789117891.654210:0:17777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789117891.724565:0:17777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789117891.725741:0:17777:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789117891.725750:0:17777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789117891.744864:0:17777:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789117891.744894:0:17777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789117891.753684:0:17777:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789117891.754466:0:17777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789117891.761210:0:17777:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789117891.761249:0:17777:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789117891.761258:0:17777:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789117891.761405:0:17777:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789117891.761449:0:17777:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.130@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789117891.761453:0:17777:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789117891.761455:0:17777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789117891.761456:0:17777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789117891.761457:0:17777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789117891.761458:0:17777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789117891.761460:0:17777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789117891.761461:0:17777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789117891.761463:0:17777:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789117891.761465:0:17777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789117891.761466:0:17777:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789117891.761468:0:17777:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789117891.761471:0:17777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789117891.761472:0:17777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789117891.761473:0:17777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789117891.761474:0:17777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789117891.761475:0:17777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789117891.761476:0:17777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789117891.761481:0:17777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789117891.761482:0:17777:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789117891.761483:0:17777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789117891.761484:0:17777:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789117891.761510:0:17777:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789117891.761532:0:17777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593232128:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789117891.764734:0:17777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117891.764823:0:17777:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4f240 going to sleep for 11 seconds 00000100:00100000:2.0:1789117891.765973:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593232128 00000100:00100000:2.0:1789117891.765987:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593232128 00000100:00100000:2.0:1789117891.766076:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117891.766088:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+5:17777:x1876025593232128:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789117891.766156:0:17793:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789117891.766159:0:17793:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789117891.766162:0:17793:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1789117891.766331:0:17814:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789117891.767199:0:17793:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1789117891.771706:0:17815:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789117891.771716:0:17815:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1789117891.771720:0:17815:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789117891.771722:0:17815:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789117891.771913:0:17815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1789117891.772249:0:17793:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789117891.772260:0:17793:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789117891.773839:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+5:17777:x1876025593232128:12345-0@lo:253:mount.lustre.0 Request processed in 7746us (9108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117891.773853:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789117891.773948:0:17777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593232128:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789117891.773965:0:17777:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789117891.773969:0:17777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789117891.773971:0:17777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789117891.773972:0:17777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789117891.773973:0:17777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789117891.773974:0:17777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789117891.773976:0:17777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789117891.773977:0:17777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789117891.773978:0:17777:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789117891.773980:0:17777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789117891.773981:0:17777:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789117891.774129:0:17777:0:(tgt_mount.c:101:server_register_mount()) register mount ffff962a88713800 from lustre-MDT0000 10000000:01000000:1.0:1789117891.774202:0:17777:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789117891.774206:0:17777:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789117891.774211:0:17777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff962bbfacced8 10000000:01000000:1.0:1789117891.774215:0:17777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789117891.774223:0:17777:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff962bbfacced8 from 1 10000000:01000000:1.0:1789117891.774225:0:17777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789117891.774284:0:17777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be20ac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117891.774312:0:17777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be20ac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117891.774323:0:17777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be20ac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117891.774346:0:17777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593232256:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789117891.774402:0:17777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117891.774447:0:17777:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4f540 going to sleep for 11 seconds 00000100:00100000:0.0:1789117891.774638:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593232256 00000100:00100000:0.0:1789117891.774647:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593232256 00000100:00100000:0.0:1789117891.774697:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789117891.774708:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+5:17777:x1876025593232256:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789117891.774725:0:17791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117891.774741:0:17791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bc20f4c00/0xaa253ed19be20ad0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20ac9 expref: -99 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117891.774768:0:17791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bc20f4c00/0xaa253ed19be20ad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20ac9 expref: 6 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117891.774780:0:17791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bc20f4c00/0xaa253ed19be20ad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20ac9 expref: 6 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117891.774788:0:17791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f4c00, rc 0) 00000100:00100000:2.0:1789117891.774886:0:17777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593232256:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789117891.774886:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+6:17777:x1876025593232256:12345-0@lo:101:mount.lustre.0 Request processed in 180us (482us total) trans 0 rc 0/0 00010000:00010000:2.0:1789117891.774900:0:17777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be20ac9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20ad0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117891.774906:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789117891.774909:0:17777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be20ac9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20ad0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117891.774960:0:17777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593232384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789117891.774986:0:17777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117891.775019:0:17777:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b88ea4180 going to sleep for 11 seconds 00000100:00100000:0.0:1789117891.775136:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593232384 00000100:00100000:0.0:1789117891.775140:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593232384 00000100:00100000:0.0:1789117891.775166:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789117891.775173:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+6:17777:x1876025593232384:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789117891.775295:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+6:17777:x1876025593232384:12345-0@lo:501:mount.lustre.0 Request processed in 120us (306us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789117891.775302:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789117891.775419:0:17777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593232384:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789117891.775451:0:17777:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789117891.775475:0:17777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be20ac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20ad0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117891.775484:0:17777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be20ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20ad0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117891.775493:0:17777:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff962a88713800 10000000:01000000:2.0:1789117891.775497:0:17777:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789117891.775501:0:17777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff962a88713800 10000000:01000000:2.0:1789117891.775503:0:17777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789117891.775506:0:17777:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff962a88713800 from 1 10000000:01000000:2.0:1789117891.775508:0:17777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789117891.775525:0:17777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a887f2800/0xaa253ed19be20ad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117891.775541:0:17777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a887f2800/0xaa253ed19be20ad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117891.775549:0:17777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a887f2800/0xaa253ed19be20ad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117891.775563:0:17777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593232512:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789117891.775590:0:17777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117891.775658:0:17777:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b88ea4180 going to sleep for 11 seconds 00000100:00100000:0.0:1789117891.775735:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593232512 00000100:00100000:0.0:1789117891.775740:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593232512 00000100:00100000:0.0:1789117891.775798:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789117891.775805:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+6:17777:x1876025593232512:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789117891.775815:0:17791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117891.775825:0:17791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bc20f4a00/0xaa253ed19be20ade lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20ad7 expref: -99 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117891.775840:0:17791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bc20f4a00/0xaa253ed19be20ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20ad7 expref: 7 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117891.775848:0:17791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bc20f4a00/0xaa253ed19be20ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20ad7 expref: 7 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117891.775855:0:17791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f4a00, rc 0) 00000100:00100000:0.0:1789117891.775902:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+7:17777:x1876025593232512:12345-0@lo:101:mount.lustre.0 Request processed in 97us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117891.775908:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789117891.775967:0:17777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593232512:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789117891.775979:0:17777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a887f2800/0xaa253ed19be20ad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20ade expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117891.775987:0:17777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a887f2800/0xaa253ed19be20ad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20ade expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117891.776022:0:17777:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789117891.776032:0:17777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a887f2800/0xaa253ed19be20ad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20ade expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117891.776039:0:17777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a887f2800/0xaa253ed19be20ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20ade expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117891.776045:0:17777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789117891.776049:0:17777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789117891.776077:0:17777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff962a88713800 10000000:01000000:3.0:1789117891.776094:0:17777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789117891.776098:0:17777:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789117891.776100:0:17777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789117891.776116:0:17777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be20ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117891.776123:0:17777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be20ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117891.776130:0:17777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be20ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117891.776148:0:17777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593232640:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789117891.776175:0:17777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117891.776386:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593232640 00000100:00100000:2.0:1789117891.776390:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593232640 00000100:00100000:1.0:1789117891.776411:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789117891.776421:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+7:17777:x1876025593232640:12345-0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789117891.776426:0:17777:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d2e780 going to sleep for 11 seconds 00010000:00010000:1.0:1789117891.776429:0:17790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117891.776450:0:17790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813da800/0xaa253ed19be20aec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20ae5 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117891.776466:0:17790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813da800/0xaa253ed19be20aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20ae5 expref: 8 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117891.776474:0:17790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813da800/0xaa253ed19be20aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20ae5 expref: 8 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117891.776480:0:17790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813da800, rc 0) 00000100:00100000:1.0:1789117891.776517:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+8:17777:x1876025593232640:12345-0@lo:101:mount.lustre.0 Request processed in 99us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117891.776523:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789117891.776540:0:17777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593232640:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789117891.776551:0:17777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be20ae5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20aec expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117891.776567:0:17777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be20ae5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20aec expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117891.776626:0:17777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593232768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789117891.776653:0:17777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117891.776674:0:17777:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d2e780 going to sleep for 11 seconds 00000100:00100000:0.0:1789117891.776728:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593232768 00000100:00100000:0.0:1789117891.776737:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593232768 00000100:00100000:0.0:1789117891.776760:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789117891.776765:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+8:17777:x1876025593232768:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789117891.776906:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+9:17777:x1876025593232768:12345-0@lo:501:mount.lustre.0 Request processed in 140us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117891.776914:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789117891.779287:0:17777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593232768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789117891.779381:0:17777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593232896:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789117891.779456:0:17777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117891.779498:0:17777:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d2e780 going to sleep for 11 seconds 00000100:00100000:1.0:1789117891.779645:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593232896 00000100:00100000:1.0:1789117891.779652:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593232896 00000100:00100000:1.0:1789117891.779767:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789117891.779777:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+9:17777:x1876025593232896:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789117891.781909:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+9:17777:x1876025593232896:12345-0@lo:503:mount.lustre.0 Request processed in 2117us (2436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117891.781929:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789117891.782388:0:17777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593232896:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789117891.783342:0:17816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd16d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf05977c-16b5-4df3-81bb-3835e509f77c:17816:1876025593233024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117891.783407:0:17816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117891.783445:0:17816:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b88ea43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117891.783513:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593233024 00000100:00100000:0.0:1789117891.783520:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593233024 00000100:00100000:0.0:1789117891.783607:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789117891.783618:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+9:17816:x1876025593233024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117891.784407:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+9:17816:x1876025593233024:12345-0@lo:502:llog_process_th.0 Request processed in 788us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117891.784415:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789117891.784546:0:17816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd16d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf05977c-16b5-4df3-81bb-3835e509f77c:17816:1876025593233024:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789117891.784576:0:17816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117891.784589:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117891.784647:0:17816:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789117891.784654:0:17816:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789117891.784658:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789117891.784674:0:17816:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff962a878aced8) 00000020:00000080:2.0:1789117891.784689:0:17816:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789117891.784693:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789117891.784767:0:17816:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789117891.784772:0:17816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa253ed19be20afa 00000020:00000080:2.0:1789117891.785179:0:17816:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789117891.785186:0:17816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117891.785190:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117891.785198:0:17816:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789117891.785202:0:17816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117891.785206:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117891.785207:0:17816:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789117891.785211:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789117891.785219:0:17816:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff962a878ab490) 00000020:00000080:2.0:1789117891.785230:0:17816:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789117891.785234:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789117891.785236:0:17816:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789117891.785239:0:17816:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789117891.785244:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789117891.785289:0:17816:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962a88713800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789117891.785302:0:17816:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff962a878a9a48) 00000020:00000080:2.0:1789117891.785309:0:17816:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789117891.785377:0:17816:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789117891.785382:0:17816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa253ed19be20b0f 00000020:00000080:2.0:1789117891.785460:0:17816:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789117891.785465:0:17816:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789117891.785468:0:17816:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xaa253ed19be20b16 00080000:01000000:2.0:1789117891.785472:0:17816:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789117891.785475:0:17816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa253ed19be20b1d 00010000:00010000:3.0:1789117891.883763:0:17816:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789117891.888329:0:17816:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:3.0:1789117891.892391:0:17816:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789117891.893176:0:17816:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff962bb0828000) 00000020:00000080:3.0:1789117891.893202:0:17816:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789117891.893289:0:17816:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789117891.893296:0:17816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa253ed19be20b2b 00000020:00000080:3.0:1789117891.900597:0:17816:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789117891.910460:0:17816:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xaa253ed19be20b32 00000020:00000080:2.0:1789117891.912504:0:17816:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789117891.912524:0:17816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117891.912534:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117891.912537:0:17816:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789117891.912540:0:17816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789117891.912544:0:17816:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1789117891.912546:0:17816:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789117891.912548:0:17816:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789117891.912549:0:17816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789117891.912552:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117891.912553:0:17816:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789117891.912556:0:17816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117891.912560:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117891.912568:0:17816:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789117891.912575:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789117891.912639:0:17816:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789117891.912657:0:17816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117891.912661:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117891.912662:0:17816:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789117891.912665:0:17816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117891.912669:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117891.912670:0:17816:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1789117891.912673:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789117891.912679:0:17816:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:00000080:2.0:1789117891.912725:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789117891.912745:0:17816:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff962a878a8000) 00000020:00000080:2.0:1789117891.912763:0:17816:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1789117891.912770:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789117891.912858:0:17816:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1789117891.912876:0:17816:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789117891.912885:0:17816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa253ed19be20b40 00010000:00080000:2.0:1789117891.912926:0:17816:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962bae4d5000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.130@tcp at head 00010000:00010000:2.0:1789117891.914691:0:17816:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1789117891.925151:0:17816:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789117891.925168:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789117891.925214:0:17816:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789117891.925238:0:17816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa253ed19be20b47 00000100:00080000:2.0:1789117891.925250:0:17816:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789117891.925256:0:17816:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff962bae4d5000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789117891.925302:0:17816:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbfd16d00 x1876025593233152/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789117891.925334:0:17816:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789117891.925560:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593233152:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789117891.925637:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117891.925731:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593233152 00000100:00100000:0.0:1789117891.925739:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593233152 00000100:00100000:0.0:1789117891.925770:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789117891.925778:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876025593233152:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1789117891.925794:0:17803:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:01000000:2.0:1789117891.927625:0:17816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117891.927648:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117891.927651:0:17816:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1789117891.927656:0:17816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789117891.927659:0:17816:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1789117891.927661:0:17816:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789117891.927663:0:17816:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789117891.927664:0:17816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789117891.927667:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117891.927668:0:17816:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789117891.927671:0:17816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789117891.927677:0:17816:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789117891.927680:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117891.927682:0:17816:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789117891.927685:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789117891.927689:0:17816:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:01000000:2.0:1789117891.927714:0:17816:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789117891.927717:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789117891.927739:0:17816:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff962bbcdd8000) 00000020:00000080:2.0:1789117891.927762:0:17816:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789117891.927768:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789117891.927875:0:17816:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789117891.927881:0:17816:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789117891.927889:0:17816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa253ed19be20b55 00010000:00080000:2.0:1789117891.927925:0:17816:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962bae4d8800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.130@tcp at head 00010000:00010000:2.0:1789117891.933644:0:17816:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1789117891.937027:0:17816:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789117891.937460:0:17816:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789117891.946117:0:17816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789117891.947323:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789117891.951720:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789117891.955706:0:17822:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789117891.955719:0:17822:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789117891.956837:0:17816:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789117891.956852:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789117891.956907:0:17816:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789117891.956930:0:17816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa253ed19be20b5c 00000100:00080000:3.0:1789117891.956943:0:17816:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789117891.956951:0:17816:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff962bae4d8800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789117891.957005:0:17816:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962ba071b0c0 x1876025593233280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789117891.957036:0:17816:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789117891.957118:0:17816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117891.957122:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117891.957124:0:17816:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789117891.957127:0:17816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789117891.957130:0:17816:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1789117891.957131:0:17816:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789117891.957133:0:17816:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789117891.957134:0:17816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789117891.957137:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117891.957138:0:17816:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789117891.957140:0:17816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789117891.957144:0:17816:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789117891.957147:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117891.957148:0:17816:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789117891.957151:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789117891.957155:0:17816:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:01000000:3.0:1789117891.957178:0:17816:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789117891.957180:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789117891.957192:0:17816:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff962bb082ced8) 00000020:00000080:3.0:1789117891.957205:0:17816:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1789117891.957210:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789117891.957287:0:17816:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789117891.957295:0:17816:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789117891.957302:0:17816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa253ed19be20b6a 00010000:00080000:3.0:1789117891.957334:0:17816:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962b853e0000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.130@tcp at head 00010000:00010000:3.0:1789117891.957531:0:17816:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1789117891.957601:0:17816:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789117891.957618:0:17816:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789117891.959537:0:17816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789117891.959734:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789117891.959884:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:1.0:1789117891.960160:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593233280:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789117891.960227:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876025593233280 offset 0 length 520: 4 00000040:00080000:2.0:1789117891.962210:0:17824:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789117891.962217:0:17824:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789117891.963118:0:17816:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789117891.963138:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789117891.963183:0:17816:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789117891.963210:0:17816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa253ed19be20b71 00000100:00080000:2.0:1789117891.963224:0:17816:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789117891.963231:0:17816:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff962b853e0000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789117891.963280:0:17816:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbfd14000 x1876025593233408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789117891.963299:0:17816:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789117891.963429:0:17816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117891.963434:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117891.963436:0:17816:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789117891.963439:0:17816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117891.963443:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117891.963444:0:17816:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789117891.963447:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789117891.963450:0:17816:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789117891.963452:0:17816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117891.963454:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117891.963456:0:17816:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789117891.963458:0:17816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117891.963460:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117891.963462:0:17816:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789117891.963465:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789117891.963504:0:17816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd16580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf05977c-16b5-4df3-81bb-3835e509f77c:17816:1876025593233536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117891.963572:0:17816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117891.963610:0:17816:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87d6f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117891.964222:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593233536 00000100:00100000:1.0:1789117891.964231:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593233536 00000100:00100000:1.0:1789117891.964286:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789117891.964298:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+9:17816:x1876025593233536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117891.964489:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+9:17816:x1876025593233536:12345-0@lo:502:llog_process_th.0 Request processed in 193us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117891.964497:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789117891.964687:0:17816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd16580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf05977c-16b5-4df3-81bb-3835e509f77c:17816:1876025593233536:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789117891.964716:0:17816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117891.964723:0:17816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117891.964726:0:17816:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789117891.964731:0:17816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789117891.965092:0:17777:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1789117891.965117:0:17777:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789117891.965133:0:17777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be20ae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20aec expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117891.965145:0:17777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be20ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20aec expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117891.965153:0:17777:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962a88713800 from 1 10000000:01000000:1.0:1789117891.965156:0:17777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789117891.965189:0:17777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813dae00/0xaa253ed19be20b78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117891.965204:0:17777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b813dae00/0xaa253ed19be20b78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117891.965215:0:17777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b813dae00/0xaa253ed19be20b78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117891.965236:0:17777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a770c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593233664:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789117891.965281:0:17777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117891.965314:0:17777:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789117891.965493:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593233664 00000100:00100000:2.0:1789117891.965499:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593233664 00000100:00100000:2.0:1789117891.965536:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789117891.965546:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+9:17777:x1876025593233664:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789117891.965573:0:17793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117891.965594:0:17793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a887f3800/0xaa253ed19be20b7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20b78 expref: -99 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117891.965620:0:17793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a887f3800/0xaa253ed19be20b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20b78 expref: 10 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117891.965630:0:17793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a887f3800/0xaa253ed19be20b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20b78 expref: 10 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117891.965639:0:17793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f3800, rc 0) 00000100:00100000:2.0:1789117891.965676:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+10:17777:x1876025593233664:12345-0@lo:101:mount.lustre.0 Request processed in 133us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117891.965683:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789117891.965793:0:17777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a770c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593233664:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789117891.965809:0:17777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b813dae00/0xaa253ed19be20b78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20b7f expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117891.965819:0:17777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b813dae00/0xaa253ed19be20b78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20b7f expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117891.966169:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593233408:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789117891.966208:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876025593233408 offset 0 length 520: 4 00000100:00100000:1.0:1789117891.966654:0:17777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a770c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593233792:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789117891.966693:0:17777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117891.966724:0:17777:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789117891.966844:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593233792 00000100:00100000:3.0:1789117891.966851:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593233792 00000100:00100000:3.0:1789117891.966904:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789117891.966912:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+10:17777:x1876025593233792:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789117891.966932:0:17791:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789117891.966939:0:17791:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789117891.967024:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+10:17777:x1876025593233792:12345-0@lo:256:mount.lustre.0 Request processed in 112us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117891.967032:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789117891.967200:0:17777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a770c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593233792:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789117891.967800:0:17777:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789117891.967830:0:17777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813dae00/0xaa253ed19be20b78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20b7f expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117891.967842:0:17777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b813dae00/0xaa253ed19be20b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20b7f expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117891.967877:0:17777:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962a88713800 from 1 10000000:01000000:1.0:1789117891.967880:0:17777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789117891.967914:0:17777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20b86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117891.967922:0:17777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20b86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117891.967934:0:17777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20b86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117891.967958:0:17777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a770c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593233920:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789117891.968022:0:17777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117891.968083:0:17777:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789117891.968106:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593233920 00000100:00100000:1.0:1789117891.968112:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593233920 00000100:00100000:1.0:1789117891.968147:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789117891.968155:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+10:17777:x1876025593233920:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789117891.968167:0:17790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117891.968181:0:17790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813da600/0xaa253ed19be20b8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20b86 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117891.968222:0:17790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813da600/0xaa253ed19be20b8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20b86 expref: 11 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117891.968234:0:17790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813da600/0xaa253ed19be20b8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20b86 expref: 11 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117891.968254:0:17790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813da600, rc 0) 00000100:00100000:1.0:1789117891.968287:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+11:17777:x1876025593233920:12345-0@lo:101:mount.lustre.0 Request processed in 134us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117891.968294:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789117891.968333:0:17777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a770c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593233920:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789117891.968345:0:17777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20b86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20b8d expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117891.968354:0:17777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20b86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20b8d expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117891.968413:0:17777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a770c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593234048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117891.968437:0:17777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117891.968450:0:17777:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789117891.968464:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593234048 00000100:00100000:1.0:1789117891.968468:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593234048 00000100:00100000:1.0:1789117891.968490:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789117891.968496:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+11:17777:x1876025593234048:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117891.968633:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+11:17777:x1876025593234048:12345-0@lo:501:mount.lustre.0 Request processed in 136us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117891.968640:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789117891.968672:0:17777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a770c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593234048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117891.968699:0:17777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a770c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593234176:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789117891.968737:0:17777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117891.968757:0:17777:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789117891.968769:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593234176 00000100:00100000:1.0:1789117891.968773:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593234176 00000100:00100000:1.0:1789117891.968794:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789117891.968800:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+11:17777:x1876025593234176:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789117891.968886:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+11:17777:x1876025593234176:12345-0@lo:503:mount.lustre.0 Request processed in 86us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117891.968894:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789117891.968937:0:17777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a770c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593234176:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789117891.969353:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876025593233152:12345-0@lo:38:llog_process_th.0 Request processed in 43562us (43703us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789117891.969363:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789117891.969710:0:17826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf05977c-16b5-4df3-81bb-3835e509f77c:17826:1876025593234304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117891.969770:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117891.969799:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593234304 00000100:00100000:0.0:1789117891.969805:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593234304 00000100:00100000:0.0:1789117891.969837:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789117891.969843:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+11:17826:x1876025593234304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117891.970220:0:17826:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bae4acc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789117891.970672:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+11:17826:x1876025593234304:12345-0@lo:502:llog_process_th.0 Request processed in 827us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117891.970681:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789117891.970736:0:17826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf05977c-16b5-4df3-81bb-3835e509f77c:17826:1876025593234304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789117891.970768:0:17826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117891.970778:0:17826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117891.970781:0:17826:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789117891.970789:0:17826:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962a88713800 00000020:00000080:0.0:1789117891.970791:0:17826:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789117891.970800:0:17826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117891.970803:0:17826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117891.970804:0:17826:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789117891.970807:0:17826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117891.970810:0:17826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117891.970811:0:17826:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789117891.970815:0:17826:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962a88713800 00000020:00000080:0.0:1789117891.970817:0:17826:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789117891.970945:0:17826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117891.970949:0:17826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117891.970951:0:17826:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789117891.970954:0:17826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117891.970956:0:17826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117891.970958:0:17826:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789117891.970961:0:17826:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962a88713800 00000020:00000080:0.0:1789117891.970964:0:17826:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00080000:2.0:1789117891.971078:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bae4d5000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789117891.971085:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789117891.971088:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593233152:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1789117891.972671:0:17826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117891.975305:0:17826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117891.975315:0:17826:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789117891.975327:0:17826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117891.975336:0:17826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117891.975337:0:17826:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789117891.975475:0:17826:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962a88713800 00000020:00000080:2.0:1789117891.975478:0:17826:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789117891.975551:0:17826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117891.975555:0:17826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117891.975565:0:17826:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789117891.975569:0:17826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117891.975572:0:17826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117891.975574:0:17826:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789117891.975578:0:17826:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962a88713800 00000020:00000080:2.0:1789117891.975581:0:17826:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789117891.975602:0:17826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117891.975605:0:17826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117891.975607:0:17826:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789117891.975609:0:17826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117891.975612:0:17826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117891.975613:0:17826:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789117891.975617:0:17826:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962a88713800 00000020:00000080:2.0:1789117891.975620:0:17826:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789117891.975699:0:17826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd16d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf05977c-16b5-4df3-81bb-3835e509f77c:17826:1876025593234432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117891.975805:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117891.975911:0:17826:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87d6fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1789117891.983066:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593234432 00000100:00100000:0.0:1789117891.983084:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593234432 00000100:00100000:0.0:1789117891.983147:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789117891.983158:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+11:17826:x1876025593234432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117891.983331:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+11:17826:x1876025593234432:12345-0@lo:502:llog_process_th.0 Request processed in 174us (7525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117891.983340:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789117891.983418:0:17826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd16d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf05977c-16b5-4df3-81bb-3835e509f77c:17826:1876025593234432:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789117891.983455:0:17826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117891.983463:0:17826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117891.983466:0:17826:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789117891.983470:0:17826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:0.0:1789117891.983605:0:17777:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:0.0:1789117891.983633:0:17777:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789117891.983650:0:17777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20b86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20b8d expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117891.983661:0:17777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20b86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20b8d expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117891.983709:0:17777:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789117891.983712:0:17777:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff962a88713800 10000000:01000000:0.0:1789117891.983715:0:17777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff962a88713800 10000000:01000000:0.0:1789117891.983719:0:17777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789117891.983726:0:17777:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962a88713800 from 1 10000000:01000000:0.0:1789117891.983729:0:17777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789117891.983759:0:17777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bc20f5000/0xaa253ed19be20b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117891.983778:0:17777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962bc20f5000/0xaa253ed19be20b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117891.983788:0:17777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962bc20f5000/0xaa253ed19be20b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117891.983809:0:17777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593234560:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789117891.983848:0:17777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117891.983888:0:17777:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bae4ac0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117891.983909:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593234560 00000100:00100000:0.0:1789117891.983913:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593234560 00000100:00100000:0.0:1789117891.983939:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789117891.983946:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+11:17777:x1876025593234560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789117891.983956:0:17793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117891.983971:0:17793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bc20f4200/0xaa253ed19be20b9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20b94 expref: -99 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117891.983996:0:17793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bc20f4200/0xaa253ed19be20b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20b94 expref: 12 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117891.984007:0:17793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bc20f4200/0xaa253ed19be20b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20b94 expref: 12 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117891.984017:0:17793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f4200, rc 0) 00000100:00100000:0.0:1789117891.984047:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+12:17777:x1876025593234560:12345-0@lo:101:mount.lustre.0 Request processed in 101us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117891.984082:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789117891.984122:0:17777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593234560:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789117891.984135:0:17777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962bc20f5000/0xaa253ed19be20b94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20b9b expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117891.984144:0:17777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962bc20f5000/0xaa253ed19be20b94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20b9b expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117891.984195:0:17777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593234688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789117891.984219:0:17777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117891.984232:0:17777:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bae4ac0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117891.984245:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593234688 00000100:00100000:0.0:1789117891.984248:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593234688 00000100:00100000:0.0:1789117891.984270:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789117891.984276:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+12:17777:x1876025593234688:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789117891.984376:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+12:17777:x1876025593234688:12345-0@lo:501:mount.lustre.0 Request processed in 99us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117891.984383:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789117891.984413:0:17777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593234688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789117891.984440:0:17777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593234816:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789117891.984475:0:17777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117891.984488:0:17777:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bae4ac0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117891.984500:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593234816 00000100:00100000:0.0:1789117891.984504:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593234816 00000100:00100000:0.0:1789117891.984523:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789117891.984529:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+12:17777:x1876025593234816:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789117891.984601:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+12:17777:x1876025593234816:12345-0@lo:503:mount.lustre.0 Request processed in 71us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117891.984614:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789117891.984653:0:17777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593234816:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789117891.986796:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0718000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf05977c-16b5-4df3-81bb-3835e509f77c:17829:1876025593234944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117891.986886:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117891.986932:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b86fac780 going to sleep for 11 seconds 00000100:00100000:0.0:1789117891.986985:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593234944 00000100:00100000:0.0:1789117891.986992:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593234944 00000100:00100000:0.0:1789117891.988559:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789117891.988576:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+12:17829:x1876025593234944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117891.988794:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+12:17829:x1876025593234944:12345-0@lo:502:llog_process_th.0 Request processed in 221us (1907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117891.988803:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789117891.989179:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0718000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf05977c-16b5-4df3-81bb-3835e509f77c:17829:1876025593234944:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789117891.989255:0:17829:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789117891.989276:0:17829:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff962bb082b490) 00000020:00000080:3.0:1789117891.989297:0:17829:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1789117891.989677:0:17829:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962a88713800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789117891.989682:0:17829:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962a88713800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789117891.989686:0:17829:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962a88713800 4 00010000:00080000:3.0:1789117891.989718:0:17829:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962b9057d800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.130@tcp at head 00010000:00010000:3.0:1789117891.997565:0:17829:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1789117892.001408:0:17829:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789117892.001452:0:17829:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789117892.001468:0:17829:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xaa253ed19be20ba9 00000100:00080000:3.0:1789117892.001479:0:17829:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789117892.001486:0:17829:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff962b9057d800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789117892.001520:0:17829:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962ba0718000 x1876025593235072/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789117892.001558:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876025593235072:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789117892.001640:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117892.001713:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593235072 00000100:00100000:3.0:1789117892.001719:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593235072 00000100:00100000:3.0:1789117892.001754:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789117892.001762:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876025593235072:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789117892.001813:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876025593235072:12345-0@lo:38:llog_process_th.0 Request processed in 50us (173us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789117892.001820:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789117892.001851:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789117892.001859:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b9057d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789117892.001883:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789117892.001887:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876025593235072:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789117892.001920:0:17829:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789117892.003504:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0718000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf05977c-16b5-4df3-81bb-3835e509f77c:17829:1876025593235200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117892.003593:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117892.003643:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593235200 00000100:00100000:3.0:1789117892.003648:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593235200 00000100:00100000:3.0:1789117892.003693:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789117892.003701:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+12:17829:x1876025593235200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117892.004993:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+12:17829:x1876025593235200:12345-0@lo:502:llog_process_th.0 Request processed in 1287us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117892.005003:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789117892.005099:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b86fac3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117892.005126:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0718000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf05977c-16b5-4df3-81bb-3835e509f77c:17829:1876025593235200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117892.005192:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0718000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf05977c-16b5-4df3-81bb-3835e509f77c:17829:1876025593235328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117892.005233:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117892.005269:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593235328 00000100:00100000:3.0:1789117892.005275:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593235328 00000100:00100000:3.0:1789117892.005311:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789117892.005320:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+12:17829:x1876025593235328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117892.005387:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+12:17829:x1876025593235328:12345-0@lo:502:llog_process_th.0 Request processed in 68us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117892.005395:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789117892.005427:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b9837a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789117892.005438:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0718000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf05977c-16b5-4df3-81bb-3835e509f77c:17829:1876025593235328:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789117892.005456:0:17829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789117892.011383:0:17777:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789117892.011428:0:17777:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789117892.011453:0:17777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bc20f5000/0xaa253ed19be20b94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20b9b expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117892.011466:0:17777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962bc20f5000/0xaa253ed19be20b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20b9b expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789117892.011678:0:17777:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789117892.011681:0:17777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789117892.011682:0:17777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789117892.011683:0:17777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789117892.011684:0:17777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789117892.011686:0:17777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789117892.011687:0:17777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789117892.011689:0:17777:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789117892.011691:0:17777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789117892.011693:0:17777:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789117892.011697:0:17777:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1789117892.011700:0:17777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789117892.011701:0:17777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789117892.011703:0:17777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789117892.011704:0:17777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789117892.011705:0:17777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789117892.011707:0:17777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789117892.011708:0:17777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789117892.011709:0:17777:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789117892.011710:0:17777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789117892.011711:0:17777:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789117892.011744:0:17777:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789117892.011773:0:17777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a770c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593235456:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789117892.011862:0:17777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117892.011962:0:17777:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4f240 going to sleep for 11 seconds 00000100:00100000:3.0:1789117892.012010:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593235456 00000100:00100000:3.0:1789117892.012018:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593235456 00000100:00100000:3.0:1789117892.012510:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789117892.012521:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+12:17777:x1876025593235456:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789117892.012562:0:17793:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789117892.012577:0:17793:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789117892.035673:0:17793:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789117892.035695:0:17793:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789117892.035936:0:17814:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789117892.035943:0:17814:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789117892.035964:0:17814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be20bb0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117892.035985:0:17814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962a887f3800/0xaa253ed19be20b7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20b78 expref: 12 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117892.035993:0:17814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be20bb0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117892.036040:0:17814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962a887f3800/0xaa253ed19be20b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be20b78 expref: 12 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117892.036071:0:17814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962a887f3800/0xaa253ed19be20b7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be20b78 expref: 12 pid: 17793 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117892.036087:0:17814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17814:1876025593235584:0@lo:104: 00000100:00100000:2.0:1789117892.036242:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+12:17777:x1876025593235456:12345-0@lo:253:mount.lustre.0 Request processed in 23721us (24378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117892.036253:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789117892.036365:0:17814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117892.036401:0:17814:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bae4ac9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117892.037508:0:17777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a770c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:17777:1876025593235456:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789117892.037523:0:17777:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789117892.037526:0:17777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789117892.037528:0:17777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789117892.037529:0:17777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789117892.037530:0:17777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789117892.037531:0:17777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789117892.037532:0:17777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789117892.037533:0:17777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789117892.037535:0:17777:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789117892.037537:0:17777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789117892.037538:0:17777:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789117892.037554:0:17777:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789117892.038751:0:17781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593235584 00000100:00100000:2.0:1789117892.038763:0:17781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593235584 00000100:00100000:2.0:1789117892.038828:0:17781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789117892.038838:0:17781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf05977c-16b5-4df3-81bb-3835e509f77c+3:17814:x1876025593235584:12345-0@lo:104: 00010000:00010000:2.0:1789117892.038857:0:17781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b813dae00/0xaa253ed19be20b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20b7f expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117892.038958:0:17781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789117892.038975:0:17781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf05977c-16b5-4df3-81bb-3835e509f77c+3:17814:x1876025593235584:12345-0@lo:104: Request processed in 139us (2610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117892.038981:0:17781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789117892.039112:0:17814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17814:1876025593235584:0@lo:104: 00010000:00010000:0.0:1789117892.039135:0:17814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be20bb0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117892.039155:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117892.039161:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b813dae00/0xaa253ed19be20b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20b7f expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117892.039167:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dae00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117892.039172:0:17787:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b813dae00/0xaa253ed19be20b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be20b7f expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117892.039179:0:17787:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b813dae00/0xaa253ed19be20b78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be20b7f expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117892.039187:0:17787:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b813dae00/0xaa253ed19be20b78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be20b7f expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117892.039193:0:17787:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789117892.039238:0:17787:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b813dae00/0xaa253ed19be20b78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20b7f expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117892.039245:0:17787:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117892.039267:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b813dae00/0xaa253ed19be20b78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20b7f expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117892.039274:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b813dae00/0xaa253ed19be20b78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20b7f expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117892.039290:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117892.039292:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117892.039293:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117892.039335:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593235712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789117892.039924:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117892.041131:0:17783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593235712 00000100:00100000:2.0:1789117892.041143:0:17783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593235712 00010000:00010000:2.0:1789117892.041179:0:17783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962a887f3800/0xaa253ed19be20b7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20b78 expref: 12 pid: 17793 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117892.041214:0:17783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789117892.041222:0:17783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87faad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf05977c-16b5-4df3-81bb-3835e509f77c+12:3647:x1876025593235712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789117892.041236:0:17783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117892.041241:0:17783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962a887f3800/0xaa253ed19be20b7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20b78 expref: 12 pid: 17793 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117892.041254:0:17783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962a887f3800/0xaa253ed19be20b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be20b78 expref: 12 pid: 17793 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117892.041271:0:17783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a887f3800/0xaa253ed19be20b7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be20b78 expref: 12 pid: 17793 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117892.041287:0:17783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be20bb0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117892.041295:0:17783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be20bb0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789117892.041311:0:17783:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005369755s 00010000:00010000:2.0:1789117892.041316:0:17783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be20bb0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117892.041323:0:17783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be20bb0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117892.041513:0:17783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be20bb0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117892.041523:0:17783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be20bb0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117892.041529:0:17783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f5e00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117892.041533:0:17783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be20bb0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117892.041541:0:17783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be20bb0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117892.041555:0:17783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be20bb0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117892.041953:0:17783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117892.042023:0:17783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87faad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf05977c-16b5-4df3-81bb-3835e509f77c+11:3647:x1876025593235712:12345-0@lo:103:ldlm_bl.0 Request processed in 800us (2099us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117892.042031:0:17783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789117892.042702:0:17814:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be20bb0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117892.042712:0:17814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be20bb0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117892.042720:0:17814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be20bb0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117892.042784:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593235712:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1789117892.079502:0:17777:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000020:00080000:2.0:1789117892.086470:0:17840:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1789117892.086476:0:17840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1789117892.086476:0:17777:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1789117892.086885:0:17841:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789117892.087431:0:17777:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1789117892.087602:0:17841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789117892.089765:0:17841:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789117892.089847:0:17841:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:2.0:1789117892.090223:0:17842:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff962bbfd17840 x1876025593235840/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117892.090235:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 0 seconds 00000040:01000000:1.0:1789117892.090878:0:17777:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789117892.090914:0:17777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789117892.091658:0:17777:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789117892.091674:0:17777:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789117892.091827:0:17777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789117892.093944:0:17777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789117892.094951:0:17777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789117892.095409:0:17777:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1789117892.097208:0:17777:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1789117892.100220:0:17777:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1789117892.102456:0:17777:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789117892.102496:0:17777:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc5cc16b7988 00100000:10000000:0.0:1789117892.102505:0:17777:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789117892.103476:0:17777:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789117892.103491:0:17777:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.130@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789117892.103506:0:17777:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789117892.103524:0:17777:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1789117892.107850:0:17777:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789117892.108125:0:17777:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789117892.581429:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789117892.901254:0:17796:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789117892.901265:0:17796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962a88713800 from 7 10000000:01000000:2.0:1789117892.901278:0:17796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789117892.901339:0:17796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a887f2c00/0xaa253ed19be20bb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117892.901352:0:17796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a887f2c00/0xaa253ed19be20bb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117892.901363:0:17796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a887f2c00/0xaa253ed19be20bb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117892.901399:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd170c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593235968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789117892.901496:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117892.901721:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b880d7480 going to sleep for 11 seconds 00000100:00100000:3.0:1789117892.901761:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593235968 00000100:00100000:3.0:1789117892.901770:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593235968 00000100:00100000:3.0:1789117892.902271:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789117892.902283:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+11:17796:x1876025593235968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117892.902299:0:17790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117892.902321:0:17790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b80031600/0xaa253ed19be20bbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20bb7 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117892.902355:0:17790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b80031600/0xaa253ed19be20bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20bb7 expref: 12 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117892.902367:0:17790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b80031600/0xaa253ed19be20bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20bb7 expref: 12 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117892.902377:0:17790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b80031600, rc 0) 00000100:00100000:3.0:1789117892.902527:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+12:17796:x1876025593235968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 246us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117892.902534:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789117892.905178:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd170c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593235968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117892.905216:0:17796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a887f2c00/0xaa253ed19be20bb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20bbe expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117892.905229:0:17796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a887f2c00/0xaa253ed19be20bb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20bbe expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117892.905314:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd170c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593236096:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789117892.905393:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117892.905595:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b880d7480 going to sleep for 11 seconds 00000100:00100000:3.0:1789117892.905730:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593236096 00000100:00100000:3.0:1789117892.905739:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593236096 00000100:00100000:3.0:1789117892.905819:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789117892.905830:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+12:17796:x1876025593236096:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789117892.906075:0:17790:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789117892.906097:0:17790:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789117892.906100:0:17790:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1789117892.906203:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+12:17796:x1876025593236096:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 376us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117892.906211:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789117892.906771:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd170c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593236096:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789117892.906840:0:17796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789117892.906859:0:17796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a887f2c00/0xaa253ed19be20bb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20bbe expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117892.906883:0:17796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a887f2c00/0xaa253ed19be20bb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20bbe expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789117893.029679:0:17834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789117893.104971:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789117893.605851:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789117894.058518:0:17834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789117894.121515:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 0 seconds 00010000:00010000:1.0:1789117894.632986:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117895.143789:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789117895.654135:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117896.165969:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 0 seconds 00010000:00010000:1.0:1789117896.688661:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789117897.064488:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789117897.064494:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789117897.064497:0:36:0:(import.c:65:import_set_state_nolock()) ffff962bae4d5000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789117897.064505:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 544 00000100:00080000:0.0:1789117897.064510:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789117897.064516:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff962bae4d5000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1789117897.064538:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87fab840 x1876025593236352/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789117897.064552:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789117897.064556:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789117897.064558:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789117897.064561:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789117897.064564:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789117897.064567:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789117897.064569:0:36:0:(import.c:65:import_set_state_nolock()) ffff962b9057d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789117897.064573:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff962b9057d800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1789117897.064581:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87fa9680 x1876025593236480/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789117897.064630:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789117897.064653:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf05977c-16b5-4df3-81bb-3835e509f77c:3645:1876025593236224:0@lo:400:kworker.0 00000100:00100000:0.0:1789117897.064725:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117897.064846:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593236224 00000100:00100000:3.0:1789117897.064860:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593236224 00000100:00100000:3.0:1789117897.064906:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789117897.064914:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+12:3645:x1876025593236224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117897.064963:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+12:3645:x1876025593236224:12345-0@lo:400:kworker.0 Request processed in 50us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117897.064970:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789117897.065010:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf05977c-16b5-4df3-81bb-3835e509f77c:3645:1876025593236224:0@lo:400:kworker.0 00000100:00100000:1.0:1789117897.065085:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593236352:0@lo:38:kworker.0 00000100:00100000:1.0:1789117897.065125:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117897.065239:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593236352 00000100:00100000:3.0:1789117897.065243:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593236352 00000100:00100000:3.0:1789117897.065264:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789117897.065269:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876025593236352:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789117897.065286:0:17804:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789117897.067365:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876025593236480:0@lo:38:kworker.0 00000100:00100000:1.0:1789117897.068304:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117897.068523:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593236480 00000100:00100000:0.0:1789117897.068532:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593236480 00000100:00100000:0.0:1789117897.068569:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789117897.068578:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876025593236480:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789117897.068604:0:17800:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 549 last 0 00000020:00000080:0.0:1789117897.068640:0:17800:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xaa253ed19be20bc5 00000004:00100000:0.0:1789117897.068654:0:17800:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789117897.068797:0:17800:0:(import.c:65:import_set_state_nolock()) ffff962bbf97d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789117897.068849:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876025593236480:12345-0@lo:38:kworker.0 Request processed in 271us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117897.068856:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789117897.068945:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff962a87fa9680 x1876025593236480/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789117907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789117897.068959:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789117897.068967:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789117897.068971:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789117897.068974:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b9057d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789117897.068979:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876025593236480:0@lo:38:kworker.0 00000100:00100000:2.0:1789117897.103193:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876025593236352:12345-0@lo:38:kworker.0 Request processed in 37914us (38058us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789117897.103211:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789117897.104078:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bae4d5000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789117897.104087:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789117897.104093:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593236352:0@lo:38:kworker.0 00000100:00100000:0.0:1789117897.193524:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789117897.702503:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789117897.723182:0:18085:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789117898.217119:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1789117898.737779:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789117898.802562:0:18138:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789117898.802779:0:18138:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789117899.237237:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789117899.749188:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789117900.031597:0:18188:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789117900.031827:0:18188:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789117900.262266:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1789117900.778968:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117901.157899:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789117891/real 1789117891] req@ffff962bbfd14000 x1876025593233408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117901 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117901.157930:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962bbfd14000 x1876025593233408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117901 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117901.157942:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789117891/real 1789117891] req@ffff962ba071b0c0 x1876025593233280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117901 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117901.157956:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962ba071b0c0 x1876025593233280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117901 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789117901.157976:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b853e0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789117901.157987:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789117901.157992:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593233408:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789117901.158009:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bae4d8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789117901.158017:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789117901.158020:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593233280:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789117901.158752:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789117901.158757:0:14597:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789117901.158760:0:14597:0:(import.c:65:import_set_state_nolock()) ffff962bae4d5000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789117901.158766:0:14597:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 549 00000100:00080000:1.0:1789117901.158771:0:14597:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789117901.158778:0:14597:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff962bae4d5000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789117901.158799:0:14597:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bc1a761c0 x1876025593236736/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789117901.158813:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117901.158816:0:14597:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789117901.158819:0:14597:0:(import.c:65:import_set_state_nolock()) ffff962bae4d8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789117901.158822:0:14597:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 544 00000100:00080000:1.0:1789117901.158825:0:14597:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789117901.158828:0:14597:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff962bae4d8800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789117901.158838:0:14597:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bc1a752c0 x1876025593236864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789117901.158847:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117901.158850:0:14597:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789117901.158852:0:14597:0:(import.c:65:import_set_state_nolock()) ffff962b853e0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789117901.158854:0:14597:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 544 00000100:00080000:1.0:1789117901.158857:0:14597:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789117901.158866:0:14597:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff962b853e0000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789117901.158880:0:14597:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bc1a76580 x1876025593236992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789117901.158922:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf05977c-16b5-4df3-81bb-3835e509f77c:3645:1876025593236608:0@lo:400:kworker.0 00000100:00100000:1.0:1789117901.158987:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117901.159047:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593236736:0@lo:38:kworker.0 00000100:00100000:1.0:1789117901.159093:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117901.159113:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593236864:0@lo:8:kworker.0 00000400:00000100:1.0:1789117901.159143:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876025593236864 offset 0 length 520: 4 00000100:00100000:1.0:1789117901.159164:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593236992:0@lo:8:kworker.0 00000400:00000100:1.0:1789117901.159320:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876025593236992 offset 0 length 520: 4 00000100:00100000:1.0:1789117901.159347:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593237120:0@lo:400:kworker.0 00000100:00100000:1.0:1789117901.159580:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117901.159708:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593236608 00000100:00100000:1.0:1789117901.159716:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593236608 00000100:00100000:1.0:1789117901.159764:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789117901.159774:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+12:3645:x1876025593236608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117901.159825:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+12:3645:x1876025593236608:12345-0@lo:400:kworker.0 Request processed in 53us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117901.159833:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789117901.159875:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593236736 00000100:00100000:1.0:1789117901.159879:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593236736 00000100:00100000:1.0:1789117901.159899:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789117901.159904:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876025593236736:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789117901.159922:0:17803:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789117901.164156:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593237120 00000100:00100000:2.0:1789117901.164170:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593237120 00000100:00100000:2.0:1789117901.164337:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789117901.164349:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593237120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117901.164722:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593237120:12345-0@lo:400:kworker.0 Request processed in 374us (5139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117901.164730:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789117901.164757:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff962bc1a76940 x1876025593237120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117901.164776:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593237120:0@lo:400:kworker.0 00000100:00100000:0.0:1789117901.171754:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf05977c-16b5-4df3-81bb-3835e509f77c:3645:1876025593236608:0@lo:400:kworker.0 00000100:00100000:1.0:1789117901.179954:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876025593236736:12345-0@lo:38:kworker.0 Request processed in 20041us (20853us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789117901.179975:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789117901.180839:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bae4d5000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789117901.180846:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789117901.180851:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593236736:0@lo:38:kworker.0 00000100:00100000:0.0:1789117901.291243:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789117901.798251:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117902.312199:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789117902.821374:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117903.333187:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789117903.846426:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789117904.295943:0:17834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789117904.369871:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789117904.872585:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117905.387521:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789117905.894149:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789117906.278074:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789117906.278090:0:14597:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789117906.278094:0:14597:0:(import.c:65:import_set_state_nolock()) ffff962bae4d5000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789117906.278103:0:14597:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 553 00000100:00080000:0.0:1789117906.278123:0:14597:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789117906.278129:0:14597:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff962bae4d5000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1789117906.278164:0:14597:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87fa83c0 x1876025593237376/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789117906.278380:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593237248:0@lo:400:kworker.0 00000100:00100000:3.0:1789117906.278477:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789117906.278793:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789117906.278797:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789117906.278800:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789117906.278804:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789117906.278854:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593237248 00000100:00100000:0.0:1789117906.278861:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593237248 00000100:00100000:0.0:1789117906.278919:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789117906.278928:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+12:3647:x1876025593237248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117906.278982:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+12:3647:x1876025593237248:12345-0@lo:400:kworker.0 Request processed in 56us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117906.278989:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789117906.279022:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593237504:0@lo:400:kworker.0 00000100:00100000:0.0:1789117906.279097:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117906.279162:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593237248:0@lo:400:kworker.0 00000100:00100000:3.0:1789117906.279537:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593237376:0@lo:38:kworker.0 00000100:00100000:3.0:1789117906.279585:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117906.279753:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593237504 00000100:00100000:2.0:1789117906.279759:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593237504 00000100:00100000:2.0:1789117906.279813:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117906.279820:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593237504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117906.279864:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593237504:12345-0@lo:400:kworker.0 Request processed in 43us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117906.279870:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789117906.280823:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593237376 00000100:00100000:0.0:1789117906.280831:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593237376 00000100:00100000:0.0:1789117906.280869:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789117906.280877:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0718f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876025593237376:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789117906.280907:0:17804:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1789117906.293399:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff962a87fa8f00 x1876025593237504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117906.293419:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593237504:0@lo:400:kworker.0 00000100:00100000:0.0:1789117906.348281:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0718f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876025593237376:12345-0@lo:38:kworker.0 Request processed in 67393us (68685us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789117906.348312:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1789117906.354756:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bae4d5000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789117906.354769:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789117906.354774:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593237376:0@lo:38:kworker.0 00000100:00100000:2.0:1789117906.410864:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 0 seconds 00010000:00010000:1.0:1789117906.917621:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117907.430135:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789117907.941203:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117908.456691:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789117908.966299:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117909.479376:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 0 seconds 00000020:01000004:2.0:1789117909.527464:0:18533:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789117909.527469:0:18533:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789117909.527470:0:18533:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789117909.527602:0:18533:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff962bbf6a1000 00000020:01000004:2.0:1789117909.527617:0:18533:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1789117909.527630:0:18533:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789117909.527643:0:18533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff962bbcddb490) 00000020:00000080:2.0:1789117909.527671:0:18533:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789117909.701092:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1789117909.701738:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789117909.703574:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1789117909.704783:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1789117909.707127:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1789117909.707593:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1789117909.707837:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1789117909.708023:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1789117909.708271:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1789117909.708457:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1789117909.709423:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1789117909.709624:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1789117909.709967:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1789117909.713109:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1789117909.713581:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1789117909.714095:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1789117909.714752:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1789117909.715071:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1789117909.715248:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1789117909.715443:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1789117909.715723:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1789117909.715930:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1789117909.716754:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1789117909.717790:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1789117909.718300:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1789117909.718562:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1789117909.718896:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1789117909.719447:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1789117909.719714:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1789117909.719893:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1789117909.720168:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1789117909.720983:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1789117909.721941:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1789117909.722362:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1789117909.727322:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789117909.727708:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789117909.728450:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789117909.730437:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789117909.732815:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1789117909.733760:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1789117909.734121:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1789117909.734463:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789117909.735142:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1789117909.735927:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1789117909.736313:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789117909.736979:0:18533:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:0.0:1789117909.739148:0:18533:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789117909.739392:0:18533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789117909.739403:0:18533:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789117909.739416:0:18533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xaa253ed19be20bd3 00000020:01000004:0.0:1789117909.739423:0:18533:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789117909.739443:0:18533:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.130@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789117909.739447:0:18533:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789117909.739453:0:18533:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789117909.739477:0:18533:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789117909.739481:0:18533:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.130@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789117909.750745:0:18533:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789117909.750787:0:18533:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.130@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1789117909.750791:0:18533:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789117909.750793:0:18533:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789117909.750795:0:18533:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117909.750796:0:18533:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789117909.750797:0:18533:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117909.750798:0:18533:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117909.750800:0:18533:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789117909.750801:0:18533:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117909.750803:0:18533:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789117909.750806:0:18533:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1789117909.750808:0:18533:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789117909.750810:0:18533:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789117909.750811:0:18533:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117909.750812:0:18533:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789117909.750813:0:18533:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117909.750814:0:18533:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117909.750815:0:18533:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789117909.750816:0:18533:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117909.750817:0:18533:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789117909.750843:0:18533:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789117909.750862:0:18533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fab0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593237632:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789117909.750931:0:18533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117909.750994:0:18533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbcdd4540 going to sleep for 11 seconds 00000100:00100000:3.0:1789117909.751152:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593237632 00000100:00100000:3.0:1789117909.751160:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593237632 00000100:00100000:3.0:1789117909.751208:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789117909.751218:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+12:18533:x1876025593237632:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789117909.751249:0:17790:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789117909.751252:0:17790:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1789117909.751259:0:17790:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789117909.752049:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+12:18533:x1876025593237632:12345-0@lo:253:mount.lustre.0 Request processed in 830us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117909.752077:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789117909.752209:0:18533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fab0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593237632:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789117909.752220:0:18533:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789117909.752223:0:18533:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789117909.752224:0:18533:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789117909.752226:0:18533:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117909.752227:0:18533:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789117909.752228:0:18533:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117909.752229:0:18533:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117909.752230:0:18533:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789117909.752232:0:18533:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117909.752234:0:18533:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789117909.752251:0:18533:0:(tgt_mount.c:101:server_register_mount()) register mount ffff962bbf6a1000 from lustre-MDT0001 10000000:01000000:0.0:1789117909.752278:0:18533:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789117909.752288:0:18533:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789117909.752295:0:18533:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff962bbfacced8 local copy 00010000:00010000:0.0:1789117909.752305:0:18533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be20ac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20ad0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117909.752394:0:18533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fab0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593237760:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789117909.752426:0:18533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117909.752461:0:18533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbcdd4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789117909.752517:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593237760 00000100:00100000:1.0:1789117909.752522:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593237760 00000100:00100000:1.0:1789117909.752567:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789117909.752575:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+12:18533:x1876025593237760:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117909.752641:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+12:18533:x1876025593237760:12345-0@lo:501:mount.lustre.0 Request processed in 67us (215us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789117909.752656:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789117909.752777:0:18533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fab0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593237760:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789117909.752789:0:18533:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789117909.752806:0:18533:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789117909.752812:0:18533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be20ac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20ad0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117909.752831:0:18533:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be20ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20ad0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117909.752853:0:18533:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff962bbf6a1000 10000000:01000000:2.0:1789117909.752857:0:18533:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789117909.752862:0:18533:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff962bbfacced8 10000000:01000000:2.0:1789117909.752864:0:18533:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789117909.752868:0:18533:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff962bbfacced8 from 1 10000000:01000000:2.0:1789117909.752870:0:18533:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789117909.752891:0:18533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a887f3800/0xaa253ed19be20bda lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117909.752898:0:18533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a887f3800/0xaa253ed19be20bda lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117909.752907:0:18533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a887f3800/0xaa253ed19be20bda lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117909.752919:0:18533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593237888:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789117909.752944:0:18533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117909.752964:0:18533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84f40e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789117909.753279:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593237888 00000100:00100000:0.0:1789117909.753284:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593237888 00000100:00100000:0.0:1789117909.753316:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789117909.753322:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+12:18533:x1876025593237888:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789117909.753331:0:17791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117909.753343:0:17791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be20be1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20bda expref: -99 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117909.753363:0:17791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be20be1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20bda expref: 13 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117909.753374:0:17791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be20be1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20bda expref: 13 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117909.753383:0:17791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f5e00, rc 0) 00000100:00100000:0.0:1789117909.753418:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+13:18533:x1876025593237888:12345-0@lo:101:mount.lustre.0 Request processed in 96us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117909.753424:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789117909.753489:0:18533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593237888:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789117909.753501:0:18533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a887f3800/0xaa253ed19be20bda lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20be1 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117909.753510:0:18533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a887f3800/0xaa253ed19be20bda lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20be1 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117909.753548:0:18533:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789117909.753565:0:18533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a887f3800/0xaa253ed19be20bda lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20be1 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117909.753572:0:18533:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a887f3800/0xaa253ed19be20bda lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20be1 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117909.753579:0:18533:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff962bbf6a1000 10000000:01000000:2.0:1789117909.753583:0:18533:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789117909.753586:0:18533:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff962bbf6a1000 from 1 10000000:01000000:2.0:1789117909.753588:0:18533:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789117909.753602:0:18533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a887f3a00/0xaa253ed19be20be8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117909.753609:0:18533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a887f3a00/0xaa253ed19be20be8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117909.753617:0:18533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a887f3a00/0xaa253ed19be20be8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117909.753629:0:18533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593238016:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789117909.753662:0:18533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117909.753679:0:18533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84f40e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789117909.753782:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593238016 00000100:00100000:1.0:1789117909.753786:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593238016 00000100:00100000:1.0:1789117909.753804:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789117909.753809:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+13:18533:x1876025593238016:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789117909.753816:0:17793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117909.753823:0:17793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813dae00/0xaa253ed19be20bef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20be8 expref: -99 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117909.753842:0:17793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813dae00/0xaa253ed19be20bef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20be8 expref: 14 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117909.753850:0:17793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813dae00/0xaa253ed19be20bef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20be8 expref: 14 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117909.753858:0:17793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813dae00, rc 0) 00000100:00100000:1.0:1789117909.753890:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+14:18533:x1876025593238016:12345-0@lo:101:mount.lustre.0 Request processed in 81us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117909.753896:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789117909.753996:0:18533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593238016:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789117909.754014:0:18533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a887f3a00/0xaa253ed19be20be8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20bef expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117909.754022:0:18533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a887f3a00/0xaa253ed19be20be8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20bef expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117909.754037:0:18533:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789117909.754041:0:18533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a887f3a00/0xaa253ed19be20be8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20bef expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117909.754047:0:18533:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a887f3a00/0xaa253ed19be20be8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20bef expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117909.754078:0:18533:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789117909.754081:0:18533:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789117909.754085:0:18533:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff962bbf6a1000 10000000:01000000:2.0:1789117909.754087:0:18533:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789117909.754090:0:18533:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789117909.754092:0:18533:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789117909.754104:0:18533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a887f2a00/0xaa253ed19be20bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117909.754111:0:18533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a887f2a00/0xaa253ed19be20bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117909.754118:0:18533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a887f2a00/0xaa253ed19be20bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117909.754130:0:18533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593238144:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789117909.754153:0:18533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117909.754166:0:18533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84f40e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789117909.754269:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593238144 00000100:00100000:1.0:1789117909.754273:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593238144 00000100:00100000:1.0:1789117909.754300:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789117909.754305:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+14:18533:x1876025593238144:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789117909.754312:0:17793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117909.754319:0:17793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813db600/0xaa253ed19be20bfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20bf6 expref: -99 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117909.754331:0:17793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813db600/0xaa253ed19be20bfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20bf6 expref: 15 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117909.754340:0:17793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813db600/0xaa253ed19be20bfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20bf6 expref: 15 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117909.754346:0:17793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813db600, rc 0) 00000100:00100000:1.0:1789117909.754380:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+15:18533:x1876025593238144:12345-0@lo:101:mount.lustre.0 Request processed in 74us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117909.754386:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789117909.754503:0:18533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593238144:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789117909.754513:0:18533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a887f2a00/0xaa253ed19be20bf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20bfd expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117909.754538:0:18533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a887f2a00/0xaa253ed19be20bf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20bfd expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789117909.758773:0:18533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1789117909.763402:0:18533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789117909.780683:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789117909.780736:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1789117909.780750:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1789117909.780761:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1789117909.780773:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1789117909.780784:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1789117909.780796:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:2.0:1789117909.780812:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1789117909.780823:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1789117909.780835:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:2.0:1789117909.780846:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:2.0:1789117909.780858:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:2.0:1789117909.780869:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:2.0:1789117909.780884:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1789117909.780896:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1789117909.780907:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:2.0:1789117909.780918:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1789117909.780929:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1789117909.780940:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:2.0:1789117909.780952:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1789117909.780963:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1789117909.780974:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1789117909.780985:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1789117909.781008:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:2.0:1789117909.781012:0:18533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:2.0:1789117909.781159:0:18533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593238272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789117909.781232:0:18533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117909.781264:0:18533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84f40240 going to sleep for 11 seconds 00000100:00100000:1.0:1789117909.788030:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593238272 00000100:00100000:1.0:1789117909.788047:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593238272 00000100:00100000:1.0:1789117909.788139:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789117909.788150:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+15:18533:x1876025593238272:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117909.788355:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+15:18533:x1876025593238272:12345-0@lo:501:mount.lustre.0 Request processed in 206us (7122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117909.788363:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789117909.789781:0:18533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593238272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789117909.789835:0:18533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593238400:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789117909.789900:0:18533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117909.789942:0:18533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84f40240 going to sleep for 11 seconds 00000100:00100000:0.0:1789117909.789990:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593238400 00000100:00100000:0.0:1789117909.789996:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593238400 00000100:00100000:0.0:1789117909.790038:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789117909.790077:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+15:18533:x1876025593238400:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789117909.790978:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+15:18533:x1876025593238400:12345-0@lo:503:mount.lustre.0 Request processed in 924us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117909.790987:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789117909.791141:0:18533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593238400:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789117909.791588:0:18533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789117909.791778:0:18533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593238528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789117909.791823:0:18533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117909.791852:0:18533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84f40e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789117909.791922:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593238528 00000100:00100000:0.0:1789117909.791927:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593238528 00000100:00100000:0.0:1789117909.791952:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789117909.791959:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+15:18533:x1876025593238528:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789117909.792844:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+15:18533:x1876025593238528:12345-0@lo:502:mount.lustre.0 Request processed in 882us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117909.792852:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789117909.793500:0:18533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593238528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789117909.793711:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789117909.793737:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:2.0:1789117909.793752:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:2.0:1789117909.793764:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:2.0:1789117909.793775:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:2.0:1789117909.793786:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:2.0:1789117909.793797:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:2.0:1789117909.793809:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:2.0:1789117909.793819:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:2.0:1789117909.793831:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:2.0:1789117909.793843:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:2.0:1789117909.793854:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:2.0:1789117909.793865:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:2.0:1789117909.793876:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:2.0:1789117909.793887:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:2.0:1789117909.793908:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:2.0:1789117909.793919:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:2.0:1789117909.793931:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:2.0:1789117909.793942:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:2.0:1789117909.793953:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1789117909.793964:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1789117909.793976:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1789117909.793987:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1789117909.793998:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1789117909.794010:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1789117909.794021:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1789117909.794032:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1789117909.794044:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1789117909.794074:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1789117909.794087:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1789117909.794099:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1789117909.794110:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1789117909.794121:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1789117909.794132:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1789117909.794143:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1789117909.794168:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1789117909.794180:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1789117909.794191:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1789117909.794202:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1789117909.794213:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1789117909.794223:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1789117909.794234:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1789117909.794261:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1789117909.794273:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1789117909.794305:0:18533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593238656:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789117909.794358:0:18533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117909.794393:0:18533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84f40e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789117909.795760:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593238656 00000100:00100000:0.0:1789117909.795771:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593238656 00000100:00100000:0.0:1789117909.795819:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789117909.795828:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+15:18533:x1876025593238656:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789117909.795975:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+15:18533:x1876025593238656:12345-0@lo:502:mount.lustre.0 Request processed in 146us (1616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117909.795983:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789117909.799410:0:18533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593238656:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789117909.799540:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1789117909.799555:0:18533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1789117909.800483:0:18537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117909.800495:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117909.800497:0:18537:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789117909.800502:0:18537:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1789117909.800505:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789117909.800520:0:18537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff962bbcdd9a48) 00000020:00000080:2.0:1789117909.800553:0:18537:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1789117909.800559:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789117909.800935:0:18537:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789117909.800945:0:18537:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xaa253ed19be20c0b 00000020:00000080:2.0:1789117909.801209:0:18537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789117909.801213:0:18537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117909.801216:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117909.801218:0:18537:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789117909.801221:0:18537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117909.801224:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117909.801225:0:18537:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1789117909.801228:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789117909.801249:0:18537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff962bbcddced8) 00000020:00000080:2.0:1789117909.801261:0:18537:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1789117909.801265:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789117909.801267:0:18537:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1789117909.801271:0:18537:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1789117909.801277:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789117909.801320:0:18537:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962bbf6a1000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1789117909.801338:0:18537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff962bbd00b490) 00000020:00000080:2.0:1789117909.801349:0:18537:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1789117909.801433:0:18537:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789117909.801439:0:18537:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xaa253ed19be20c20 00000020:00000080:2.0:1789117909.801564:0:18537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1789117909.801572:0:18537:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789117909.801576:0:18537:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xaa253ed19be20c27 00080000:01000000:2.0:1789117909.801584:0:18537:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789117909.801587:0:18537:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xaa253ed19be20c2e 00010000:00010000:0.0:1789117909.961903:0:18537:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1789117909.962445:0:18537:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:0.0:1789117909.962747:0:18537:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789117909.963671:0:18537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1789117909.963682:0:18537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117909.963687:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117909.963689:0:18537:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1789117909.963693:0:18537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117909.963697:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117909.963703:0:18537:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1789117909.963707:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789117909.963712:0:18537:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:00000080:0.0:1789117909.963739:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789117909.963753:0:18537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff962a87e24ed8) 00000020:00000080:0.0:1789117909.963772:0:18537:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1789117909.963776:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789117909.963847:0:18537:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1789117909.963854:0:18537:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789117909.963862:0:18537:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xaa253ed19be20c3c 00010000:00080000:0.0:1789117909.963893:0:18537:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962bbf326800@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.130@tcp at head 00010000:00010000:0.0:1789117909.965412:0:18537:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1789117909.971360:0:18537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789117909.971376:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789117909.971428:0:18537:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789117909.971452:0:18537:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xaa253ed19be20c43 00000100:00080000:1.0:1789117909.971463:0:18537:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789117909.971469:0:18537:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff962bbf326800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789117909.971509:0:18537:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bc1a74f00 x1876025593238784/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789117909.971552:0:18537:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789117909.971577:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789117909.971581:0:14597:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789117909.971584:0:14597:0:(import.c:65:import_set_state_nolock()) ffff962bae4d5000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789117909.971588:0:14597:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 558 00000100:00080000:1.0:1789117909.971592:0:14597:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789117909.971595:0:14597:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff962bae4d5000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789117909.971609:0:14597:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bc1a77480 x1876025593238912/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789117909.971620:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117909.971623:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789117909.971631:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117909.971634:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789117909.972108:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593238784:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789117909.972178:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117909.972228:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593238912:0@lo:38:kworker.0 00000100:00100000:3.0:1789117909.972268:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117909.972301:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593238784 00000100:00100000:3.0:1789117909.972308:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593238784 00000100:00100000:3.0:1789117909.972328:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593238912 00000100:00100000:3.0:1789117909.972330:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593238912 00000100:00100000:3.0:1789117909.972340:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789117909.972348:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0718b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876025593238784:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789117909.972372:0:17803:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 562 last 0 00000020:00000080:3.0:1789117909.972406:0:17803:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xaa253ed19be20c4a 00000004:00100000:3.0:1789117909.972423:0:17803:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789117909.972436:0:17803:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1789117909.972733:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593239040:0@lo:400:kworker.0 00000100:00100000:0.0:1789117909.972772:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117909.972812:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593239040 00000100:00100000:0.0:1789117909.972816:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593239040 00000100:00100000:0.0:1789117909.972853:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789117909.972861:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593239040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117909.972909:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593239040:12345-0@lo:400:kworker.0 Request processed in 49us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117909.972916:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789117909.972952:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff962bc1a74780 x1876025593239040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117909.972965:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593239040:0@lo:400:kworker.0 00000020:01000000:1.0:1789117909.982046:0:18537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117909.982080:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117909.982083:0:18537:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789117909.982087:0:18537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789117909.982090:0:18537:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789117909.982092:0:18537:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789117909.982093:0:18537:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789117909.982095:0:18537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789117909.982098:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117909.982099:0:18537:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789117909.982101:0:18537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789117909.982106:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117909.982107:0:18537:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789117909.982111:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789117909.982168:0:18537:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789117909.982180:0:18537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117909.982183:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117909.982184:0:18537:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789117909.982186:0:18537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789117909.982188:0:18537:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1789117909.982189:0:18537:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789117909.982191:0:18537:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789117909.982192:0:18537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789117909.982195:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117909.982196:0:18537:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789117909.982198:0:18537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789117909.982201:0:18537:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789117909.982204:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117909.982205:0:18537:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789117909.982208:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789117909.982217:0:18537:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:01000000:1.0:1789117909.982256:0:18537:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789117909.982259:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789117909.982275:0:18537:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff962bbfac9a48) 00000020:00000080:1.0:1789117909.982295:0:18537:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789117909.982299:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789117909.982361:0:18537:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789117909.982368:0:18537:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789117909.982374:0:18537:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xaa253ed19be20c58 00010000:00080000:1.0:1789117909.982408:0:18537:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962b90dba800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.130@tcp at head 00010000:00010000:1.0:1789117909.982828:0:18537:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:1.0:1789117909.983632:0:18537:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789117909.985013:0:18537:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789117909.992137:0:18537:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789117909.992334:0:18537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789117909.992489:0:18537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:1.0:1789117909.993220:0:18542:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789117909.993227:0:18542:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00010000:00010000:0.0:1789117909.993508:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789117909.993665:0:17803:0:(import.c:65:import_set_state_nolock()) ffff962bbf4b3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789117909.993781:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0718b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1876025593238784:12345-0@lo:38:llog_process_th.0 Request processed in 21430us (21601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117909.993793:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789117909.993825:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789117909.993832:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876025593238912:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1789117909.993874:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876025593238912:12345-0@lo:38:kworker.0 Request processed in 42us (21606us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789117909.993880:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789117909.994022:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789117909.994031:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789117909.994040:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789117909.994045:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789117909.994048:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbf326800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789117909.994084:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593238784:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789117909.994097:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789117909.994101:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bae4d5000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789117909.994105:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789117909.994108:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593238912:0@lo:38:kworker.0 00000100:00100000:2.0:1789117909.994378:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789117909.994396:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593239168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117909.994442:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117909.994513:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593239168 00000100:00100000:0.0:1789117909.994521:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593239168 00000100:00100000:0.0:1789117909.994578:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789117909.994597:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1876025593239168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789117909.994630:0:17804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789117909.994682:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1876025593239168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117909.994690:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789117909.994806:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593239168:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1789117909.995841:0:18537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789117909.995855:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789117909.995890:0:18537:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789117909.995907:0:18537:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xaa253ed19be20c5f 00000100:00080000:3.0:1789117909.995914:0:18537:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789117909.995920:0:18537:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff962b90dba800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789117909.995948:0:18537:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962ba0718780 x1876025593239296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789117909.996117:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0718780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593239296:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789117909.996165:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876025593239296 offset 0 length 520: 4 00000100:00080000:3.0:1789117909.996316:0:18537:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789117909.996368:0:18537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117909.996372:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117909.996374:0:18537:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789117909.996378:0:18537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789117909.996381:0:18537:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1789117909.996382:0:18537:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789117909.996384:0:18537:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789117909.996385:0:18537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789117909.996388:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117909.996390:0:18537:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789117909.996392:0:18537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789117909.996397:0:18537:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789117909.996400:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117909.996401:0:18537:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789117909.996404:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789117909.996408:0:18537:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:01000000:3.0:1789117909.996427:0:18537:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789117909.996430:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789117909.996454:0:18537:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff962b8ee0b490) 00000020:00000080:3.0:1789117909.996467:0:18537:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1789117909.996472:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789117909.996552:0:18537:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1789117909.996558:0:18537:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789117909.996563:0:18537:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xaa253ed19be20c6d 00010000:00080000:3.0:1789117909.996591:0:18537:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962bc1a36800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.130@tcp at head 00000100:00080000:1.0:1789117909.996719:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117909.996724:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789117909.996726:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117909.996729:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789117909.996948:0:18537:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1789117909.997095:0:18537:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789117909.997108:0:18537:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789117909.998876:0:18537:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789117909.999160:0:18537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789117909.999444:0:18537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1789117910.000050:0:18544:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789117910.000081:0:18544:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789117910.000895:0:18537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789117910.000907:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789117910.000945:0:18537:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789117910.000967:0:18537:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xaa253ed19be20c74 00000100:00080000:3.0:1789117910.000978:0:18537:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789117910.000984:0:18537:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff962bc1a36800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789117910.001205:0:18537:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962ba0719e00 x1876025593239424/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789117910.001257:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0719e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593239424:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789117910.001314:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876025593239424 offset 0 length 520: 4 00000100:00080000:3.0:1789117910.001370:0:18537:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789117910.001427:0:18537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117910.001431:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117910.001433:0:18537:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789117910.001436:0:18537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117910.001440:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117910.001442:0:18537:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789117910.001445:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789117910.001447:0:18537:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789117910.001449:0:18537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117910.001458:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117910.001459:0:18537:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789117910.001462:0:18537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117910.001464:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117910.001465:0:18537:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789117910.001468:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789117910.001495:0:18537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117910.001498:0:18537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117910.001499:0:18537:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789117910.001503:0:18537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:3.0:1789117910.001569:0:18533:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1789117910.001666:0:18533:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789117910.001687:0:18533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a887f2a00/0xaa253ed19be20bf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20bfd expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117910.001700:0:18533:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a887f2a00/0xaa253ed19be20bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20bfd expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117910.001709:0:18533:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962bbf6a1000 from 1 10000000:01000000:3.0:1789117910.001712:0:18533:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789117910.001741:0:18533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be20c7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117910.001750:0:18533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be20c7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117910.001762:0:18533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be20c7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117910.001780:0:18533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593239552:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789117910.001826:0:18533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117910.001852:0:18533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf839cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117910.002094:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593239552 00000100:00100000:0.0:1789117910.002102:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593239552 00000100:00100000:0.0:1789117910.002150:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789117910.002159:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+15:18533:x1876025593239552:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789117910.002175:0:17790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117910.002191:0:17790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bc20f5a00/0xaa253ed19be20c82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20c7b expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117910.002220:0:17790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bc20f5a00/0xaa253ed19be20c82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20c7b expref: 16 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117910.002232:0:17790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bc20f5a00/0xaa253ed19be20c82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20c7b expref: 16 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117910.002242:0:17790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bc20f5a00, rc 0) 00000100:00100000:0.0:1789117910.002285:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+16:18533:x1876025593239552:12345-0@lo:101:mount.lustre.0 Request processed in 126us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117910.002292:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1789117910.002478:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117910.002484:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789117910.002488:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117910.002491:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789117910.002900:0:18533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593239552:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789117910.002917:0:18533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be20c7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20c82 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117910.002927:0:18533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be20c7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20c82 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117910.003453:0:18533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593239680:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789117910.003500:0:18533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117910.003539:0:18533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf839cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117910.003703:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593239680 00000100:00100000:1.0:1789117910.003709:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593239680 00000100:00100000:1.0:1789117910.003739:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789117910.003748:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+16:18533:x1876025593239680:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789117910.003766:0:17793:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789117910.003783:0:17793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789117910.003786:0:17793:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789117910.003871:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+16:18533:x1876025593239680:12345-0@lo:256:mount.lustre.0 Request processed in 125us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117910.003879:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789117910.004134:0:18533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593239680:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789117910.004872:0:18533:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789117910.004924:0:18533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be20c7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20c82 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117910.004935:0:18533:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be20c7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20c82 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117910.004942:0:18533:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962bbf6a1000 from 1 10000000:01000000:3.0:1789117910.004945:0:18533:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789117910.004972:0:18533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20c89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117910.004978:0:18533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20c89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117910.004988:0:18533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20c89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117910.005025:0:18533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593239808:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789117910.005091:0:18533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117910.005122:0:18533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf839cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117910.005242:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593239808 00000100:00100000:1.0:1789117910.005247:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593239808 00000100:00100000:1.0:1789117910.005284:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789117910.005292:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+16:18533:x1876025593239808:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789117910.005302:0:17791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117910.005313:0:17791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813dba00/0xaa253ed19be20c90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20c89 expref: -99 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.005333:0:17791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813dba00/0xaa253ed19be20c90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20c89 expref: 17 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.005342:0:17791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813dba00/0xaa253ed19be20c90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20c89 expref: 17 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.005362:0:17791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813dba00, rc 0) 00000100:00100000:1.0:1789117910.005401:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+17:18533:x1876025593239808:12345-0@lo:101:mount.lustre.0 Request processed in 110us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117910.005408:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789117910.005468:0:18533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593239808:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789117910.005479:0:18533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20c89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20c90 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117910.005487:0:18533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20c89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20c90 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789117910.005612:0:18533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789117910.005647:0:18533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593239936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789117910.005672:0:18533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117910.005691:0:18533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf839e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789117910.005776:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593239936 00000100:00100000:1.0:1789117910.005780:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593239936 00000100:00100000:1.0:1789117910.005809:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789117910.005815:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+17:18533:x1876025593239936:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117910.005893:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+17:18533:x1876025593239936:12345-0@lo:501:mount.lustre.0 Request processed in 77us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117910.005900:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789117910.005983:0:18533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593239936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789117910.006182:0:18533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593240064:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789117910.006223:0:18533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117910.006282:0:18533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf839e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789117910.006438:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593240064 00000100:00100000:1.0:1789117910.006442:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593240064 00000100:00100000:1.0:1789117910.006537:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789117910.006544:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+17:18533:x1876025593240064:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789117910.006622:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+17:18533:x1876025593240064:12345-0@lo:503:mount.lustre.0 Request processed in 79us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117910.006629:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789117910.006693:0:18533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593240064:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789117910.007018:0:18533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789117910.007114:0:18533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593240192:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789117910.007147:0:18533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117910.007510:0:18533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf839cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117910.007575:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593240192 00000100:00100000:2.0:1789117910.007581:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593240192 00000100:00100000:2.0:1789117910.007617:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789117910.007624:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+17:18533:x1876025593240192:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789117910.007816:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+17:18533:x1876025593240192:12345-0@lo:502:mount.lustre.0 Request processed in 192us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117910.007823:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789117910.008709:0:18533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593240192:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789117910.008923:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789117910.008950:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1789117910.008962:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1789117910.008973:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1789117910.008984:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1789117910.008996:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1789117910.009204:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1789117910.009218:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 144 off9680 00000040:00080000:3.0:1789117910.009231:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9904 00000040:00080000:3.0:1789117910.009253:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10128 00000040:00080000:3.0:1789117910.009265:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 144 off10272 00000040:00080000:3.0:1789117910.009277:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10496 00000040:00080000:3.0:1789117910.009288:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 224 off10720 00000040:00080000:3.0:1789117910.009316:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10848 00000040:00080000:3.0:1789117910.009329:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 224 off11072 00000040:00080000:3.0:1789117910.009340:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 224 off11296 00000040:00080000:3.0:1789117910.009351:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 128 off11424 00000100:00100000:3.0:1789117910.009389:0:18533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593240320:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789117910.009452:0:18533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117910.009597:0:18533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf839cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117910.009689:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593240320 00000100:00100000:2.0:1789117910.009696:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593240320 00000100:00100000:2.0:1789117910.009778:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789117910.009787:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+17:18533:x1876025593240320:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789117910.009906:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+17:18533:x1876025593240320:12345-0@lo:502:mount.lustre.0 Request processed in 120us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117910.009915:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789117910.009984:0:18533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593240320:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789117910.010033:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11648 00000040:00080000:3.0:1789117910.010041:0:18533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:3.0:1789117910.010698:0:18546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117910.010707:0:18546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117910.010710:0:18546:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789117910.010715:0:18546:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962bbf6a1000 00000020:00000080:3.0:1789117910.010717:0:18546:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789117910.010724:0:18546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117910.010727:0:18546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117910.010733:0:18546:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789117910.010736:0:18546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117910.010738:0:18546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117910.010740:0:18546:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789117910.010743:0:18546:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962bbf6a1000 00000020:00000080:3.0:1789117910.010745:0:18546:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789117910.010798:0:18546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117910.010801:0:18546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117910.010802:0:18546:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789117910.010804:0:18546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117910.010806:0:18546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117910.010808:0:18546:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789117910.010811:0:18546:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962bbf6a1000 00000020:00000080:3.0:1789117910.010813:0:18546:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789117910.010829:0:18546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117910.010831:0:18546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117910.010832:0:18546:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789117910.010834:0:18546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117910.010837:0:18546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117910.010838:0:18546:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789117910.010841:0:18546:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962bbf6a1000 00000020:00000080:3.0:1789117910.010843:0:18546:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789117910.010856:0:18546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117910.010858:0:18546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117910.010859:0:18546:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789117910.010862:0:18546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117910.010864:0:18546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117910.010865:0:18546:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789117910.010868:0:18546:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962bbf6a1000 00000020:00000080:3.0:1789117910.010870:0:18546:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789117910.010883:0:18546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117910.010886:0:18546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117910.010887:0:18546:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789117910.010894:0:18546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117910.010897:0:18546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117910.010898:0:18546:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789117910.010901:0:18546:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962bbf6a1000 00000020:00000080:3.0:1789117910.010903:0:18546:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789117910.010923:0:18546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117910.010925:0:18546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117910.010927:0:18546:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789117910.010929:0:18546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 19 count 19 00000020:01000000:0.0:1789117910.016076:0:18533:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:0.0:1789117910.016322:0:18533:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789117910.016382:0:18533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20c89 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20c90 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117910.016404:0:18533:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20c89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20c90 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117910.016478:0:18533:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789117910.016482:0:18533:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff962bbf6a1000 10000000:01000000:0.0:1789117910.016485:0:18533:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff962bbf6a1000 10000000:01000000:0.0:1789117910.016490:0:18533:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789117910.016496:0:18533:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962bbf6a1000 from 1 10000000:01000000:0.0:1789117910.016498:0:18533:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789117910.016564:0:18533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bc20f4600/0xaa253ed19be20c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117910.016573:0:18533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962bc20f4600/0xaa253ed19be20c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117910.016584:0:18533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962bc20f4600/0xaa253ed19be20c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117910.016610:0:18533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593240448:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789117910.016685:0:18533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117910.016737:0:18533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf751780 going to sleep for 11 seconds 00000100:00100000:1.0:1789117910.016931:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593240448 00000100:00100000:1.0:1789117910.016939:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593240448 00000100:00100000:1.0:1789117910.017077:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789117910.017087:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+17:18533:x1876025593240448:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789117910.017102:0:17790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117910.017126:0:17790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813daa00/0xaa253ed19be20c9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20c97 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.017164:0:17790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813daa00/0xaa253ed19be20c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20c97 expref: 18 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.017176:0:17790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813daa00/0xaa253ed19be20c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20c97 expref: 18 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.017188:0:17790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813daa00, rc 0) 00000100:00100000:1.0:1789117910.017238:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+18:18533:x1876025593240448:12345-0@lo:101:mount.lustre.0 Request processed in 153us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117910.017245:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789117910.017474:0:18533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593240448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789117910.017491:0:18533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962bc20f4600/0xaa253ed19be20c97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20c9e expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117910.017500:0:18533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962bc20f4600/0xaa253ed19be20c97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20c9e expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789117910.019048:0:18533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1789117910.019501:0:18533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789117910.019808:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1789117910.019831:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1789117910.019846:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1789117910.019860:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1789117910.019873:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1789117910.019887:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1789117910.019902:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1789117910.019914:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1789117910.019929:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1789117910.019940:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1789117910.019953:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1789117910.019965:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1789117910.019979:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1789117910.019993:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1789117910.020088:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1789117910.020120:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1789117910.020137:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1789117910.020158:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1789117910.020174:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1789117910.020186:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1789117910.020197:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1789117910.020210:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1789117910.020222:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1789117910.020235:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1789117910.023778:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1789117910.023827:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1789117910.023851:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1789117910.023869:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1789117910.023901:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1789117910.023907:0:18533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1789117910.024036:0:18533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593240576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789117910.024152:0:18533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117910.024185:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593240576 00000100:00100000:2.0:1789117910.024193:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593240576 00000100:00100000:0.0:1789117910.024201:0:18533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf751480 going to sleep for 11 seconds 00000100:00100000:2.0:1789117910.024245:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789117910.024255:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+18:18533:x1876025593240576:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789117910.024392:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+18:18533:x1876025593240576:12345-0@lo:501:mount.lustre.0 Request processed in 137us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117910.024400:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789117910.024608:0:18533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593240576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789117910.024717:0:18533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593240704:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789117910.024759:0:18533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117910.024829:0:18533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf751480 going to sleep for 11 seconds 00000100:00100000:1.0:1789117910.025193:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593240704 00000100:00100000:1.0:1789117910.025199:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593240704 00000100:00100000:1.0:1789117910.025359:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789117910.025369:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+18:18533:x1876025593240704:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789117910.025665:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+18:18533:x1876025593240704:12345-0@lo:503:mount.lustre.0 Request processed in 298us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117910.025673:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789117910.027511:0:18533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593240704:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789117910.027988:0:18533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789117910.028116:0:18533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593240832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789117910.028180:0:18533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117910.028228:0:18533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf751780 going to sleep for 11 seconds 00000100:00100000:2.0:1789117910.028338:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593240832 00000100:00100000:2.0:1789117910.028345:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593240832 00000100:00100000:2.0:1789117910.028413:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789117910.028424:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+18:18533:x1876025593240832:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789117910.028547:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+18:18533:x1876025593240832:12345-0@lo:502:mount.lustre.0 Request processed in 124us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117910.028556:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789117910.028655:0:18533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593240832:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789117910.028868:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1789117910.028893:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1789117910.028905:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1789117910.028917:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1789117910.028927:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1789117910.028947:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1789117910.028961:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1789117910.028976:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1789117910.028993:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1789117910.029335:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1789117910.029358:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1789117910.029373:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1789117910.029398:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1789117910.029411:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1789117910.029425:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1789117910.029439:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1789117910.029452:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1789117910.029465:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1789117910.029478:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1789117910.030229:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1789117910.030265:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1789117910.030290:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1789117910.030314:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1789117910.030338:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1789117910.030355:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1789117910.030372:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1789117910.030389:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1789117910.030409:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1789117910.030442:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1789117910.030460:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1789117910.030475:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1789117910.030493:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1789117910.030513:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1789117910.030547:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1789117910.030567:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1789117910.030584:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1789117910.030601:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1789117910.030618:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1789117910.030634:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1789117910.030651:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1789117910.030666:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1789117910.030680:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1789117910.030696:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1789117910.030713:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1789117910.030742:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1789117910.030763:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1789117910.030783:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1789117910.030801:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1789117910.030885:0:18533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593240960:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789117910.030968:0:18533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117910.032345:0:18533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c64d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789117910.032745:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593240960 00000100:00100000:0.0:1789117910.032754:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593240960 00000100:00100000:2.0:1789117910.032816:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789117910.032828:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+18:18533:x1876025593240960:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789117910.032972:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+18:18533:x1876025593240960:12345-0@lo:502:mount.lustre.0 Request processed in 147us (2004us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117910.032980:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789117910.035302:0:18533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593240960:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789117910.036208:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1789117910.036246:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1789117910.036299:0:18533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593241088:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789117910.036385:0:18533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117910.036501:0:18533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c64d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789117910.036781:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593241088 00000100:00100000:0.0:1789117910.036789:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593241088 00000100:00100000:0.0:1789117910.036849:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789117910.036858:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+18:18533:x1876025593241088:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789117910.036982:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+18:18533:x1876025593241088:12345-0@lo:502:mount.lustre.0 Request processed in 124us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117910.036991:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789117910.037096:0:18533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593241088:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789117910.037217:0:18533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1789117910.037227:0:18533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789117910.038352:0:18551:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1789117910.038369:0:18551:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff962bbfac8000) 00000020:00000080:1.0:1789117910.038394:0:18551:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1789117910.038493:0:18551:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962bbf6a1000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789117910.038497:0:18551:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962bbf6a1000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789117910.038499:0:18551:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962bbf6a1000 3 00010000:00080000:1.0:1789117910.038540:0:18551:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962bbf4b2000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.130@tcp at head 00010000:00010000:1.0:1789117910.041265:0:18551:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1789117910.046880:0:18551:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1789117910.046961:0:18551:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789117910.046974:0:18551:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xaa253ed19be20cac 00000100:00080000:0.0:1789117910.046986:0:18551:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789117910.046992:0:18551:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff962bbf4b2000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1789117910.047464:0:18551:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87fa9e00 x1876025593241216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789117910.047492:0:18551:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789117910.047532:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117910.047538:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789117910.047541:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117910.047544:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789117910.048115:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876025593241216:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789117910.048218:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117910.048302:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593241216 00000100:00100000:2.0:1789117910.048308:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593241216 00000100:00100000:2.0:1789117910.048345:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117910.048354:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876025593241216:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789117910.048384:0:17800:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 562 last 0 00000020:00000080:2.0:1789117910.048429:0:17800:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xaa253ed19be20cb3 00000004:00100000:2.0:1789117910.048451:0:17800:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789117910.048485:0:17800:0:(import.c:65:import_set_state_nolock()) ffff962bbd048000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789117910.048981:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876025593241216:12345-0@lo:38:llog_process_th.0 Request processed in 625us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117910.048990:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789117910.049040:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962a87fa9e00 x1876025593241216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789117920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117910.049088:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789117910.049096:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789117910.049103:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789117910.049107:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789117910.049110:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbf4b2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789117910.049116:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876025593241216:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789117910.051568:0:18551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:0.0:1789117910.051630:0:18533:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789117910.051659:0:18533:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789117910.051679:0:18533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bc20f4600/0xaa253ed19be20c97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20c9e expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117910.051690:0:18533:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962bc20f4600/0xaa253ed19be20c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20c9e expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789117910.051861:0:18533:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789117910.051864:0:18533:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789117910.051866:0:18533:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117910.051867:0:18533:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789117910.051869:0:18533:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117910.051871:0:18533:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117910.051872:0:18533:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789117910.051874:0:18533:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117910.051876:0:18533:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789117910.051880:0:18533:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1789117910.051882:0:18533:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789117910.051883:0:18533:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789117910.051884:0:18533:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117910.051885:0:18533:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789117910.051886:0:18533:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117910.051888:0:18533:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117910.051889:0:18533:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789117910.051890:0:18533:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117910.051891:0:18533:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789117910.051915:0:18533:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789117910.051935:0:18533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593241344:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789117910.052013:0:18533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117910.052048:0:18533:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf751900 going to sleep for 11 seconds 00000100:00100000:3.0:1789117910.055578:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593241344 00000100:00100000:3.0:1789117910.055595:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593241344 00000100:00100000:3.0:1789117910.056982:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789117910.057005:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+18:18533:x1876025593241344:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789117910.057049:0:17791:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789117910.057080:0:17791:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1789117910.059371:0:17778:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1789117910.059912:0:17791:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789117910.059927:0:17791:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1789117910.060156:0:17814:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789117910.060162:0:17814:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789117910.060191:0:17814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962b813dbe00/0xaa253ed19be20cba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.060212:0:17814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b80031600/0xaa253ed19be20bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20bb7 expref: 18 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.060230:0:17814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962bc20f5a00/0xaa253ed19be20c82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20c7b expref: 18 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.060238:0:17814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962b813dbe00/0xaa253ed19be20cba lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.060283:0:17814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962bc20f5a00/0xaa253ed19be20c82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be20c7b expref: 18 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.060302:0:17814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962bc20f5a00/0xaa253ed19be20c82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be20c7b expref: 18 pid: 17790 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117910.060322:0:17814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17814:1876025593241472:0@lo:104: 00000100:00100000:1.0:1789117910.060434:0:17814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789117910.060489:0:17814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b80031600/0xaa253ed19be20bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be20bb7 expref: 18 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.060499:0:17814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962b80031600/0xaa253ed19be20bbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be20bb7 expref: 18 pid: 17790 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117910.060507:0:17814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17814:1876025593241600:0@lo:104: 00000100:00100000:1.0:1789117910.060538:0:17814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117910.060557:0:17814:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b90609180 going to sleep for 11 seconds 00000100:00100000:1.0:1789117910.060593:0:17782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593241472 00000100:00100000:1.0:1789117910.060601:0:17782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593241472 00000100:00100000:1.0:1789117910.060758:0:17782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593241600 00000100:00100000:1.0:1789117910.060763:0:17782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593241600 00000100:00100000:1.0:1789117910.060784:0:17782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789117910.060793:0:17782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf05977c-16b5-4df3-81bb-3835e509f77c+4:17814:x1876025593241472:12345-0@lo:104: 00010000:00010000:1.0:1789117910.060811:0:17782:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be20c7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20c82 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.060877:0:17782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789117910.060883:0:17782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf05977c-16b5-4df3-81bb-3835e509f77c+4:17814:x1876025593241472:12345-0@lo:104: Request processed in 92us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117910.060891:0:17782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789117910.060906:0:17782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789117910.060912:0:17782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a74780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf05977c-16b5-4df3-81bb-3835e509f77c+3:17814:x1876025593241600:12345-0@lo:104: 00010000:00010000:1.0:1789117910.060920:0:17782:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962a887f2c00/0xaa253ed19be20bb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20bbe expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.060955:0:17782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789117910.060961:0:17782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a74780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf05977c-16b5-4df3-81bb-3835e509f77c+3:17814:x1876025593241600:12345-0@lo:104: Request processed in 49us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117910.060967:0:17782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789117910.060971:0:17814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17814:1876025593241472:0@lo:104: 00000100:00100000:0.0:1789117910.060984:0:17814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17814:1876025593241600:0@lo:104: 00010000:00010000:1.0:1789117910.060991:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789117910.060998:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be20c7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20c82 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.061005:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b80030000 already unused, calling callback (ffffffffc13d9c20) 00010000:00010000:0.0:1789117910.061008:0:17814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962b813dbe00/0xaa253ed19be20cba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117910.061010:0:17787:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be20c7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be20c82 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.061029:0:17787:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be20c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be20c82 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117910.061037:0:17787:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be20c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be20c82 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117910.061954:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789117910.062101:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+18:18533:x1876025593241344:12345-0@lo:253:mount.lustre.0 Request processed in 5103us (10097us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117910.062112:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 10000000:01000000:1.0:1789117910.062149:0:17787:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1789117910.062168:0:18533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:18533:1876025593241344:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789117910.062187:0:18533:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789117910.062192:0:18533:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00010000:00010000:1.0:1789117910.062193:0:17787:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be20c7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20c82 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789117910.062194:0:18533:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789117910.062197:0:18533:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117910.062200:0:18533:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789117910.062202:0:18533:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117910.062205:0:18533:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117910.062207:0:18533:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00010000:00010000:1.0:1789117910.062209:0:17787:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:0.0:1789117910.062209:0:18533:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117910.062212:0:18533:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789117910.062227:0:18533:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1789117910.062236:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be20c7b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20c82 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.062247:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b80030000/0xaa253ed19be20c7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20c82 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.062260:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117910.062262:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117910.062263:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117910.062286:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593241728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117910.062318:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117910.062367:0:17783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593241728 00000100:00100000:1.0:1789117910.062372:0:17783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593241728 00010000:00010000:1.0:1789117910.062396:0:17783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962bc20f5a00/0xaa253ed19be20c82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20c7b expref: 18 pid: 17790 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117910.062420:0:17783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789117910.062427:0:17783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a77c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf05977c-16b5-4df3-81bb-3835e509f77c+18:3647:x1876025593241728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789117910.062438:0:17783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117910.062443:0:17783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962bc20f5a00/0xaa253ed19be20c82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20c7b expref: 18 pid: 17790 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.062453:0:17783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962bc20f5a00/0xaa253ed19be20c82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be20c7b expref: 18 pid: 17790 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.062473:0:17783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bc20f5a00/0xaa253ed19be20c82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be20c7b expref: 18 pid: 17790 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.062486:0:17783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117910.062513:0:17783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a77c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf05977c-16b5-4df3-81bb-3835e509f77c+17:3647:x1876025593241728:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117910.062520:0:17783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789117910.062558:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593241728:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789117910.068941:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117910.068954:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962a887f2c00/0xaa253ed19be20bb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20bbe expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.068966:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f2c00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789117910.068971:0:17786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962a887f2c00/0xaa253ed19be20bb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be20bbe expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.068982:0:17786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962a887f2c00/0xaa253ed19be20bb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be20bbe expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117910.068990:0:17786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962a887f2c00/0xaa253ed19be20bb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be20bbe expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117910.068996:0:17786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789117910.069034:0:17786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962a887f2c00/0xaa253ed19be20bb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20bbe expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.069040:0:17786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117910.069079:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962a887f2c00/0xaa253ed19be20bb7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20bbe expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.069098:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962a887f2c00/0xaa253ed19be20bb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20bbe expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117910.069113:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117910.069115:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117910.069118:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117910.069142:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117910.069144:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117910.069149:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf05977c-16b5-4df3-81bb-3835e509f77c:3644:1876025593241856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789117910.075621:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117910.075702:0:17785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593241856 00000100:00100000:2.0:1789117910.075710:0:17785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593241856 00010000:00010000:2.0:1789117910.075746:0:17785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b80031600/0xaa253ed19be20bbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20bb7 expref: 17 pid: 17790 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117910.075806:0:17785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117910.075817:0:17785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf05977c-16b5-4df3-81bb-3835e509f77c+17:3644:x1876025593241856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789117910.075833:0:17785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117910.075840:0:17785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b80031600/0xaa253ed19be20bbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20bb7 expref: 17 pid: 17790 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117910.075854:0:17785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b80031600/0xaa253ed19be20bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be20bb7 expref: 17 pid: 17790 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117910.075885:0:17785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b80031600/0xaa253ed19be20bbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be20bb7 expref: 17 pid: 17790 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117910.075905:0:17785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962b813dbe00/0xaa253ed19be20cba lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117910.075914:0:17785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813dbe00/0xaa253ed19be20cba lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789117910.075931:0:17785:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015770246s 00010000:00010000:2.0:1789117910.075936:0:17785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962b813dbe00/0xaa253ed19be20cba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117910.075944:0:17785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962b813dbe00/0xaa253ed19be20cba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117910.076188:0:17785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962b813dbe00/0xaa253ed19be20cba lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117910.076196:0:17785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962b813dbe00/0xaa253ed19be20cba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117910.076208:0:17785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dbe00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117910.076213:0:17785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962b813dbe00/0xaa253ed19be20cba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117910.076222:0:17785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962b813dbe00/0xaa253ed19be20cba lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117910.076239:0:17785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962b813dbe00/0xaa253ed19be20cba lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117910.076250:0:17785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117910.076302:0:17785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf05977c-16b5-4df3-81bb-3835e509f77c+16:3644:x1876025593241856:12345-0@lo:103:ldlm_bl.0 Request processed in 487us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117910.076310:0:17785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789117910.076336:0:17814:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962b813dbe00/0xaa253ed19be20cba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117910.076344:0:17814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962b813dbe00/0xaa253ed19be20cba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117910.076351:0:17814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813dbe00/0xaa253ed19be20cba lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117910.076390:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf05977c-16b5-4df3-81bb-3835e509f77c:3644:1876025593241856:0@lo:103:ldlm_bl.0 00000040:01000000:0.0:1789117910.076985:0:18533:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1789117910.077092:0:18560:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1789117910.077097:0:18560:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789117910.079944:0:18561:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789117910.080384:0:18533:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1789117910.082857:0:18561:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789117910.086385:0:18561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789117910.086470:0:18561:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1789117910.089684:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18563:1876025593241984:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789117910.089762:0:18563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1789117910.089771:0:18533:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:2.0:1789117910.089807:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593241984 00000100:00100000:2.0:1789117910.089815:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593241984 00000040:00080000:1.0:1789117910.089830:0:18533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789117910.089873:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789117910.089882:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:18563:x1876025593241984:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789117910.089963:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:18563:x1876025593241984:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 69us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117910.089971:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789117910.089998:0:18563:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b858b0600 going to sleep for 11 seconds 00000100:00100000:2.0:1789117910.090026:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18563:1876025593241984:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1789117910.090076:0:18563:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1789117910.090102:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18563:1876025593242112:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789117910.090144:0:18563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117910.090162:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593242112 00000100:00100000:2.0:1789117910.090165:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593242112 00000100:00100000:2.0:1789117910.090183:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789117910.090189:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:18563:x1876025593242112:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789117910.090274:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:18563:x1876025593242112:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 84us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117910.090282:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000004:00000080:1.0:1789117910.090282:0:18533:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789117910.090291:0:18533:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:2.0:1789117910.090304:0:18563:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b89b6bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789117910.090326:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18563:1876025593242112:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1789117910.090335:0:18533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789117910.090378:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:18563:1876025593242240:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789117910.090406:0:18563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117910.090441:0:17809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593242240 00000100:00100000:2.0:1789117910.090445:0:17809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593242240 00000100:00100000:2.0:1789117910.090471:0:17809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789117910.090478:0:17809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:18563:x1876025593242240:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789117910.090535:0:17809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:18563:x1876025593242240:12345-0@lo:900:lod0001_rec0000.0 Request processed in 45us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117910.090542:0:17809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789117910.090557:0:18563:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b89b6b840 going to sleep for 11 seconds 00010000:00080000:2.0:1789117910.090571:0:18563:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962bbfd15680 x1876025593242240/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789117926 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117910.090582:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:18563:1876025593242240:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789117910.090616:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18563:1876025593242368:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789117910.090649:0:18563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117910.090665:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593242368 00000100:00100000:2.0:1789117910.090668:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593242368 00000100:00100000:2.0:1789117910.090685:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789117910.090691:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:18563:x1876025593242368:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789117910.090729:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:18563:x1876025593242368:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 38us (79us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117910.090735:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789117910.090750:0:18563:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b89b6bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789117910.090762:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18563:1876025593242368:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1789117910.090795:0:18563:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789117910.091754:0:18533:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789117910.092319:0:18533:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789117910.092353:0:18533:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1789117910.097446:0:18533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789117910.099226:0:18533:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:2.0:1789117910.100576:0:18563:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789117910.100647:0:18563:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789117910.100651:0:18563:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:1.0:1789117910.108923:0:18533:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1789117910.135770:0:18533:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789117910.135813:0:18533:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbc5cc1c1f988 00100000:10000000:1.0:1789117910.135822:0:18533:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1789117910.137412:0:18533:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789117910.137464:0:18533:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.130@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789117910.137859:0:18533:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789117910.137951:0:18533:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1789117910.140388:0:18533:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789117910.141017:0:18533:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789117910.507228:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 0 seconds 00010000:00010000:1.0:1789117911.013336:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789117911.082601:0:18556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789117911.525936:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 0 seconds 10000000:01000000:2.0:1789117911.782568:0:17796:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789117911.782577:0:17796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962bbf6a1000 from 8 10000000:01000000:2.0:1789117911.782582:0:17796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789117911.782629:0:17796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a887f2e00/0xaa253ed19be20cc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117911.782650:0:17796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a887f2e00/0xaa253ed19be20cc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117911.782663:0:17796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a887f2e00/0xaa253ed19be20cc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117911.782692:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd152c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593242496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789117911.782763:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117911.782812:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b89b6bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789117911.782953:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593242496 00000100:00100000:0.0:1789117911.782961:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593242496 00000100:00100000:0.0:1789117911.783045:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789117911.783084:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+16:17796:x1876025593242496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117911.783097:0:17793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117911.783127:0:17793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962baea9be00/0xaa253ed19be20cc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20cc1 expref: -99 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117911.783156:0:17793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962baea9be00/0xaa253ed19be20cc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20cc1 expref: 17 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117911.783167:0:17793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962baea9be00/0xaa253ed19be20cc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20cc1 expref: 17 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117911.783177:0:17793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962baea9be00, rc 0) 00000100:00100000:0.0:1789117911.783233:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+17:17796:x1876025593242496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117911.783240:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789117911.783388:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd152c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593242496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117911.783405:0:17796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a887f2e00/0xaa253ed19be20cc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20cc8 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117911.783415:0:17796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a887f2e00/0xaa253ed19be20cc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20cc8 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117911.783478:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0719a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593242624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789117911.783528:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117911.783552:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf839c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789117911.783956:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593242624 00000100:00100000:0.0:1789117911.783961:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593242624 00000100:00100000:0.0:1789117911.784369:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789117911.784377:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+17:17796:x1876025593242624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789117911.784396:0:17793:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789117911.784418:0:17793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789117911.784422:0:17793:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789117911.784523:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+17:17796:x1876025593242624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 146us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117911.784532:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789117911.784788:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0719a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593242624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789117911.784835:0:17796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789117911.784843:0:17796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a887f2e00/0xaa253ed19be20cc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20cc8 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117911.784852:0:17796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a887f2e00/0xaa253ed19be20cc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20cc8 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117911.784861:0:17796:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789117911.784863:0:17796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962a88713800 from 8 10000000:01000000:3.0:1789117911.784866:0:17796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789117911.784891:0:17796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be20ccf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117911.784898:0:17796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be20ccf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117911.784907:0:17796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be20ccf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117911.784925:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0719a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593242752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789117911.785387:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117911.785412:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf839c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789117911.785471:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593242752 00000100:00100000:0.0:1789117911.785477:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593242752 00000100:00100000:0.0:1789117911.785528:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789117911.785536:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+17:17796:x1876025593242752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117911.785547:0:17793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117911.785559:0:17793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962baea9b800/0xaa253ed19be20cd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20ccf expref: -99 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117911.785581:0:17793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962baea9b800/0xaa253ed19be20cd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20ccf expref: 18 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117911.785589:0:17793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962baea9b800/0xaa253ed19be20cd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20ccf expref: 18 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117911.785596:0:17793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962baea9b800, rc 0) 00000100:00100000:0.0:1789117911.785632:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+18:17796:x1876025593242752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117911.785639:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789117911.786182:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0719a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593242752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117911.786205:0:17796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be20ccf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20cd6 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117911.786214:0:17796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be20ccf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20cd6 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117911.786279:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0719a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593242880:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789117911.786315:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117911.786338:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf839c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789117911.788224:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593242880 00000100:00100000:0.0:1789117911.788252:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593242880 00000100:00100000:0.0:1789117911.788351:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789117911.788366:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+18:17796:x1876025593242880:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789117911.788398:0:17790:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789117911.791657:0:17790:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789117911.791669:0:17790:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789117911.791848:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+18:17796:x1876025593242880:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 3484us (5527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117911.791862:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789117911.791992:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0719a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593242880:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789117911.792102:0:17796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789117911.792113:0:17796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be20ccf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20cd6 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117911.792125:0:17796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be20ccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20cd6 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117912.037460:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789117912.111743:0:18556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789117912.550117:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789117913.061666:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117913.573143:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1789117914.086177:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789117914.534168:0:17834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789117914.597201:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789117915.109331:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789117915.494367:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789117915.494375:0:14597:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789117915.494380:0:14597:0:(import.c:65:import_set_state_nolock()) ffff962bae4d5000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789117915.494392:0:14597:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff962bae4d5000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789117915.494431:0:14597:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bc1a761c0 x1876025593243136/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789117915.494457:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117915.494461:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789117915.494463:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117915.494466:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789117915.494490:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117915.494493:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789117915.494496:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117915.494498:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789117915.494537:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593243136:0@lo:38:kworker.0 00000100:00100000:1.0:1789117915.494677:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117915.494771:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593243264:0@lo:400:kworker.0 00000100:00100000:1.0:1789117915.494815:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117915.494835:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117915.494841:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593243392:0@lo:400:kworker.0 00000100:00100000:1.0:1789117915.494900:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117915.494971:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a76d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf05977c-16b5-4df3-81bb-3835e509f77c:3645:1876025593243008:0@lo:400:kworker.0 00000100:00100000:0.0:1789117915.495010:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117915.495044:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789117915.495050:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593243520:0@lo:400:kworker.0 00000100:00100000:0.0:1789117915.495092:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117915.495120:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593243264 00000100:00100000:0.0:1789117915.495129:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593243264 00000100:00100000:0.0:1789117915.495175:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593243520 00000100:00100000:0.0:1789117915.495178:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593243520 00000100:00100000:0.0:1789117915.495194:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789117915.495201:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593243264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117915.495255:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593243264:12345-0@lo:400:kworker.0 Request processed in 54us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117915.495263:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789117915.495279:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789117915.495284:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593243520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117915.495310:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593243520:12345-0@lo:400:kworker.0 Request processed in 26us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117915.495326:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789117915.495364:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962bc1a743c0 x1876025593243520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117915.495370:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593243008 00000100:00100000:2.0:1789117915.495373:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593243136 00000100:00100000:2.0:1789117915.495377:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593243136 00000100:00100000:1.0:1789117915.495377:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593243008 00000100:00100000:0.0:1789117915.495382:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593243520:0@lo:400:kworker.0 00000100:00100000:2.0:1789117915.495394:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593243392 00000100:00100000:2.0:1789117915.495397:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593243392 00000100:00100000:1.0:1789117915.495409:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789117915.495415:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789117915.495416:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+18:3645:x1876025593243008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117915.495432:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876025593243136:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789117915.495457:0:17804:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 567 last 0 00010000:00080000:0.0:1789117915.495465:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962bc1a77840 x1876025593243264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117915.495477:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593243264:0@lo:400:kworker.0 00000100:00100000:1.0:1789117915.495480:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+18:3645:x1876025593243008:12345-0@lo:400:kworker.0 Request processed in 63us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117915.495488:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000020:00000080:2.0:1789117915.495494:0:17804:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa253ed19be20cdd 00000100:00100000:0.0:1789117915.495503:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593243648:0@lo:41:osp-pre-0-1.0 00000004:00100000:2.0:1789117915.495510:0:17804:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789117915.495517:0:17804:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1789117915.495537:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117915.495553:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a76d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf05977c-16b5-4df3-81bb-3835e509f77c:3645:1876025593243008:0@lo:400:kworker.0 00000100:00100000:0.0:1789117915.495595:0:17803:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1789117915.495602:0:17803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1789117915.501566:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593243648 00000100:00100000:2.0:1789117915.501580:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593243648 00000100:00100000:0.0:1789117915.503162:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789117915.503179:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1876025593243392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117915.503295:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1876025593243392:12345-0@lo:400:kworker.0 Request processed in 122us (8394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117915.503304:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789117915.503355:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593243392:0@lo:400:kworker.0 00000100:00100000:0.0:1789117915.503385:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789117915.503392:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593243648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789117915.503429:0:18751:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789117915.503465:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593243648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (7927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117915.503480:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789117915.503508:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593243648:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1789117915.508247:0:17804:0:(import.c:65:import_set_state_nolock()) ffff962bbcfe9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789117915.508350:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876025593243136:12345-0@lo:38:kworker.0 Request processed in 12916us (13672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117915.508363:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1789117915.508437:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789117915.508447:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789117915.508454:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789117915.508466:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bae4d5000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789117915.508483:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007fafcc61): req@ffff962bbfd17840 x1876025593235840/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117915.508501:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593243136:0@lo:38:kworker.0 00000100:00100000:1.0:1789117915.508614:0:17842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117915.508647:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf72b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117915.508658:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789117915.508669:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593243776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789117915.508694:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117915.508722:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593235840 00000100:00100000:1.0:1789117915.508728:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593235840 00000100:00100000:1.0:1789117915.508761:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593243776 00000100:00100000:1.0:1789117915.508775:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593243776 00000100:00100000:1.0:1789117915.508805:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789117915.508812:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17842:x1876025593235840:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789117915.508874:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17842:x1876025593235840:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 62us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117915.508881:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789117915.508892:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789117915.508898:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876025593243776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789117915.508956:0:17803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789117915.509000:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876025593243776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117915.509006:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789117915.509030:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593243776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789117915.509048:0:17842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17840 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17842:1876025593235840:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1789117915.509095:0:17842:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789117915.509123:0:17842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a761c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17842:1876025593243904:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789117915.509147:0:17842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117915.509164:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf612e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789117915.509173:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593243904 00000100:00100000:1.0:1789117915.509177:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593243904 00000100:00100000:1.0:1789117915.509191:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789117915.509196:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17842:x1876025593243904:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789117915.509276:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17842:x1876025593243904:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 80us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117915.509282:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789117915.509313:0:17842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a761c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17842:1876025593243904:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789117915.509378:0:17842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a761c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17842:1876025593244032:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789117915.509402:0:17842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117915.509416:0:17842:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf612e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789117915.509440:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593244032 00000100:00100000:1.0:1789117915.509443:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593244032 00000100:00100000:1.0:1789117915.509460:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789117915.509465:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17842:x1876025593244032:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789117915.509504:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17842:x1876025593244032:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 39us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117915.509509:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789117915.509529:0:17842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a761c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17842:1876025593244032:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1789117915.509565:0:17842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789117915.516323:0:17842:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789117915.516430:0:17842:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 23, retries 0 00000004:00080000:1.0:1789117915.516436:0:17842:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1789117916.138535:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789117916.419957:0:18807:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789117916.526873:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789117901/real 1789117901] req@ffff962bc1a752c0 x1876025593236864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117916 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117916.526914:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962bc1a752c0 x1876025593236864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117916 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117916.526923:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789117901/real 1789117901] req@ffff962bc1a76580 x1876025593236992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117916 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117916.526935:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962bc1a76580 x1876025593236992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117916 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789117916.526958:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bae4d8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789117916.526992:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789117916.526997:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593236864:0@lo:8:kworker.0 00000100:00080000:1.0:1789117916.527003:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b853e0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789117916.527008:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789117916.527011:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593236992:0@lo:8:kworker.0 00000100:00080000:1.0:1789117916.527128:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117916.527132:0:14597:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789117916.527135:0:14597:0:(import.c:65:import_set_state_nolock()) ffff962bae4d8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789117916.527141:0:14597:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 553 00000100:00080000:1.0:1789117916.527147:0:14597:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789117916.527154:0:14597:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff962bae4d8800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789117916.527176:0:14597:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bc1a761c0 x1876025593244416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789117916.527189:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117916.527192:0:14597:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789117916.527193:0:14597:0:(import.c:65:import_set_state_nolock()) ffff962b853e0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789117916.527197:0:14597:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 553 00000100:00080000:1.0:1789117916.527199:0:14597:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789117916.527202:0:14597:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff962b853e0000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789117916.527218:0:14597:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87f470c0 x1876025593244544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789117916.527241:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117916.527245:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789117916.527248:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117916.527256:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789117916.527284:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593244160:0@lo:400:kworker.0 00000100:00100000:1.0:1789117916.527381:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117916.527441:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593244928:0@lo:400:kworker.0 00000100:00100000:1.0:1789117916.527475:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117916.527496:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789117916.527501:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593244800:0@lo:400:kworker.0 00000100:00100000:1.0:1789117916.527522:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117916.527562:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593244672:0@lo:400:kworker.0 00000100:00100000:1.0:1789117916.527584:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117916.527602:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789117916.527607:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593244288:0@lo:400:kworker.0 00000100:00100000:1.0:1789117916.527629:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117916.527663:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593244160 00000100:00100000:1.0:1789117916.527671:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593244160 00000100:00100000:1.0:1789117916.527714:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789117916.527723:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+18:3647:x1876025593244160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117916.527772:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+18:3647:x1876025593244160:12345-0@lo:400:kworker.0 Request processed in 49us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117916.527779:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789117916.527811:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593244928 00000100:00100000:1.0:1789117916.527814:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593244928 00000100:00100000:1.0:1789117916.527839:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593244672 00000100:00100000:1.0:1789117916.527841:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593244672 00000100:00100000:1.0:1789117916.527855:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789117916.527860:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593244928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117916.527899:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593244928:12345-0@lo:400:kworker.0 Request processed in 39us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117916.527905:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789117916.527917:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789117916.527923:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593244672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117916.527952:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593244672:12345-0@lo:400:kworker.0 Request processed in 30us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117916.527958:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789117916.527974:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593244800 00000100:00100000:1.0:1789117916.527978:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593244800 00000100:00100000:1.0:1789117916.527997:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593244288 00000100:00100000:1.0:1789117916.528000:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593244288 00000100:00100000:1.0:1789117916.528011:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789117916.528016:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593244800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117916.528046:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593244800:12345-0@lo:400:kworker.0 Request processed in 29us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117916.528075:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789117916.528088:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789117916.528094:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876025593244288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117916.528122:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876025593244288:12345-0@lo:400:kworker.0 Request processed in 29us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117916.528128:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789117916.528163:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593244416:0@lo:8:kworker.0 00000400:00000100:1.0:1789117916.528183:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876025593244416 offset 0 length 520: 4 00000100:00100000:1.0:1789117916.528197:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593244544:0@lo:8:kworker.0 00000400:00000100:1.0:1789117916.528223:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876025593244544 offset 0 length 520: 4 00000100:00100000:1.0:1789117916.528261:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593244288:0@lo:400:kworker.0 00010000:00080000:1.0:1789117916.528273:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962a87f44000 x1876025593244672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117916.528281:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593244672:0@lo:400:kworker.0 00000100:00100000:1.0:1789117916.528307:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593244800:0@lo:400:kworker.0 00000100:00100000:1.0:1789117916.528315:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593244160:0@lo:400:kworker.0 00010000:00080000:1.0:1789117916.528330:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962a87f44f00 x1876025593244928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117916.528338:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593244928:0@lo:400:kworker.0 00010000:00010000:1.0:1789117917.159549:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789117917.965889:0:18859:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789117917.966395:0:18859:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789117918.187287:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117919.207501:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789117919.548495:0:18910:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789117919.548723:0:18910:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789117919.591812:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789117909/real 1789117909] req@ffff962ba0718780 x1876025593239296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117919 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117919.591887:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962ba0718780 x1876025593239296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117919 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789117919.592168:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b90dba800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789117919.592197:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789117919.592203:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0718780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593239296:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789117919.592317:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789117919.592325:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789117919.592332:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789117919.592335:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789117919.592399:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789117919.592405:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789117919.592408:0:36:0:(import.c:65:import_set_state_nolock()) ffff962b90dba800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789117919.592420:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 562 00000100:00080000:3.0:1789117919.592430:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789117919.592438:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff962b90dba800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789117919.592473:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962ba071ad00 x1876025593245568/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789117919.592488:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789117919.592492:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789117919.592526:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593245312:0@lo:400:kworker.0 00000100:00100000:3.0:1789117919.592653:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117919.592698:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117919.592704:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0719680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593245440:0@lo:400:kworker.0 00000100:00100000:3.0:1789117919.592764:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117919.592815:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593245312 00000100:00100000:3.0:1789117919.592822:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593245312 00000100:00100000:3.0:1789117919.592913:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789117919.592927:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593245312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117919.592981:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593245312:12345-0@lo:400:kworker.0 Request processed in 60us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117919.592994:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789117919.593014:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593245184:0@lo:400:kworker.0 00000100:00100000:0.0:1789117919.593047:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117919.593085:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593245440 00000100:00100000:3.0:1789117919.593089:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593245440 00000100:00100000:0.0:1789117919.593107:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789117919.593113:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba07192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf05977c-16b5-4df3-81bb-3835e509f77c:3645:1876025593245056:0@lo:400:kworker.0 00000100:00100000:3.0:1789117919.593118:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593245184 00000100:00100000:0.0:1789117919.593140:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117919.593147:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593245184 00000100:00100000:0.0:1789117919.593160:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593245696:0@lo:400:kworker.0 00000100:00100000:3.0:1789117919.593173:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789117919.593179:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117919.593183:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba07183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593245440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117919.593206:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789117919.593214:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876025593245184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117919.593251:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876025593245184:12345-0@lo:400:kworker.0 Request processed in 39us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117919.593258:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789117919.593270:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba07183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593245440:12345-0@lo:400:kworker.0 Request processed in 91us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117919.593275:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593245696 00000100:00100000:0.0:1789117919.593278:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593245696 00000100:00100000:3.0:1789117919.593280:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789117919.593299:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789117919.593305:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593245696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117919.593335:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593245696:12345-0@lo:400:kworker.0 Request processed in 29us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117919.593351:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789117919.593353:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0719680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593245440:0@lo:400:kworker.0 00010000:00080000:3.0:1789117919.593369:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962ba0718000 x1876025593245312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1789117919.593375:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962ba071b480 x1876025593245696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117919.593380:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593245312:0@lo:400:kworker.0 00000100:00100000:0.0:1789117919.593395:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593245696:0@lo:400:kworker.0 00000100:00100000:0.0:1789117919.593406:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593245184:0@lo:400:kworker.0 00000100:00100000:2.0:1789117919.593958:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593245056 00000100:00100000:2.0:1789117919.593966:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593245056 00000100:00100000:2.0:1789117919.594014:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789117919.594023:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+18:3645:x1876025593245056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117919.594094:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+18:3645:x1876025593245056:12345-0@lo:400:kworker.0 Request processed in 72us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117919.594101:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789117919.594177:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593245568:0@lo:8:kworker.0 00000400:00000100:2.0:1789117919.594206:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876025593245568 offset 0 length 520: 4 00000100:00100000:3.0:1789117919.594541:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba07192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf05977c-16b5-4df3-81bb-3835e509f77c:3645:1876025593245056:0@lo:400:kworker.0 00010000:00010000:2.0:1789117920.238364:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117920.613779:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789117920.613801:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593245824:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789117920.613883:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117920.613931:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593245952:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117920.613956:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117920.613994:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593245824 00000100:00100000:0.0:1789117920.614001:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593245824 00000100:00100000:2.0:1789117920.614071:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789117910/real 1789117910] req@ffff962ba0719e00 x1876025593239424/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117920 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117920.614094:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962ba0719e00 x1876025593239424/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117920 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789117920.614110:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bc1a36800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789117920.614125:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789117920.614129:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0719e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593239424:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1789117920.614204:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593245952 00000100:00100000:0.0:1789117920.614209:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593245952 00000100:00100000:0.0:1789117920.614228:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789117920.614235:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876025593245824:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789117920.614576:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789117920.614591:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87faa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593245952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789117920.614627:0:18751:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789117920.614682:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87faa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593245952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117920.614689:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00000024:0.0:1789117920.614793:0:17804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789117920.614896:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876025593245824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 661us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117920.614907:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789117920.614911:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117920.614917:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789117920.614920:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117920.614923:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789117920.614936:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593246080:0@lo:400:kworker.0 00000100:00080000:1.0:1789117920.614946:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117920.614950:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789117920.614954:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117920.614957:0:14597:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789117920.614967:0:14597:0:(import.c:65:import_set_state_nolock()) ffff962bc1a36800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1789117920.614973:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789117920.614976:0:14597:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 562 00000100:00080000:1.0:1789117920.614982:0:14597:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789117920.614987:0:14597:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff962bc1a36800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789117920.615011:0:14597:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87f47c00 x1876025593246336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789117920.615040:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593246336:0@lo:8:kworker.0 00000400:00000100:1.0:1789117920.615192:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876025593246336 offset 0 length 520: 4 00000100:00100000:0.0:1789117920.615377:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593246080 00000100:00100000:0.0:1789117920.615383:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593246080 00000100:00100000:0.0:1789117920.615416:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789117920.615423:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+18:3647:x1876025593246080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117920.615461:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+18:3647:x1876025593246080:12345-0@lo:400:kworker.0 Request processed in 39us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117920.615474:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789117920.615514:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593246080:0@lo:400:kworker.0 00000100:00100000:0.0:1789117920.615545:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593245952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117920.615646:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593246208:0@lo:400:kworker.0 00000100:00100000:2.0:1789117920.615680:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117920.615719:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593245824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789117920.615731:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117920.615737:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593246464:0@lo:400:kworker.0 00000100:00100000:2.0:1789117920.615761:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117920.615804:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593246208 00000100:00100000:0.0:1789117920.615808:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593246208 00000100:00100000:0.0:1789117920.615859:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593246464 00000100:00100000:0.0:1789117920.615863:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593246464 00000100:00100000:0.0:1789117920.615880:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789117920.615886:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593246208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117920.615985:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593246208:12345-0@lo:400:kworker.0 Request processed in 98us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117920.615992:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789117920.616007:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789117920.616017:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593246464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117920.616073:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593246464:12345-0@lo:400:kworker.0 Request processed in 39us (292us total) trans 0 rc 0/0 00010000:00080000:1.0:1789117920.617498:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962a87f44000 x1876025593246208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117920.617513:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593246208:0@lo:400:kworker.0 00010000:00080000:0.0:1789117920.617683:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962a87f45680 x1876025593246464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117920.617694:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593246464:0@lo:400:kworker.0 00000100:00100000:2.0:1789117920.626617:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000020:00000080:1.0:1789117921.020310:0:18958:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffaa7b4550 20000000:00000080:1.0:1789117921.020340:0:18958:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff962b8ee7e400 uarg=0000000000000000 20000000:01000000:1.0:1789117921.020378:0:18958:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789117921.020385:0:18958:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789117921.020389:0:18958:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789117921.020962:0:18959:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 19 20000000:00000400:1.0:1789117921.021356:0:18958:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789117921.029576:0:18958:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789117921.029721:0:18958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962baea9ba00/0xaa253ed19be20ce4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117921.029741:0:18958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b813da600/0xaa253ed19be20b8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20b86 expref: 17 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117921.029748:0:18958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b813dba00/0xaa253ed19be20c90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20c89 expref: 17 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117921.029756:0:18958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962baea9ba00/0xaa253ed19be20ce4 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117921.029878:0:18958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b813dba00/0xaa253ed19be20c90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be20c89 expref: 17 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117921.029894:0:18958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962b813dba00/0xaa253ed19be20c90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be20c89 expref: 17 pid: 17791 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117921.029911:0:18958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18958:1876025593246592:0@lo:104: 00000100:00100000:0.0:1789117921.029987:0:18958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789117921.030136:0:18958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b813da600/0xaa253ed19be20b8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be20b86 expref: 17 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117921.030144:0:18958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962b813da600/0xaa253ed19be20b8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be20b86 expref: 17 pid: 17790 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117921.030152:0:18958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18958:1876025593246720:0@lo:104: 00000100:00100000:0.0:1789117921.030176:0:18958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117921.030442:0:18958:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86f3fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789117921.030744:0:17781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593246592 00000100:00100000:1.0:1789117921.030753:0:17781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593246592 00000100:00100000:1.0:1789117921.030865:0:17781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593246720 00000100:00100000:1.0:1789117921.030869:0:17781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593246720 00000100:00100000:1.0:1789117921.030887:0:17781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789117921.030897:0:17781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fab840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf05977c-16b5-4df3-81bb-3835e509f77c+4:18958:x1876025593246592:12345-0@lo:104: 00010000:00010000:1.0:1789117921.030910:0:17781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20c89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20c90 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117921.031039:0:17781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789117921.031046:0:17781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fab840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf05977c-16b5-4df3-81bb-3835e509f77c+4:18958:x1876025593246592:12345-0@lo:104: Request processed in 150us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117921.031073:0:17781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789117921.031097:0:17781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789117921.031103:0:17781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87faa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf05977c-16b5-4df3-81bb-3835e509f77c+3:18958:x1876025593246720:12345-0@lo:104: 00010000:00010000:1.0:1789117921.031111:0:17781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20b86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20b8d expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117921.031159:0:17781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789117921.031165:0:17781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87faa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf05977c-16b5-4df3-81bb-3835e509f77c+3:18958:x1876025593246720:12345-0@lo:104: Request processed in 62us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117921.031171:0:17781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789117921.031245:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789117921.031254:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20c89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20c90 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117921.031261:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b80030200 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:3.0:1789117921.031265:0:17786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20c89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be20c90 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117921.031273:0:17786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20c89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be20c90 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789117921.031279:0:17786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20c89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be20c90 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117921.031284:0:17786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789117921.031333:0:17786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20c89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20c90 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117921.031345:0:17786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789117921.031366:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20c89 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20c90 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117921.031373:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20c89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20c90 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117921.031386:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117921.031389:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20b86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20b8d expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117921.031394:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813da000 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:3.0:1789117921.031397:0:17786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20b86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be20b8d expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117921.031403:0:17786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20b86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be20b8d expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789117921.031409:0:17786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20b86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be20b8d expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117921.031413:0:17786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789117921.031426:0:17786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20b86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20b8d expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117921.031432:0:17786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789117921.031438:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20b86 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20b8d expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117921.031444:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20b86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20b8d expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117921.031463:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117921.031465:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117921.031467:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117921.031473:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117921.031486:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0719680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593246848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789117921.031520:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117921.031552:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117921.031558:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0719e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593246976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789117921.031580:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117921.031613:0:17783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593246848 00000100:00100000:3.0:1789117921.031617:0:17783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593246848 00010000:00010000:3.0:1789117921.031636:0:17783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b813dba00/0xaa253ed19be20c90 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20c89 expref: 18 pid: 17791 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117921.031656:0:17783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593246976 00000100:00100000:3.0:1789117921.031659:0:17783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593246976 00010000:00010000:3.0:1789117921.031669:0:17783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b813da600/0xaa253ed19be20b8d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20b86 expref: 19 pid: 17790 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117921.031681:0:17783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789117921.031687:0:17783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf05977c-16b5-4df3-81bb-3835e509f77c+19:3646:x1876025593246848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789117921.031696:0:17783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117921.031701:0:17783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b813dba00/0xaa253ed19be20c90 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20c89 expref: 19 pid: 17791 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117921.031711:0:17783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b813dba00/0xaa253ed19be20c90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be20c89 expref: 19 pid: 17791 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117921.031737:0:17783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117921.031766:0:17783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf05977c-16b5-4df3-81bb-3835e509f77c+19:3646:x1876025593246848:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117921.031773:0:17783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789117921.031787:0:17783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789117921.031805:0:17783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf05977c-16b5-4df3-81bb-3835e509f77c+18:3646:x1876025593246976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789117921.031814:0:17783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117921.031818:0:17783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b813da600/0xaa253ed19be20b8d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20b86 expref: 18 pid: 17790 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117921.031828:0:17783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b813da600/0xaa253ed19be20b8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be20b86 expref: 18 pid: 17790 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117921.031840:0:17783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962baea9ba00/0xaa253ed19be20ce4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117921.031849:0:17783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962baea9ba00/0xaa253ed19be20ce4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117921.031863:0:17783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962baea9ba00/0xaa253ed19be20ce4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117921.031871:0:17783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962baea9ba00/0xaa253ed19be20ce4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117921.031878:0:17783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962baea9ba00/0xaa253ed19be20ce4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117921.031885:0:17783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962baea9ba00/0xaa253ed19be20ce4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117921.031897:0:17783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9ba00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789117921.031901:0:17783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962baea9ba00/0xaa253ed19be20ce4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117921.031909:0:17783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962baea9ba00/0xaa253ed19be20ce4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117921.031918:0:17783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962baea9ba00/0xaa253ed19be20ce4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117921.031928:0:17783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117921.031951:0:17783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf05977c-16b5-4df3-81bb-3835e509f77c+18:3646:x1876025593246976:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117921.031957:0:17783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789117921.032001:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0719e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593246976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789117921.032010:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0719680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593246848:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789117921.036039:0:18958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813dba00/0xaa253ed19be20c90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be20c89 expref: 17 pid: 17791 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117921.036093:0:18958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18958:1876025593246592:0@lo:104: 00010000:00010000:0.0:1789117921.036133:0:18958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813da600/0xaa253ed19be20b8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be20b86 expref: 16 pid: 17790 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117921.036144:0:18958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18958:1876025593246720:0@lo:104: 00010000:00010000:0.0:1789117921.036178:0:18958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962baea9ba00/0xaa253ed19be20ce4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117921.036212:0:18958:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962baea9ba00/0xaa253ed19be20ce4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117921.036218:0:18958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962baea9ba00/0xaa253ed19be20ce4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117921.036235:0:18958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962baea9ba00/0xaa253ed19be20ce4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117921.273376:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789117921.643814:0:18534:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789117922.283925:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789117922.343921:0:18556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1789117922.981188:0:17796:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789117922.981197:0:17796:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962bbf6a1000 from 19 10000000:01000000:1.0:1789117922.981207:0:17796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789117922.981297:0:17796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813da600/0xaa253ed19be20ceb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117922.981311:0:17796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b813da600/0xaa253ed19be20ceb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117922.981322:0:17796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b813da600/0xaa253ed19be20ceb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117922.981359:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593247104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789117922.981441:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117922.981512:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf6120c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117922.981607:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593247104 00000100:00100000:0.0:1789117922.981616:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593247104 00000100:00100000:0.0:1789117922.981686:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789117922.981699:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+16:17796:x1876025593247104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117922.981718:0:17790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117922.981739:0:17790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962baea9ba00/0xaa253ed19be20cf2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20ceb expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117922.981767:0:17790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962baea9ba00/0xaa253ed19be20cf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20ceb expref: 17 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117922.981780:0:17790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962baea9ba00/0xaa253ed19be20cf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20ceb expref: 17 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117922.981791:0:17790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962baea9ba00, rc 0) 00000100:00100000:0.0:1789117922.981847:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+17:17796:x1876025593247104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117922.981854:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789117922.981982:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593247104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117922.982002:0:17796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b813da600/0xaa253ed19be20ceb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20cf2 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117922.982013:0:17796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b813da600/0xaa253ed19be20ceb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20cf2 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117922.982131:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0719e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593247232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117922.982159:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117922.982188:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84f40240 going to sleep for 11 seconds 00000100:00100000:2.0:1789117922.982353:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593247232 00000100:00100000:2.0:1789117922.982358:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593247232 00000100:00100000:2.0:1789117922.982383:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789117922.982390:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+17:17796:x1876025593247232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117922.982530:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+17:17796:x1876025593247232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117922.982537:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789117922.982667:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0719e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593247232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117922.982699:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0719e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593247360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117922.982736:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117922.982757:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84f40240 going to sleep for 11 seconds 00000100:00100000:0.0:1789117922.982814:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593247360 00000100:00100000:0.0:1789117922.982818:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593247360 00000100:00100000:0.0:1789117922.982837:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789117922.982843:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+17:17796:x1876025593247360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117922.982937:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+17:17796:x1876025593247360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117922.982944:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789117922.983020:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0719e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593247360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789117922.983988:0:19019:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:3.0:1789117922.984223:0:17796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:3.0:1789117922.984249:0:17796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789117922.984259:0:17796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813da600/0xaa253ed19be20ceb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20cf2 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117922.984269:0:17796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b813da600/0xaa253ed19be20ceb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20cf2 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117922.984290:0:17796:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789117922.984292:0:17796:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962a88713800 from 19 10000000:01000000:3.0:1789117922.984295:0:17796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789117922.984343:0:17796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20cf9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117922.984350:0:17796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20cf9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117922.984360:0:17796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20cf9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117922.984383:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0719e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593247488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789117922.984439:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117922.984474:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84f40240 going to sleep for 11 seconds 00000100:00100000:3.0:1789117922.984504:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593247488 00000100:00100000:3.0:1789117922.984510:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593247488 00000100:00100000:3.0:1789117922.984547:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789117922.984556:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+17:17796:x1876025593247488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117922.984568:0:17790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117922.984582:0:17790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b80030800/0xaa253ed19be20d00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20cf9 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117922.984606:0:17790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b80030800/0xaa253ed19be20d00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20cf9 expref: 18 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117922.984616:0:17790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b80030800/0xaa253ed19be20d00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20cf9 expref: 18 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117922.984624:0:17790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b80030800, rc 0) 00000100:00100000:3.0:1789117922.984658:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+18:17796:x1876025593247488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117922.984665:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789117922.984700:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0719e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593247488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117922.984711:0:17796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20cf9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20d00 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117922.984718:0:17796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20cf9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20d00 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117922.984763:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0719e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593247616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117922.984787:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117922.984800:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84f40240 going to sleep for 11 seconds 00000100:00100000:3.0:1789117922.984816:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593247616 00000100:00100000:3.0:1789117922.984819:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593247616 00000100:00100000:3.0:1789117922.984836:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789117922.984841:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+18:17796:x1876025593247616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117922.984941:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+18:17796:x1876025593247616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117922.984949:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789117922.984976:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0719e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593247616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117922.985000:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0719e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593247744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117922.985037:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117922.985050:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84f40240 going to sleep for 11 seconds 00000100:00100000:3.0:1789117922.985084:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593247744 00000100:00100000:3.0:1789117922.985087:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593247744 00000100:00100000:3.0:1789117922.985102:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789117922.985107:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+18:17796:x1876025593247744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117922.985176:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+18:17796:x1876025593247744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117922.985182:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789117922.985222:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0719e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593247744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789117922.985877:0:19020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:3.0:1789117922.985929:0:17796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:3.0:1789117922.985947:0:17796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789117922.985954:0:17796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20cf9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20d00 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117922.985964:0:17796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20cf9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20d00 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117923.301788:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117924.338752:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789117924.774580:0:17834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789117925.351705:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789117925.733522:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117925.733530:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789117925.733533:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117925.733537:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789117925.733561:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117925.733565:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789117925.733567:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117925.733571:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789117925.733607:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593248000:0@lo:400:kworker.0 00000100:00100000:1.0:1789117925.733677:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117925.733728:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789117925.733734:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf05977c-16b5-4df3-81bb-3835e509f77c:3645:1876025593247872:0@lo:400:kworker.0 00000100:00100000:1.0:1789117925.733764:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117925.733785:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593248384:0@lo:400:kworker.0 00000100:00100000:1.0:1789117925.733808:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117925.733832:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593248128:0@lo:400:kworker.0 00000100:00100000:1.0:1789117925.733856:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117925.733873:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117925.733878:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593248256:0@lo:400:kworker.0 00000100:00100000:1.0:1789117925.733899:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117925.733930:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593247872 00000100:00100000:1.0:1789117925.733937:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593247872 00000100:00100000:1.0:1789117925.733979:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789117925.734004:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+18:3645:x1876025593247872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117925.734078:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+18:3645:x1876025593247872:12345-0@lo:400:kworker.0 Request processed in 75us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117925.734087:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789117925.734128:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593248384 00000100:00100000:1.0:1789117925.734132:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593248384 00000100:00100000:1.0:1789117925.734157:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593248128 00000100:00100000:1.0:1789117925.734159:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593248128 00000100:00100000:1.0:1789117925.734172:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789117925.734178:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593248384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117925.734211:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593248384:12345-0@lo:400:kworker.0 Request processed in 33us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117925.734218:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789117925.734241:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789117925.734247:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593248128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117925.734276:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593248128:12345-0@lo:400:kworker.0 Request processed in 30us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117925.734283:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789117925.734313:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962a87f44b40 x1876025593248128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117925.734332:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593248128:0@lo:400:kworker.0 00000100:00100000:1.0:1789117925.734639:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf05977c-16b5-4df3-81bb-3835e509f77c:3645:1876025593247872:0@lo:400:kworker.0 00010000:00080000:1.0:1789117925.734650:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962a87f461c0 x1876025593248384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117925.734659:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593248384:0@lo:400:kworker.0 00000100:00100000:2.0:1789117925.734940:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593248000 00000100:00100000:2.0:1789117925.734947:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593248000 00000100:00100000:2.0:1789117925.734983:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593248256 00000100:00100000:2.0:1789117925.734986:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593248256 00000100:00100000:2.0:1789117925.735000:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789117925.735007:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593248000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117925.735081:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593248000:12345-0@lo:400:kworker.0 Request processed in 74us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117925.735088:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789117925.735102:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789117925.735108:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593248256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117925.735138:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593248256:12345-0@lo:400:kworker.0 Request processed in 31us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117925.735145:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789117925.735188:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593248256:0@lo:400:kworker.0 00000100:00100000:2.0:1789117925.735212:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593248000:0@lo:400:kworker.0 00000100:00100000:0.0:1789117925.735413:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789117925.735424:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593248512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117925.735471:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117925.735971:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593248512 00000100:00100000:2.0:1789117925.735977:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593248512 00000100:00100000:2.0:1789117925.736015:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789117925.736022:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593248512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789117925.736049:0:18751:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789117925.736120:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593248512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117925.736142:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789117925.736179:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593248512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117925.736362:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789117925.736374:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593248640:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789117925.736406:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117925.736436:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593248640 00000100:00100000:1.0:1789117925.736439:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593248640 00000100:00100000:1.0:1789117925.736476:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789117925.736483:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593248640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789117925.736501:0:17804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789117925.736531:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593248640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 49us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117925.736537:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789117925.736560:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593248640:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789117926.373235:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117927.398230:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117928.421781:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117929.446256:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117930.469371:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117930.855532:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789117930.855554:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593248768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117930.855632:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117930.855692:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593248768 00000100:00100000:0.0:1789117930.855700:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593248768 00000100:00100000:0.0:1789117930.855744:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789117930.855752:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593248768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789117930.855785:0:17803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789117930.855831:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593248768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117930.855838:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789117930.855883:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593248768:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1789117930.856226:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789117930.856231:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789117930.856234:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789117930.856238:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789117930.856249:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789117930.856253:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789117930.856256:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789117930.856259:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789117930.856280:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593249024:0@lo:400:kworker.0 00000100:00100000:2.0:1789117930.856313:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117930.856339:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789117930.856345:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf05977c-16b5-4df3-81bb-3835e509f77c:3645:1876025593248896:0@lo:400:kworker.0 00000100:00100000:2.0:1789117930.856373:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117930.856400:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593249024 00000100:00100000:2.0:1789117930.856404:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593249024 00000100:00100000:2.0:1789117930.856428:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789117930.856435:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593249024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117930.856472:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593249024:12345-0@lo:400:kworker.0 Request processed in 37us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117930.856486:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789117930.856513:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593249024:0@lo:400:kworker.0 00000100:00100000:1.0:1789117930.858222:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593249280:0@lo:400:kworker.0 00000100:00100000:1.0:1789117930.858308:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117930.858372:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789117930.858380:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593249152:0@lo:400:kworker.0 00000100:00100000:1.0:1789117930.858409:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117930.858448:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593248896 00000100:00100000:1.0:1789117930.858456:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593248896 00000100:00100000:1.0:1789117930.858504:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789117930.858512:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+18:3645:x1876025593248896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117930.858567:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+18:3645:x1876025593248896:12345-0@lo:400:kworker.0 Request processed in 56us (2192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117930.858575:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789117930.858627:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf05977c-16b5-4df3-81bb-3835e509f77c:3645:1876025593248896:0@lo:400:kworker.0 00000100:00100000:2.0:1789117930.858701:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593249280 00000100:00100000:2.0:1789117930.858706:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593249280 00000100:00100000:2.0:1789117930.858750:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593249152 00000100:00100000:2.0:1789117930.858753:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593249152 00000100:00100000:2.0:1789117930.858767:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789117930.858773:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593249280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117930.858813:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593249280:12345-0@lo:400:kworker.0 Request processed in 40us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117930.858819:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789117930.858829:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789117930.858834:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593249152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117930.858856:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593249152:12345-0@lo:400:kworker.0 Request processed in 23us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117930.858862:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789117930.859303:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789117930.859313:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593249408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789117930.859346:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117930.859382:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593249408 00000100:00100000:0.0:1789117930.859386:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593249408 00000100:00100000:0.0:1789117930.859411:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789117930.859416:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593249408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789117930.859440:0:17804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789117930.859472:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593249408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117930.859477:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789117930.859513:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593249408:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1789117930.862099:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962bbfd15680 x1876025593249152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117930.862119:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593249152:0@lo:400:kworker.0 00010000:00080000:1.0:1789117930.862148:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962bbfd152c0 x1876025593249280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117930.862159:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593249280:0@lo:400:kworker.0 00000020:01000004:0.0:1789117930.933840:0:19306:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789117930.933845:0:19306:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789117930.933846:0:19306:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789117930.933969:0:19306:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff962bc1b5c000 00000020:01000004:0.0:1789117930.933986:0:19306:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789117930.934000:0:19306:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789117930.934013:0:19306:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff962a87e23490) 00000020:00000080:0.0:1789117930.934030:0:19306:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789117930.991994:0:19306:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789117930.993463:0:19306:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789117930.994045:0:19306:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789117930.994282:0:19306:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789117930.994484:0:19306:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789117930.994696:0:19306:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1789117930.994979:0:19306:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1789117930.998405:0:19306:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789117930.998629:0:19306:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789117930.998645:0:19306:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789117930.998658:0:19306:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xaa253ed19be20d0e 00000020:01000004:3.0:1789117930.998665:0:19306:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789117930.998688:0:19306:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.130@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789117930.998691:0:19306:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789117930.998697:0:19306:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789117930.998701:0:19306:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789117930.998712:0:19306:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff962b8ee09a48) 00000020:00000080:3.0:1789117930.998722:0:19306:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1789117931.006556:0:19306:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789117931.006757:0:19306:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789117931.006765:0:19306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789117931.009693:0:19306:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789117931.009706:0:19306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789117931.010319:0:19306:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789117931.010327:0:19306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789117931.014274:0:19306:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789117931.014586:0:19306:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789117931.014593:0:19306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789117931.024703:0:19306:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789117931.024718:0:19306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789117931.047335:0:19306:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789117931.047585:0:19306:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789117931.047592:0:19306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789117931.051353:0:19306:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789117931.051369:0:19306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789117931.052797:0:19306:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789117931.052808:0:19306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789117931.055751:0:19306:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789117931.055941:0:19306:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789117931.055948:0:19306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789117931.056772:0:19306:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789117931.056787:0:19306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789117931.175084:0:19306:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789117931.175306:0:19306:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789117931.175313:0:19306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789117931.180961:0:19306:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789117931.180976:0:19306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789117931.194405:0:19306:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789117931.194455:0:19306:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1789117931.194462:0:19306:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.130@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789117931.213013:0:19306:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789117931.213090:0:19306:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.130@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1789117931.213095:0:19306:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789117931.213096:0:19306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789117931.213098:0:19306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789117931.213099:0:19306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789117931.213100:0:19306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789117931.213101:0:19306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789117931.213103:0:19306:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789117931.213105:0:19306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789117931.213106:0:19306:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789117931.213110:0:19306:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1789117931.213112:0:19306:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789117931.213114:0:19306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789117931.213115:0:19306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789117931.213116:0:19306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789117931.213117:0:19306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789117931.213135:0:19306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789117931.213136:0:19306:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789117931.213137:0:19306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789117931.213138:0:19306:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789117931.213178:0:19306:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789117931.213201:0:19306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f44780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593249536:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789117931.213278:0:19306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117931.213328:0:19306:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bad82a900 going to sleep for 11 seconds 00000100:00100000:2.0:1789117931.213397:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593249536 00000100:00100000:2.0:1789117931.213404:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593249536 00000100:00100000:2.0:1789117931.213463:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789117931.213473:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+18:19306:x1876025593249536:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789117931.213503:0:17793:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789117931.213506:0:17793:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1789117931.213511:0:17793:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789117931.213831:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+18:19306:x1876025593249536:12345-0@lo:253:mount.lustre.0 Request processed in 359us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117931.213841:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789117931.213906:0:19306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f44780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593249536:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789117931.213919:0:19306:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789117931.213921:0:19306:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789117931.213923:0:19306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789117931.213924:0:19306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789117931.213925:0:19306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789117931.213926:0:19306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789117931.213927:0:19306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789117931.213929:0:19306:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789117931.213930:0:19306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789117931.213931:0:19306:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789117931.214915:0:19306:0:(tgt_mount.c:101:server_register_mount()) register mount ffff962bc1b5c000 from lustre-OST0000 10000000:01000000:3.0:1789117931.215109:0:19306:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789117931.215113:0:19306:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789117931.215133:0:19306:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff962bbfacced8 local copy 00010000:00010000:3.0:1789117931.215145:0:19306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be20ac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20ad0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117931.215458:0:19306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593249664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789117931.215514:0:19306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117931.215921:0:19306:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5cd4600 going to sleep for 11 seconds 00000100:00100000:1.0:1789117931.215935:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593249664 00000100:00100000:1.0:1789117931.215943:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593249664 00000100:00100000:1.0:1789117931.216071:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789117931.216083:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+18:19306:x1876025593249664:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117931.216325:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+18:19306:x1876025593249664:12345-0@lo:501:mount.lustre.0 Request processed in 244us (811us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789117931.216333:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789117931.216439:0:19306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593249664:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789117931.216458:0:19306:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789117931.216482:0:19306:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789117931.216490:0:19306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be20ac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20ad0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117931.216499:0:19306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be20ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20ad0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117931.216533:0:19306:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff962bc1b5c000 10000000:01000000:0.0:1789117931.216537:0:19306:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789117931.216543:0:19306:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789117931.216554:0:19306:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789117931.216558:0:19306:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789117931.216561:0:19306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789117931.216588:0:19306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be20d1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117931.216596:0:19306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be20d1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117931.216672:0:19306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be20d1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117931.216691:0:19306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593249792:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789117931.216723:0:19306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117931.216852:0:19306:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c640c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117931.216897:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593249792 00000100:00100000:1.0:1789117931.216902:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593249792 00000100:00100000:1.0:1789117931.216972:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789117931.216981:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+18:19306:x1876025593249792:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789117931.216992:0:17791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117931.217006:0:17791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813dbe00/0xaa253ed19be20d23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20d1c expref: -99 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117931.217028:0:17791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813dbe00/0xaa253ed19be20d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20d1c expref: 19 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117931.217039:0:17791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813dbe00/0xaa253ed19be20d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20d1c expref: 19 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117931.217048:0:17791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813dbe00, rc 0) 00000100:00100000:1.0:1789117931.217243:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+19:19306:x1876025593249792:12345-0@lo:101:mount.lustre.0 Request processed in 262us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117931.217249:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789117931.217316:0:19306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593249792:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789117931.217329:0:19306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be20d1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20d23 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117931.217696:0:19306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be20d1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20d23 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789117931.221859:0:19306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789117931.225637:0:19306:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789117931.229767:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789117931.229841:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789117931.229855:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789117931.229867:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789117931.229877:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789117931.229888:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789117931.229914:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789117931.229919:0:19306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789117931.230095:0:19306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593249920:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789117931.230186:0:19306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117931.230231:0:19306:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf6123c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117931.230261:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593249920 00000100:00100000:1.0:1789117931.230268:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593249920 00000100:00100000:1.0:1789117931.230319:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789117931.230328:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+19:19306:x1876025593249920:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117931.230518:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+19:19306:x1876025593249920:12345-0@lo:501:mount.lustre.0 Request processed in 190us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117931.230527:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789117931.230617:0:19306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593249920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789117931.230658:0:19306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0718780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593250048:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789117931.230699:0:19306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117931.230728:0:19306:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5cd4780 going to sleep for 11 seconds 00000100:00100000:1.0:1789117931.230906:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593250048 00000100:00100000:1.0:1789117931.230912:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593250048 00000100:00100000:1.0:1789117931.230947:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789117931.230955:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+19:19306:x1876025593250048:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789117931.233217:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+19:19306:x1876025593250048:12345-0@lo:503:mount.lustre.0 Request processed in 2254us (2509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117931.233230:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789117931.233264:0:19306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0718780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593250048:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789117931.233869:0:19306:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789117931.233962:0:19306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0718780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593250176:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789117931.234025:0:19306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117931.234095:0:19306:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5cd4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117931.234472:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593250176 00000100:00100000:1.0:1789117931.234487:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593250176 00000100:00100000:1.0:1789117931.234532:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789117931.234540:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+19:19306:x1876025593250176:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789117931.235340:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+19:19306:x1876025593250176:12345-0@lo:502:mount.lustre.0 Request processed in 798us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117931.235349:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789117931.235437:0:19306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0718780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593250176:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789117931.235740:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789117931.235828:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789117931.235840:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789117931.235851:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789117931.235861:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789117931.235872:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789117931.235883:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789117931.235910:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789117931.235922:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789117931.235933:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789117931.235946:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789117931.235958:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789117931.235991:0:19306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0718780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593250304:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789117931.236044:0:19306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117931.236360:0:19306:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5cd4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117931.239692:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593250304 00000100:00100000:1.0:1789117931.239714:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593250304 00000100:00100000:1.0:1789117931.239789:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789117931.239814:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+19:19306:x1876025593250304:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789117931.239992:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+19:19306:x1876025593250304:12345-0@lo:502:mount.lustre.0 Request processed in 179us (3948us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117931.240000:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789117931.240274:0:19306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0718780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593250304:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789117931.240350:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789117931.240369:0:19306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1789117931.242990:0:19323:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789117931.243003:0:19323:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1789117931.243011:0:19323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117931.243013:0:19323:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789117931.243020:0:19323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789117931.243037:0:19323:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff962b8ee08000) 00000020:00000080:3.0:1789117931.243079:0:19323:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789117931.243087:0:19323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789117931.243182:0:19323:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962bc1b5c000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789117931.243202:0:19323:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789117931.243210:0:19323:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xaa253ed19be20d31 00010000:00010000:3.0:1789117931.249984:0:19323:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1789117931.250716:0:19323:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1789117931.252708:0:19323:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1789117931.257223:0:19323:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789117931.257239:0:19323:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117931.257246:0:19323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117931.257249:0:19323:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789117931.257254:0:19323:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789117931.257257:0:19323:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1789117931.257258:0:19323:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789117931.257260:0:19323:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789117931.257262:0:19323:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789117931.257264:0:19323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117931.257265:0:19323:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789117931.257268:0:19323:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117931.257271:0:19323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117931.257272:0:19323:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789117931.257275:0:19323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789117931.257277:0:19323:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789117931.257279:0:19323:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117931.257281:0:19323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117931.257296:0:19323:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789117931.257300:0:19323:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117931.257303:0:19323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117931.257304:0:19323:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789117931.257307:0:19323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789117931.257336:0:19323:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117931.257339:0:19323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117931.257340:0:19323:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789117931.257343:0:19323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1789117931.257701:0:19306:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789117931.257731:0:19306:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789117931.258251:0:19306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be20d1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20d23 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117931.258264:0:19306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be20d1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20d23 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117931.258272:0:19306:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962bc1b5c000 from 1 10000000:01000000:0.0:1789117931.258275:0:19306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789117931.258311:0:19306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be20d38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117931.258319:0:19306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be20d38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117931.258344:0:19306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be20d38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117931.258367:0:19306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593250432:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789117931.258438:0:19306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117931.259228:0:19306:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c64780 going to sleep for 11 seconds 00000100:00100000:1.0:1789117931.260285:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593250432 00000100:00100000:1.0:1789117931.260297:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593250432 00000100:00100000:1.0:1789117931.260399:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789117931.260410:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+19:19306:x1876025593250432:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789117931.260428:0:17790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117931.260448:0:17790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813dba00/0xaa253ed19be20d3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20d38 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117931.260475:0:17790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813dba00/0xaa253ed19be20d3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20d38 expref: 20 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117931.260486:0:17790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813dba00/0xaa253ed19be20d3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20d38 expref: 20 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117931.260495:0:17790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813dba00, rc 0) 00000100:00100000:1.0:1789117931.260572:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+20:19306:x1876025593250432:12345-0@lo:101:mount.lustre.0 Request processed in 163us (2133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117931.260578:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789117931.260702:0:19306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593250432:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789117931.260721:0:19306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be20d38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20d3f expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117931.260732:0:19306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be20d38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20d3f expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789117931.262537:0:19306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789117931.262836:0:19306:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789117931.263012:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789117931.263035:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789117931.263074:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789117931.263081:0:19306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789117931.263175:0:19306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0718780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593250560:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789117931.263239:0:19306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117931.263665:0:19306:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5cd49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117931.263797:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593250560 00000100:00100000:2.0:1789117931.263804:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593250560 00000100:00100000:2.0:1789117931.263847:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789117931.263859:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+20:19306:x1876025593250560:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789117931.263986:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+20:19306:x1876025593250560:12345-0@lo:501:mount.lustre.0 Request processed in 128us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117931.264007:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789117931.264283:0:19306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0718780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593250560:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789117931.264323:0:19306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0718780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593250688:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789117931.264365:0:19306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117931.264388:0:19306:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5cd49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117931.264581:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593250688 00000100:00100000:2.0:1789117931.264586:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593250688 00000100:00100000:2.0:1789117931.266759:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789117931.266786:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+20:19306:x1876025593250688:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789117931.266998:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+20:19306:x1876025593250688:12345-0@lo:503:mount.lustre.0 Request processed in 225us (2631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117931.267005:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789117931.267354:0:19306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0718780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593250688:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789117931.267862:0:19306:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789117931.267969:0:19306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0718780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593250816:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789117931.268046:0:19306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117931.268131:0:19306:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5cd4480 going to sleep for 11 seconds 00000100:00100000:3.0:1789117931.268157:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593250816 00000100:00100000:3.0:1789117931.268174:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593250816 00000100:00100000:3.0:1789117931.268211:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789117931.268221:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+20:19306:x1876025593250816:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789117931.268316:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+20:19306:x1876025593250816:12345-0@lo:502:mount.lustre.0 Request processed in 97us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117931.268324:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789117931.268371:0:19306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0718780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593250816:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789117931.268567:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789117931.268590:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789117931.268604:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789117931.268617:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789117931.268630:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789117931.268657:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789117931.268673:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789117931.268685:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:3.0:1789117931.268699:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:3.0:1789117931.268712:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:3.0:1789117931.268724:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 144 off10272 00000040:00080000:3.0:1789117931.268736:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10496 00000040:00080000:3.0:1789117931.268749:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10720 00000040:00080000:3.0:1789117931.268763:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 128 off10848 00000040:00080000:3.0:1789117931.268778:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off11072 00000040:00080000:3.0:1789117931.268802:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11296 00000040:00080000:3.0:1789117931.268816:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 128 off11424 00000100:00100000:3.0:1789117931.268840:0:19306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0718780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593250944:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789117931.268875:0:19306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117931.268893:0:19306:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5cd4480 going to sleep for 11 seconds 00000100:00100000:3.0:1789117931.268912:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593250944 00000100:00100000:3.0:1789117931.268916:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593250944 00000100:00100000:3.0:1789117931.268934:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789117931.268940:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+20:19306:x1876025593250944:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789117931.269009:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+20:19306:x1876025593250944:12345-0@lo:502:mount.lustre.0 Request processed in 68us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117931.269016:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789117931.269079:0:19306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0718780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593250944:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789117931.269114:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11648 00000040:00080000:3.0:1789117931.269135:0:19306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:3.0:1789117931.271673:0:19327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117931.271689:0:19327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117931.271691:0:19327:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789117931.271700:0:19327:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962bc1b5c000 00000020:00000080:3.0:1789117931.271703:0:19327:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789117931.271710:0:19327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117931.271713:0:19327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117931.271714:0:19327:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789117931.271717:0:19327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117931.271719:0:19327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117931.271720:0:19327:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789117931.271723:0:19327:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962bc1b5c000 00000020:00000080:3.0:1789117931.271725:0:19327:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789117931.275128:0:19327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117931.275139:0:19327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117931.275149:0:19327:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789117931.275153:0:19327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117931.275166:0:19327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117931.275168:0:19327:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789117931.275174:0:19327:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962bc1b5c000 00000020:00000080:3.0:1789117931.275177:0:19327:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789117931.275206:0:19327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117931.275210:0:19327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117931.275211:0:19327:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789117931.275214:0:19327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117931.275217:0:19327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117931.275218:0:19327:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789117931.275221:0:19327:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962bc1b5c000 00000020:00000080:3.0:1789117931.275223:0:19327:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789117931.275240:0:19327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117931.275243:0:19327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117931.275244:0:19327:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789117931.275246:0:19327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117931.275249:0:19327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117931.275250:0:19327:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789117931.275254:0:19327:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962bc1b5c000 00000020:00000080:3.0:1789117931.275256:0:19327:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789117931.275274:0:19327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117931.275277:0:19327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117931.275278:0:19327:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789117931.275280:0:19327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117931.275283:0:19327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117931.275284:0:19327:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789117931.275287:0:19327:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962bc1b5c000 00000020:00000080:3.0:1789117931.275289:0:19327:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789117931.275347:0:19327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117931.275351:0:19327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117931.275352:0:19327:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789117931.275360:0:19327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 19 count 19 00000020:01000000:1.0:1789117931.275576:0:19306:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:1.0:1789117931.275668:0:19306:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789117931.275719:0:19306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be20d38 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20d3f expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117931.275733:0:19306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be20d38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20d3f expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117931.275807:0:19306:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789117931.275810:0:19306:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff962bc1b5c000 10000000:01000000:1.0:1789117931.275814:0:19306:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff962bc1b5c000 10000000:01000000:1.0:1789117931.275817:0:19306:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789117931.275825:0:19306:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962bc1b5c000 from 1 10000000:01000000:1.0:1789117931.275827:0:19306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789117931.275866:0:19306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be20d46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117931.275875:0:19306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be20d46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117931.275889:0:19306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be20d46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117931.275914:0:19306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f452c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593251072:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789117931.275989:0:19306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117931.276042:0:19306:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86fe9900 going to sleep for 11 seconds 00000100:00100000:0.0:1789117931.276307:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593251072 00000100:00100000:0.0:1789117931.276315:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593251072 00000100:00100000:0.0:1789117931.276362:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789117931.276371:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+20:19306:x1876025593251072:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789117931.276384:0:17793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117931.276397:0:17793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962baea9b200/0xaa253ed19be20d4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20d46 expref: -99 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117931.276419:0:17793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962baea9b200/0xaa253ed19be20d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20d46 expref: 21 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117931.276429:0:17793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962baea9b200/0xaa253ed19be20d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20d46 expref: 21 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117931.276437:0:17793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962baea9b200, rc 0) 00000100:00100000:0.0:1789117931.276482:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+21:19306:x1876025593251072:12345-0@lo:101:mount.lustre.0 Request processed in 111us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117931.276489:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789117931.276596:0:19306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f452c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593251072:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789117931.276869:0:19306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be20d46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20d4d expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117931.276879:0:19306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be20d46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20d4d expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789117931.280454:0:19306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789117931.283587:0:19306:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789117931.287263:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789117931.287332:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789117931.287350:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789117931.287365:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789117931.287380:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789117931.287409:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789117931.287426:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789117931.287439:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789117931.287452:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789117931.287464:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789117931.287477:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789117931.287856:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789117931.287871:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789117931.287884:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789117931.287897:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789117931.287911:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789117931.287923:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789117931.287937:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789117931.287950:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789117931.287964:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789117931.287976:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789117931.288005:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789117931.288020:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789117931.288035:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789117931.288048:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1789117931.288100:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1789117931.288116:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1789117931.288144:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1789117931.288168:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1789117931.288185:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1789117931.288198:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1789117931.288212:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1789117931.288226:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1789117931.288240:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1789117931.288262:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1789117931.288275:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1789117931.288286:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1789117931.288321:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1789117931.288328:0:19306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789117931.288441:0:19306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f452c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593251200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117931.294217:0:19306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117931.294278:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593251200 00000100:00100000:1.0:1789117931.294281:0:19306:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86fe9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789117931.294289:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593251200 00000100:00100000:2.0:1789117931.294345:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789117931.294354:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+21:19306:x1876025593251200:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789117931.294510:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+21:19306:x1876025593251200:12345-0@lo:501:mount.lustre.0 Request processed in 156us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117931.294517:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789117931.294596:0:19306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f452c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593251200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117931.294656:0:19306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f452c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593251328:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789117931.294702:0:19306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117931.294724:0:19306:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86fe9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789117931.294970:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593251328 00000100:00100000:2.0:1789117931.294975:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593251328 00000100:00100000:2.0:1789117931.295000:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789117931.295006:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+21:19306:x1876025593251328:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789117931.298556:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+21:19306:x1876025593251328:12345-0@lo:503:mount.lustre.0 Request processed in 3540us (3844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117931.298572:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789117931.298822:0:19306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f452c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593251328:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789117931.299588:0:19306:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789117931.300838:0:19306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f452c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593251456:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789117931.300913:0:19306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117931.301176:0:19306:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86fe9900 going to sleep for 11 seconds 00000100:00100000:2.0:1789117931.301267:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593251456 00000100:00100000:2.0:1789117931.301274:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593251456 00000100:00100000:2.0:1789117931.301360:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789117931.301371:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+21:19306:x1876025593251456:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789117931.301506:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+21:19306:x1876025593251456:12345-0@lo:502:mount.lustre.0 Request processed in 137us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117931.301515:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789117931.301830:0:19306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f452c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593251456:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789117931.302097:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789117931.302145:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789117931.302173:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789117931.302190:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789117931.302202:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789117931.302213:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789117931.302223:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789117931.302235:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789117931.302246:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789117931.302258:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789117931.302269:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789117931.302284:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789117931.302296:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789117931.302308:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789117931.302319:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789117931.302333:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789117931.302346:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789117931.302359:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789117931.302371:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789117931.302384:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789117931.302399:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789117931.302412:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789117931.302438:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789117931.302455:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789117931.302471:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1789117931.302667:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1789117931.302687:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1789117931.302700:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1789117931.302713:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1789117931.302727:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1789117931.302741:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1789117931.302756:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1789117931.302769:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1789117931.302783:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1789117931.302805:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1789117931.302816:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1789117931.302828:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1789117931.302840:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1789117931.302867:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1789117931.302882:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1789117931.302895:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1789117931.302907:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1789117931.302918:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1789117931.302929:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1789117931.302941:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1789117931.302956:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1789117931.302967:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1789117931.302979:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1789117931.303025:0:19306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593251584:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789117931.303106:0:19306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117931.303148:0:19306:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c64900 going to sleep for 11 seconds 00000100:00100000:1.0:1789117931.303163:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593251584 00000100:00100000:1.0:1789117931.303170:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593251584 00000100:00100000:1.0:1789117931.303212:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789117931.303221:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+21:19306:x1876025593251584:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789117931.303324:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+21:19306:x1876025593251584:12345-0@lo:502:mount.lustre.0 Request processed in 104us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117931.303332:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789117931.307390:0:19306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593251584:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789117931.312672:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1789117931.312727:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1789117931.312777:0:19306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593251712:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789117931.312859:0:19306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117931.312900:0:19306:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c64900 going to sleep for 11 seconds 00000100:00100000:2.0:1789117931.313453:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593251712 00000100:00100000:2.0:1789117931.313461:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593251712 00000100:00100000:2.0:1789117931.313554:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789117931.313563:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+21:19306:x1876025593251712:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789117931.313671:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+21:19306:x1876025593251712:12345-0@lo:502:mount.lustre.0 Request processed in 109us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117931.313679:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789117931.314198:0:19306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593251712:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789117931.314255:0:19306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1789117931.314265:0:19306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789117931.316915:0:19333:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789117931.316931:0:19333:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff962a87e21a48) 00000020:00000080:0.0:1789117931.316966:0:19333:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1789117931.317079:0:19333:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962bc1b5c000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789117931.317084:0:19333:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962bc1b5c000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789117931.317087:0:19333:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962bc1b5c000 3 00010000:00080000:0.0:1789117931.317116:0:19333:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962b84784000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.130@tcp at head 00010000:00010000:0.0:1789117931.318726:0:19333:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1789117931.318924:0:19333:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789117931.318964:0:19333:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789117931.318976:0:19333:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xaa253ed19be20d5b 00000100:00080000:0.0:1789117931.318990:0:19333:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789117931.318996:0:19333:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff962b84784000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1789117931.319035:0:19333:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962b98a6f0c0 x1876025593251840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789117931.319117:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876025593251840:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789117931.319199:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117931.319277:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593251840 00000100:00100000:0.0:1789117931.319285:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593251840 00000100:00100000:0.0:1789117931.319316:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789117931.319323:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876025593251840:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789117931.319348:0:17798:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 583 last 0 00000020:00000080:0.0:1789117931.319376:0:17798:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xaa253ed19be20d62 00000004:00100000:0.0:1789117931.319392:0:17798:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789117931.319431:0:17798:0:(import.c:65:import_set_state_nolock()) ffff962a86a7e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789117931.319475:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876025593251840:12345-0@lo:38:llog_process_th.0 Request processed in 152us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117931.319483:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789117931.319518:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962b98a6f0c0 x1876025593251840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789117941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117931.319540:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789117931.319548:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789117931.319555:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789117931.319559:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789117931.319561:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b84784000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789117931.319567:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876025593251840:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789117931.319585:0:19333:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789117931.319606:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789117931.319611:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789117931.319614:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789117931.319617:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789117931.319621:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789117931.319624:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789117931.319627:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789117931.319630:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:0.0:1789117931.330424:0:19333:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789117931.330442:0:19333:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff962bbd2b3490) 00000020:00000080:0.0:1789117931.330466:0:19333:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1789117931.330546:0:19333:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962bc1b5c000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789117931.330550:0:19333:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962bc1b5c000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789117931.330553:0:19333:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962bc1b5c000 3 00010000:00080000:0.0:1789117931.330598:0:19333:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962a86a7b000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.130@tcp at head 00010000:00010000:0.0:1789117931.340098:0:19333:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1789117931.340340:0:19333:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1789117931.340383:0:19333:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789117931.340398:0:19333:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xaa253ed19be20d70 00000100:00080000:0.0:1789117931.340411:0:19333:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789117931.340416:0:19333:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff962a86a7b000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1789117931.340452:0:19333:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962b98a6f0c0 x1876025593251968/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789117931.340473:0:19333:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789117931.340519:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876025593251968:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789117931.340586:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117931.347565:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593251968 00000100:00100000:1.0:1789117931.347585:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593251968 00000100:00100000:1.0:1789117931.348154:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789117931.349388:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876025593251968:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789117931.349423:0:17800:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 583 last 0 00000020:00000080:1.0:1789117931.349459:0:17800:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xaa253ed19be20d77 00000004:00100000:1.0:1789117931.349486:0:17800:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789117931.349521:0:17800:0:(import.c:65:import_set_state_nolock()) ffff962a87d67000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789117931.352561:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876025593251968:12345-0@lo:38:llog_process_th.0 Request processed in 3166us (11965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117931.352577:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789117931.353573:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789117931.353582:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789117931.353585:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789117931.353588:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789117931.353592:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789117931.353596:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789117931.353599:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789117931.353680:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:0.0:1789117931.353755:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962b98a6f0c0 x1876025593251968/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789117941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117931.353770:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789117931.353781:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789117931.353792:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789117931.353808:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789117931.353814:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a86a7b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789117931.353822:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876025593251968:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789117931.354310:0:19333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1789117931.355027:0:19306:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789117931.355219:0:19306:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789117931.355238:0:19306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be20d46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20d4d expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117931.355248:0:19306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be20d46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20d4d expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789117931.355302:0:19306:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789117931.355304:0:19306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789117931.355305:0:19306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789117931.355307:0:19306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789117931.355308:0:19306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789117931.355309:0:19306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789117931.355310:0:19306:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789117931.355312:0:19306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789117931.355313:0:19306:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789117931.355318:0:19306:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789117931.355320:0:19306:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789117931.355321:0:19306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789117931.355322:0:19306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789117931.355327:0:19306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789117931.355328:0:19306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789117931.355329:0:19306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789117931.355330:0:19306:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789117931.355331:0:19306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789117931.355332:0:19306:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789117931.355359:0:19306:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789117931.355381:0:19306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593252096:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789117931.355456:0:19306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117931.355534:0:19306:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c22f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117931.366011:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593252096 00000100:00100000:1.0:1789117931.366025:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593252096 00000100:00100000:1.0:1789117931.366107:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789117931.366127:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+21:19306:x1876025593252096:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789117931.366180:0:17793:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789117931.366197:0:17793:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789117931.373445:0:17793:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789117931.373468:0:17793:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789117931.373569:0:17814:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789117931.373574:0:17814:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789117931.373596:0:17814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962baea9bc00/0xaa253ed19be20d7e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117931.373614:0:17814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962baea9be00/0xaa253ed19be20cc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20cc1 expref: 21 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117931.373621:0:17814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962baea9b800/0xaa253ed19be20cd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20ccf expref: 21 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117931.373628:0:17814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962baea9bc00/0xaa253ed19be20d7e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117931.373667:0:17814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962baea9b800/0xaa253ed19be20cd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be20ccf expref: 21 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117931.373682:0:17814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962baea9b800/0xaa253ed19be20cd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be20ccf expref: 21 pid: 17793 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117931.373695:0:17814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6f0c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17814:1876025593252224:0@lo:104: 00000100:00100000:0.0:1789117931.373771:0:17814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789117931.373822:0:17814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962baea9be00/0xaa253ed19be20cc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be20cc1 expref: 21 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117931.373831:0:17814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962baea9be00/0xaa253ed19be20cc8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be20cc1 expref: 21 pid: 17793 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117931.373851:0:17814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17814:1876025593252352:0@lo:104: 00000100:00100000:0.0:1789117931.373878:0:17814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117931.373902:0:17814:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c64900 going to sleep for 11 seconds 00000100:00100000:2.0:1789117931.374018:0:17782:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789117931.374034:0:17782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593252224 00000100:00100000:2.0:1789117931.374041:0:17782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593252224 00000100:00100000:2.0:1789117931.374108:0:17782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593252352 00000100:00100000:2.0:1789117931.374112:0:17782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593252352 00000100:00100000:2.0:1789117931.374141:0:17782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789117931.374149:0:17782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf05977c-16b5-4df3-81bb-3835e509f77c+4:17814:x1876025593252224:12345-0@lo:104: 00010000:00010000:2.0:1789117931.374162:0:17782:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be20ccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20cd6 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117931.374216:0:17782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789117931.374222:0:17782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf05977c-16b5-4df3-81bb-3835e509f77c+4:17814:x1876025593252224:12345-0@lo:104: Request processed in 74us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117931.374229:0:17782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789117931.374245:0:17782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789117931.374251:0:17782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf05977c-16b5-4df3-81bb-3835e509f77c+3:17814:x1876025593252352:12345-0@lo:104: 00010000:00010000:2.0:1789117931.374258:0:17782:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962a887f2e00/0xaa253ed19be20cc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20cc8 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117931.374301:0:17782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789117931.374306:0:17782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf05977c-16b5-4df3-81bb-3835e509f77c+3:17814:x1876025593252352:12345-0@lo:104: Request processed in 56us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117931.374313:0:17782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789117931.374350:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789117931.374356:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be20ccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20cd6 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117931.374364:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b80031600 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:2.0:1789117931.374367:0:18557:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be20ccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be20cd6 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117931.374376:0:18557:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be20ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be20cd6 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117931.374383:0:18557:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be20ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be20cd6 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117931.374389:0:18557:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789117931.374414:0:18557:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be20ccf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20cd6 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117931.374421:0:18557:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789117931.374438:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be20ccf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20cd6 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117931.374446:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b80031600/0xaa253ed19be20ccf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20cd6 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117931.374468:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117931.374472:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962a887f2e00/0xaa253ed19be20cc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20cc8 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117931.374478:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f2e00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:2.0:1789117931.374481:0:18557:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962a887f2e00/0xaa253ed19be20cc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be20cc8 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117931.374488:0:18557:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962a887f2e00/0xaa253ed19be20cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be20cc8 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117931.374494:0:18557:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962a887f2e00/0xaa253ed19be20cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be20cc8 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117931.374500:0:18557:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789117931.374513:0:18557:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962a887f2e00/0xaa253ed19be20cc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20cc8 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117931.374518:0:18557:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789117931.374531:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962a887f2e00/0xaa253ed19be20cc1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20cc8 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117931.374538:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962a887f2e00/0xaa253ed19be20cc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20cc8 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117931.374550:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117931.374551:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117931.374553:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117931.374572:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117931.374588:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf05977c-16b5-4df3-81bb-3835e509f77c:3644:1876025593252480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789117931.374616:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117931.374646:0:17785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593252480 00000100:00100000:2.0:1789117931.374650:0:17785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593252480 00010000:00010000:2.0:1789117931.374666:0:17785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962baea9b800/0xaa253ed19be20cd6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20ccf expref: 22 pid: 17793 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117931.374687:0:17785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789117931.374693:0:17785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf05977c-16b5-4df3-81bb-3835e509f77c+22:3644:x1876025593252480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789117931.374702:0:17785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117931.374706:0:17785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962baea9b800/0xaa253ed19be20cd6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20ccf expref: 22 pid: 17793 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117931.374799:0:17785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962baea9b800/0xaa253ed19be20cd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be20ccf expref: 22 pid: 17793 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117931.374816:0:17785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117931.374845:0:17785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf05977c-16b5-4df3-81bb-3835e509f77c+22:3644:x1876025593252480:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117931.374852:0:17785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789117931.374895:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf05977c-16b5-4df3-81bb-3835e509f77c:3644:1876025593252480:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789117931.374969:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117931.375027:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789117931.375036:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593252608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117931.375102:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117931.375200:0:17783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593252608 00000100:00100000:3.0:1789117931.375205:0:17783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593252608 00010000:00010000:3.0:1789117931.375222:0:17783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962baea9be00/0xaa253ed19be20cc8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20cc1 expref: 22 pid: 17793 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117931.375241:0:17783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789117931.375247:0:17783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf05977c-16b5-4df3-81bb-3835e509f77c+22:3647:x1876025593252608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789117931.375254:0:17783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117931.375258:0:17783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962baea9be00/0xaa253ed19be20cc8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20cc1 expref: 22 pid: 17793 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117931.375267:0:17783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962baea9be00/0xaa253ed19be20cc8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be20cc1 expref: 22 pid: 17793 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117931.375278:0:17783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962baea9bc00/0xaa253ed19be20d7e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117931.375287:0:17783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962baea9bc00/0xaa253ed19be20d7e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789117931.375300:0:17783:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015770246s 00010000:00010000:3.0:1789117931.375304:0:17783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962baea9bc00/0xaa253ed19be20d7e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117931.375311:0:17783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962baea9bc00/0xaa253ed19be20d7e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117931.375316:0:17783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962baea9bc00/0xaa253ed19be20d7e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117931.375333:0:17783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962baea9bc00/0xaa253ed19be20d7e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117931.375338:0:17783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9bc00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789117931.375341:0:17783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962baea9bc00/0xaa253ed19be20d7e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117931.375348:0:17783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962baea9bc00/0xaa253ed19be20d7e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117931.375356:0:17783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962baea9bc00/0xaa253ed19be20d7e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117931.375365:0:17783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117931.375396:0:17783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf05977c-16b5-4df3-81bb-3835e509f77c+22:3647:x1876025593252608:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117931.375402:0:17783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789117931.375487:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593252608:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789117931.375569:0:17814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962baea9b800/0xaa253ed19be20cd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be20ccf expref: 21 pid: 17793 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117931.375579:0:17814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6f0c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17814:1876025593252224:0@lo:104: 00010000:00010000:0.0:1789117931.375588:0:17814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962baea9be00/0xaa253ed19be20cc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be20cc1 expref: 20 pid: 17793 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117931.375595:0:17814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17814:1876025593252352:0@lo:104: 00010000:00010000:0.0:1789117931.375608:0:17814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962baea9bc00/0xaa253ed19be20d7e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117931.375617:0:17814:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962baea9bc00/0xaa253ed19be20d7e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117931.375622:0:17814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962baea9bc00/0xaa253ed19be20d7e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117931.375628:0:17814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962baea9bc00/0xaa253ed19be20d7e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117931.376358:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+19:19306:x1876025593252096:12345-0@lo:253:mount.lustre.0 Request processed in 10239us (20898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117931.376368:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789117931.377584:0:19306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:19306:1876025593252096:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789117931.377657:0:19306:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789117931.377661:0:19306:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789117931.377662:0:19306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789117931.377675:0:19306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117931.377677:0:19306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789117931.377678:0:19306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117931.377679:0:19306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117931.377681:0:19306:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789117931.377683:0:19306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117931.377685:0:19306:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789117931.377702:0:19306:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:1.0:1789117931.388399:0:19306:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789117931.391354:0:19306:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789117931.391364:0:19306:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789117931.391396:0:19306:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789117931.391438:0:19306:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.130@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789117931.391459:0:19306:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789117931.391482:0:19306:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1789117931.392322:0:19306:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789117931.392542:0:19306:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789117931.495303:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117932.520411:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789117932.565403:0:19388:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789117932.566417:0:19388:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1789117932.587639:0:18556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1789117932.645351:0:17796:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789117932.645361:0:17796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962bbf6a1000 from 9 10000000:01000000:2.0:1789117932.645368:0:17796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789117932.645420:0:17796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a887f2400/0xaa253ed19be20d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117932.645444:0:17796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a887f2400/0xaa253ed19be20d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117932.645457:0:17796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a887f2400/0xaa253ed19be20d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117932.645484:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593252736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789117932.645581:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117932.645632:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbcdd4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789117932.645636:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593252736 00000100:00100000:3.0:1789117932.645644:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593252736 00000100:00100000:3.0:1789117932.645708:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789117932.645719:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+19:17796:x1876025593252736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117932.645734:0:17790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117932.645751:0:17790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b80030000/0xaa253ed19be20d8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20d85 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117932.645795:0:17790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b80030000/0xaa253ed19be20d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20d85 expref: 20 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117932.645817:0:17790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b80030000/0xaa253ed19be20d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20d85 expref: 20 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117932.645827:0:17790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b80030000, rc 0) 00000100:00100000:3.0:1789117932.645883:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+20:17796:x1876025593252736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117932.645891:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789117932.646699:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593252736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117932.646719:0:17796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a887f2400/0xaa253ed19be20d85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20d8c expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117932.646730:0:17796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a887f2400/0xaa253ed19be20d85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20d8c expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117932.646794:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593252864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789117932.646847:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117932.646878:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbcdd4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789117932.647332:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593252864 00000100:00100000:3.0:1789117932.647339:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593252864 00000100:00100000:3.0:1789117932.647381:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789117932.647390:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+20:17796:x1876025593252864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789117932.647411:0:17793:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789117932.647430:0:17793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789117932.647432:0:17793:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1789117932.647535:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+20:17796:x1876025593252864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117932.647542:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789117932.647635:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593252864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789117932.647700:0:17796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789117932.647709:0:17796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a887f2400/0xaa253ed19be20d85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20d8c expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117932.647718:0:17796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a887f2400/0xaa253ed19be20d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20d8c expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117932.647727:0:17796:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789117932.647731:0:17796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962a88713800 from 9 10000000:01000000:0.0:1789117932.647734:0:17796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789117932.647765:0:17796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be20d93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117932.647773:0:17796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be20d93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117932.647800:0:17796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be20d93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117932.647821:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593252992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789117932.647855:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117932.647907:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c64900 going to sleep for 11 seconds 00000100:00100000:2.0:1789117932.647937:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593252992 00000100:00100000:2.0:1789117932.647942:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593252992 00000100:00100000:2.0:1789117932.647976:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789117932.647982:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+20:17796:x1876025593252992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117932.647990:0:17791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117932.648002:0:17791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a887f2200/0xaa253ed19be20d9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20d93 expref: -99 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117932.648036:0:17791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a887f2200/0xaa253ed19be20d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20d93 expref: 21 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117932.648045:0:17791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a887f2200/0xaa253ed19be20d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20d93 expref: 21 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117932.648074:0:17791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f2200, rc 0) 00000100:00100000:2.0:1789117932.648123:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+21:17796:x1876025593252992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117932.648129:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789117932.648176:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593252992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117932.648188:0:17796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be20d93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20d9a expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117932.648196:0:17796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be20d93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20d9a expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117932.648237:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593253120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789117932.648265:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117932.648293:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c64900 going to sleep for 11 seconds 00000100:00100000:2.0:1789117932.648344:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593253120 00000100:00100000:2.0:1789117932.648348:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593253120 00000100:00100000:2.0:1789117932.648380:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789117932.648387:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+21:17796:x1876025593253120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789117932.648399:0:17790:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789117932.648411:0:17790:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789117932.648414:0:17790:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1789117932.648484:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+21:17796:x1876025593253120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 97us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117932.648491:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789117932.648518:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593253120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789117932.648562:0:17796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789117932.648568:0:17796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be20d93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20d9a expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117932.648577:0:17796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be20d93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20d9a expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117933.544319:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117934.438190:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789117919/real 1789117919] req@ffff962ba071ad00 x1876025593245568/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117934 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117934.438230:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962ba071ad00 x1876025593245568/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117934 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789117934.438257:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b90dba800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789117934.438278:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789117934.438283:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593245568:0@lo:8:kworker.0 00000100:00080000:2.0:1789117934.440369:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789117934.440377:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789117934.440380:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789117934.440384:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789117934.440403:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789117934.440407:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789117934.440412:0:37:0:(import.c:65:import_set_state_nolock()) ffff962b90dba800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789117934.440422:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 571 00000100:00080000:2.0:1789117934.440429:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789117934.440437:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff962b90dba800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789117934.440466:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbfd17c00 x1876025593253760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789117934.440485:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789117934.440489:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789117934.440661:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593253632:0@lo:400:kworker.0 00000100:00100000:2.0:1789117934.440757:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117934.440809:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789117934.440816:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593253248:0@lo:400:kworker.0 00000100:00100000:2.0:1789117934.440847:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117934.440885:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593253888:0@lo:400:kworker.0 00000100:00100000:2.0:1789117934.440915:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117934.440946:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593253376:0@lo:400:kworker.0 00000100:00100000:2.0:1789117934.440989:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117934.441010:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593254016:0@lo:400:kworker.0 00000100:00100000:2.0:1789117934.441342:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117934.441368:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789117934.441375:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593253504:0@lo:400:kworker.0 00000100:00100000:2.0:1789117934.441397:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117934.441415:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593254144:0@lo:400:kworker.0 00000100:00100000:2.0:1789117934.441439:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117934.441476:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593253632 00000100:00100000:2.0:1789117934.441485:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593253632 00000100:00100000:2.0:1789117934.441536:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593253376 00000100:00100000:2.0:1789117934.441539:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593253376 00000100:00100000:2.0:1789117934.441559:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789117934.441569:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9277e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593253632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117934.442208:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9277e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593253632:12345-0@lo:400:kworker.0 Request processed in 637us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117934.442217:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789117934.442242:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789117934.442250:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf775a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593253376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117934.442285:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf775a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593253376:12345-0@lo:400:kworker.0 Request processed in 37us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117934.442291:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789117934.442312:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593253248 00000100:00100000:2.0:1789117934.442317:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593253248 00000100:00100000:2.0:1789117934.442346:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789117934.442352:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+21:3646:x1876025593253248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117934.442397:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+21:3646:x1876025593253248:12345-0@lo:400:kworker.0 Request processed in 45us (1549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117934.442404:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789117934.442440:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593253888 00000100:00100000:2.0:1789117934.442444:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593253888 00000100:00100000:2.0:1789117934.442473:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593254016 00000100:00100000:2.0:1789117934.442475:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593254016 00000100:00100000:2.0:1789117934.442504:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593253504 00000100:00100000:2.0:1789117934.442508:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593253504 00000100:00100000:2.0:1789117934.442518:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593254144 00000100:00100000:2.0:1789117934.442520:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593254144 00000100:00100000:2.0:1789117934.442535:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789117934.442553:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9277fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593253888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117934.442586:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9277fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593253888:12345-0@lo:400:kworker.0 Request processed in 35us (1671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117934.442592:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789117934.442604:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789117934.443805:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593254016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117934.443901:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593254016:12345-0@lo:400:kworker.0 Request processed in 1290us (2557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117934.443911:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789117934.443937:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789117934.443948:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf774f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593253504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117934.443980:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf774f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593253504:12345-0@lo:400:kworker.0 Request processed in 36us (2582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117934.443986:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789117934.443997:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789117934.444030:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf774b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593254144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117934.444091:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf774b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593254144:12345-0@lo:400:kworker.0 Request processed in 72us (2650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117934.444097:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789117934.444172:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593253760:0@lo:8:kworker.0 00000100:00100000:2.0:1789117934.444217:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117934.444892:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593253760 00000100:00100000:2.0:1789117934.444903:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593253760 00000100:00100000:2.0:1789117934.444943:0:19311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789117934.444950:0:19311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf777c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876025593253760:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789117934.444987:0:19311:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 586 last 0 00000020:00000080:2.0:1789117934.445037:0:19311:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xaa253ed19be20da1 00002000:00100000:2.0:1789117934.445092:0:19311:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff962b82aac800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398c ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1789117934.445097:0:19311:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1789117934.445101:0:19311:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789117934.445357:0:19311:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1789117934.445393:0:19311:0:(import.c:65:import_set_state_nolock()) ffff962b82aae000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789117934.445466:0:19311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf777c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1876025593253760:12345-0@lo:8:kworker.0 Request processed in 515us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117934.445473:0:19311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789117934.445531:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbfd15680 x1876025593253504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117934.448685:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593253504:0@lo:400:kworker.0 00010000:00080000:2.0:1789117934.448750:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbfd152c0 x1876025593254144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117934.448791:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593254144:0@lo:400:kworker.0 00000100:00100000:2.0:1789117934.448812:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593253376:0@lo:400:kworker.0 00010000:00080000:2.0:1789117934.448825:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbfd17480 x1876025593254016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117934.448834:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593254016:0@lo:400:kworker.0 00000100:00100000:2.0:1789117934.448915:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593253248:0@lo:400:kworker.0 00010000:00080000:2.0:1789117934.448931:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbfd17840 x1876025593253888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117934.448941:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593253888:0@lo:400:kworker.0 00000100:00100000:2.0:1789117934.448956:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593253632:0@lo:400:kworker.0 00010000:00080000:2.0:1789117934.448992:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbfd17c00 x1876025593253760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789117954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117934.449003:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789117934.449014:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789117934.452384:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789117934.452398:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789117934.452405:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b90dba800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789117934.452426:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789117934.452440:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593253760:0@lo:8:kworker.0 00000004:00080000:0.0:1789117934.455893:0:18543:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789117934.455941:0:18543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18543:1876025593254400:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1789117934.456050:0:18543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117934.456129:0:18543:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8168e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117934.456151:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789117934.456166:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593254272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789117934.456198:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117934.456266:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593254272 00000100:00100000:0.0:1789117934.456277:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593254272 00000100:00100000:0.0:1789117934.456341:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789117934.456354:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1876025593254272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789117934.456392:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789117934.456444:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1876025593254272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117934.456452:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789117934.456499:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b98a6e1c0 x1876025593254272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117934.456521:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593254272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789117934.456757:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593254400 00000100:00100000:2.0:1789117934.456763:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593254400 00000100:00100000:2.0:1789117934.456805:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117934.456823:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:18543:x1876025593254400:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:0.0:1789117934.462402:0:19313:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1789117934.462414:0:19313:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789117934.463138:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:18543:x1876025593254400:12345-0@lo:7:osp-pre-0-1.0 Request processed in 6308us (7079us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117934.463159:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:1.0:1789117934.464760:0:18542:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789117934.464906:0:18542:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 586747851415ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789117934.464917:0:18542:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1789117934.473028:0:18534:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00080000:2.0:1789117934.473293:0:18543:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b98a6d2c0 x1876025593254400/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789117950 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117934.473316:0:18543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18543:1876025593254400:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1789117934.473336:0:18543:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1789117934.473435:0:18543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7743c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18543:1876025593254528:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789117934.473515:0:18543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117934.473643:0:19312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593254528 00000100:00100000:0.0:1789117934.473653:0:19312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593254528 00000100:00100000:0.0:1789117934.473713:0:19312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789117934.473726:0:19312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf776d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:18543:x1876025593254528:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789117934.473767:0:19312:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00080000:3.0:1789117934.474080:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789117934.474089:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789117934.474093:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117934.478025:0:19312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf776d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:18543:x1876025593254528:12345-0@lo:5:osp-pre-0-1.0 Request processed in 4278us (4486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117934.478043:0:19312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117934.478607:0:18543:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbcdd4780 going to sleep for 11 seconds 00010000:00080000:2.0:1789117934.478667:0:18543:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf7743c0 x1876025593254528/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789117950 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117934.478687:0:18543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7743c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18543:1876025593254528:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789117934.478707:0:18543:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1789117934.478775:0:18543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7743c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18543:1876025593254656:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789117934.478847:0:18543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117934.478876:0:18543:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbcdd4780 going to sleep for 11 seconds 00000100:00100000:1.0:1789117934.479688:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593254656 00000100:00100000:1.0:1789117934.479699:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593254656 00000100:00100000:1.0:1789117934.479770:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789117934.479782:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:18543:x1876025593254656:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789117934.479843:0:19313:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:2.0:1789117934.536797:0:19307:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1789117934.536820:0:19307:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1789117934.547769:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:18543:x1876025593254656:12345-0@lo:5:osp-pre-0-1.0 Request processed in 67974us (68906us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789117934.547793:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789117934.547881:0:18543:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf7743c0 x1876025593254656/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789117950 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117934.547897:0:18543:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789117934.547906:0:18543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7743c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18543:1876025593254656:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789117934.547927:0:18543:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1789117934.548007:0:18543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7743c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:18543:1876025593254784:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789117934.548481:0:18543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117934.548542:0:18543:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbcdd4780 going to sleep for 11 seconds 00000100:00100000:3.0:1789117934.549395:0:17810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593254784 00000100:00100000:3.0:1789117934.549410:0:17810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593254784 00000100:00100000:3.0:1789117934.550315:0:17810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789117934.550342:0:17810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf774780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:18543:x1876025593254784:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789117934.550480:0:17810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf774780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:18543:x1876025593254784:12345-0@lo:900:osp-pre-0-1.0 Request processed in 152us (2007us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117934.550489:0:17810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789117934.551544:0:18543:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf7743c0 x1876025593254784/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789117950 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117934.551561:0:18543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7743c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:18543:1876025593254784:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1789117934.569022:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789117935.016266:0:17834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789117935.462236:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789117920/real 1789117920] req@ffff962a87f47c00 x1876025593246336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117935 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117935.462284:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962a87f47c00 x1876025593246336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117935 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789117935.462305:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bc1a36800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789117935.462327:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789117935.462331:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593246336:0@lo:8:kworker.0 00000100:00080000:1.0:1789117935.462480:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117935.462485:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789117935.462488:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117935.462491:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789117935.462513:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117935.462516:0:14597:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789117935.462519:0:14597:0:(import.c:65:import_set_state_nolock()) ffff962bc1a36800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789117935.462525:0:14597:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 572 00000100:00080000:1.0:1789117935.462530:0:14597:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789117935.462537:0:14597:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff962bc1a36800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789117935.462557:0:14597:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bc1a77480 x1876025593255552/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789117935.462618:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593255296:0@lo:400:kworker.0 00000100:00100000:1.0:1789117935.462692:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117935.462732:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593255936:0@lo:400:kworker.0 00000100:00100000:1.0:1789117935.462764:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117935.462810:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789117935.462817:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593254912:0@lo:400:kworker.0 00000100:00100000:1.0:1789117935.462846:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117935.462875:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593255424:0@lo:400:kworker.0 00000100:00100000:1.0:1789117935.462902:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117935.462929:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593255040:0@lo:400:kworker.0 00000100:00100000:1.0:1789117935.462953:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117935.462970:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a74780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593255680:0@lo:400:kworker.0 00000100:00100000:1.0:1789117935.462988:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117935.463005:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789117935.463009:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593255168:0@lo:400:kworker.0 00000100:00100000:1.0:1789117935.463029:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117935.463081:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593255808:0@lo:400:kworker.0 00000100:00100000:1.0:1789117935.463108:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117935.463134:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593255296 00000100:00100000:1.0:1789117935.463140:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593255296 00000100:00100000:1.0:1789117935.463178:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593255040 00000100:00100000:1.0:1789117935.463181:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593255040 00000100:00100000:1.0:1789117935.463197:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789117935.463205:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593255296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117935.463257:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593255296:12345-0@lo:400:kworker.0 Request processed in 52us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117935.463265:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789117935.463282:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789117935.463288:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86819e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593255040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117935.463320:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86819e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593255040:12345-0@lo:400:kworker.0 Request processed in 32us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117935.463333:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789117935.463354:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593255936 00000100:00100000:1.0:1789117935.463358:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593255936 00000100:00100000:1.0:1789117935.463390:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593255680 00000100:00100000:1.0:1789117935.463394:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593255680 00000100:00100000:1.0:1789117935.463407:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593255168 00000100:00100000:1.0:1789117935.463409:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593255168 00000100:00100000:1.0:1789117935.463419:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593255808 00000100:00100000:1.0:1789117935.463422:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593255808 00000100:00100000:1.0:1789117935.463439:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789117935.463449:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86819680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593255936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117935.463479:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86819680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593255936:12345-0@lo:400:kworker.0 Request processed in 33us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117935.463484:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789117935.463497:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789117935.463503:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86818b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593255680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117935.463546:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86818b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593255680:12345-0@lo:400:kworker.0 Request processed in 43us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117935.463552:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789117935.463564:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789117935.463569:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593255168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117935.463592:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593255168:12345-0@lo:400:kworker.0 Request processed in 23us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117935.463598:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789117935.463610:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789117935.463615:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593255808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117935.463653:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593255808:12345-0@lo:400:kworker.0 Request processed in 38us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117935.463659:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789117935.463680:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593254912 00000100:00100000:1.0:1789117935.463683:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593254912 00000100:00100000:1.0:1789117935.463721:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789117935.463727:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+21:3646:x1876025593254912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117935.463755:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+21:3646:x1876025593254912:12345-0@lo:400:kworker.0 Request processed in 29us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117935.463761:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:1.0:1789117935.463822:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a87f47c00 x1876025593255168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117935.463835:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593255168:0@lo:400:kworker.0 00010000:00080000:1.0:1789117935.463845:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bc1a76580 x1876025593255808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117935.463853:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593255808:0@lo:400:kworker.0 00000100:00100000:1.0:1789117935.463861:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593255040:0@lo:400:kworker.0 00010000:00080000:1.0:1789117935.463869:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bc1a74780 x1876025593255680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117935.463877:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a74780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593255680:0@lo:400:kworker.0 00000100:00100000:1.0:1789117935.463908:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593254912:0@lo:400:kworker.0 00000100:00100000:1.0:1789117935.463917:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593255296:0@lo:400:kworker.0 00010000:00080000:1.0:1789117935.463937:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bc1a752c0 x1876025593255936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117935.463945:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593255936:0@lo:400:kworker.0 00000100:00100000:0.0:1789117935.466536:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593255424 00000100:00100000:0.0:1789117935.466554:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593255424 00000100:00100000:0.0:1789117935.466644:0:19311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789117935.466655:0:19311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593255424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117935.466746:0:19311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593255424:12345-0@lo:400:kworker.0 Request processed in 92us (3841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117935.466753:0:19311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789117935.466802:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593255552:0@lo:8:kworker.0 00000100:00100000:0.0:1789117935.466842:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117935.466888:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593255552 00000100:00100000:0.0:1789117935.466891:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593255552 00000100:00100000:0.0:1789117935.466909:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789117935.466913:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876025593255552:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789117935.466932:0:19313:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1789117935.468556:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bc1a77c00 x1876025593255424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117935.468577:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593255424:0@lo:400:kworker.0 00000100:00100000:0.0:1789117935.492368:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876025593255552:12345-0@lo:8:kworker.0 Request processed in 25323us (25395us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789117935.492391:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789117935.492653:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bc1a36800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789117935.492663:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789117935.492668:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593255552:0@lo:8:kworker.0 00010000:00010000:3.0:1789117935.589878:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117935.977776:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf777840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593256064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117935.977856:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117935.977938:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593256064 00000100:00100000:0.0:1789117935.977945:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593256064 00000100:00100000:0.0:1789117935.978006:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789117935.978015:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593256064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789117935.978077:0:17804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789117935.978122:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593256064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117935.978129:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789117935.978175:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf777840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593256064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117935.983317:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86819a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593256192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789117935.983401:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117935.983701:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593256192 00000100:00100000:1.0:1789117935.983709:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593256192 00000100:00100000:1.0:1789117935.983757:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789117935.983766:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593256192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789117935.983802:0:17803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789117935.983851:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593256192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117935.983857:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789117935.983904:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86819a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593256192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789117936.488364:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789117916/real 1789117916] req@ffff962bc1a761c0 x1876025593244416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117936 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117936.488396:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962bc1a761c0 x1876025593244416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117936 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117936.488406:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789117916/real 1789117916] req@ffff962a87f470c0 x1876025593244544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117936 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117936.488416:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962a87f470c0 x1876025593244544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117936 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789117936.488437:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bae4d8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789117936.488458:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789117936.488462:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593244416:0@lo:8:kworker.0 00000100:00080000:2.0:1789117936.488468:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b853e0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789117936.488481:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789117936.488484:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593244544:0@lo:8:kworker.0 00000100:00080000:3.0:1789117936.488678:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789117936.488683:0:14597:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789117936.488686:0:14597:0:(import.c:65:import_set_state_nolock()) ffff962bae4d8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789117936.488691:0:14597:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 568 00000100:00080000:3.0:1789117936.488696:0:14597:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789117936.488703:0:14597:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff962bae4d8800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789117936.488723:0:14597:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962ba071bc00 x1876025593256448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789117936.488737:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789117936.488740:0:14597:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789117936.488742:0:14597:0:(import.c:65:import_set_state_nolock()) ffff962b853e0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789117936.488745:0:14597:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 568 00000100:00080000:3.0:1789117936.488748:0:14597:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789117936.488751:0:14597:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff962b853e0000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789117936.488763:0:14597:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962ba0718780 x1876025593256576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789117936.488795:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789117936.488799:0:14597:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789117936.488800:0:14597:0:(import.c:65:import_set_state_nolock()) ffff962bc1a36800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789117936.488804:0:14597:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 587 00000100:00080000:3.0:1789117936.488814:0:14597:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789117936.488818:0:14597:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff962bc1a36800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789117936.488831:0:14597:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962ba071ad00 x1876025593256960/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789117936.488873:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0719a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593256704:0@lo:400:kworker.0 00000100:00100000:3.0:1789117936.488932:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117936.488964:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0719680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593257344:0@lo:400:kworker.0 00000100:00100000:3.0:1789117936.489005:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117936.489036:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117936.489042:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593256832:0@lo:400:kworker.0 00000100:00100000:3.0:1789117936.489095:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117936.489130:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593256704 00000100:00100000:3.0:1789117936.489136:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593256704 00000100:00100000:3.0:1789117936.489185:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593257344 00000100:00100000:3.0:1789117936.489189:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593257344 00000100:00100000:3.0:1789117936.489216:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789117936.489224:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba07192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593256704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117936.489272:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba07192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593256704:12345-0@lo:400:kworker.0 Request processed in 48us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117936.489280:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789117936.489297:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789117936.489303:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0718000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593257344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117936.489331:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0718000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593257344:12345-0@lo:400:kworker.0 Request processed in 28us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117936.489338:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789117936.489359:0:19312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593256832 00000100:00100000:3.0:1789117936.489367:0:19312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593256832 00000100:00100000:3.0:1789117936.489397:0:19312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789117936.489404:0:19312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a886270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593256832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117936.489436:0:19312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a886270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593256832:12345-0@lo:400:kworker.0 Request processed in 33us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117936.489443:0:19312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789117936.489462:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789117936.489466:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789117936.489478:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593256448:0@lo:8:kworker.0 00000100:00100000:1.0:1789117936.489657:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf05977c-16b5-4df3-81bb-3835e509f77c:3645:1876025593256320:0@lo:400:kworker.0 00000100:00100000:2.0:1789117936.489723:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593257088:0@lo:400:kworker.0 00010000:00080000:0.0:1789117936.492215:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962ba071a1c0 x1876025593256832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117936.492234:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593256832:0@lo:400:kworker.0 00010000:00080000:0.0:1789117936.492249:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962ba0719a40 x1876025593256704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117936.492259:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0719a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593256704:0@lo:400:kworker.0 00010000:00080000:0.0:1789117936.492269:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962ba0719680 x1876025593257344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117936.492277:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0719680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593257344:0@lo:400:kworker.0 00000100:00100000:2.0:1789117936.497810:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117936.498116:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593257088 00000100:00100000:1.0:1789117936.498126:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593257088 00000100:00100000:1.0:1789117936.498194:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789117936.498204:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593257088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117936.498273:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593257088:12345-0@lo:400:kworker.0 Request processed in 71us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117936.498281:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789117936.499741:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117936.499811:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0719e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593257216:0@lo:400:kworker.0 00000100:00100000:1.0:1789117936.499854:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117936.501662:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593257216 00000100:00100000:0.0:1789117936.501674:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593257216 00000100:00100000:0.0:1789117936.501744:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789117936.501754:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86819a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593257216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117936.502624:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593256320 00000100:00100000:2.0:1789117936.502631:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593256320 00000100:00100000:2.0:1789117936.502670:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789117936.502678:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+21:3645:x1876025593256320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117936.502762:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+21:3645:x1876025593256320:12345-0@lo:400:kworker.0 Request processed in 85us (3026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117936.502770:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789117936.502850:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf05977c-16b5-4df3-81bb-3835e509f77c:3645:1876025593256320:0@lo:400:kworker.0 00010000:00080000:2.0:1789117936.502899:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962ba071b480 x1876025593257088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117936.502911:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593257088:0@lo:400:kworker.0 00000100:00080000:2.0:1789117936.502943:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117936.503315:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86819a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593257216:12345-0@lo:400:kworker.0 Request processed in 1562us (3458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117936.503323:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1789117936.503674:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962ba0719e00 x1876025593257216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117936.503686:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0719e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593257216:0@lo:400:kworker.0 00000100:00100000:3.0:1789117936.506452:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117936.506598:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593256448 00000100:00100000:1.0:1789117936.506607:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593256448 00000100:00100000:1.0:1789117936.506659:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789117936.506667:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88627840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876025593256448:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789117936.506705:0:19313:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 588 last 0 00000020:00000080:1.0:1789117936.506739:0:19313:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa253ed19be20da8 00002000:00100000:1.0:1789117936.506756:0:19313:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff962a87d64800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789117936.506760:0:19313:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789117936.506762:0:19313:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1789117936.507167:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0718780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593256576:0@lo:8:kworker.0 00000100:00100000:3.0:1789117936.507225:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117936.507287:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593256960:0@lo:8:kworker.0 00000100:00100000:3.0:1789117936.507313:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1789117936.509138:0:19313:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789117936.509177:0:19313:0:(import.c:65:import_set_state_nolock()) ffff962a87d61000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789117936.509249:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88627840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1876025593256448:12345-0@lo:8:kworker.0 Request processed in 2581us (2804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117936.509260:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789117936.515349:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962ba071bc00 x1876025593256448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789117961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117936.515365:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789117936.515375:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789117936.515384:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789117936.515390:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789117936.515393:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bae4d8800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789117936.515415:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789117936.515422:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593256448:0@lo:8:kworker.0 00000004:00080000:1.0:1789117936.515548:0:17822:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789117936.515653:0:17822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 588798598243ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789117936.515660:0:17822:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1789117936.515822:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593256576 00000100:00100000:1.0:1789117936.515830:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593256576 00000100:00100000:1.0:1789117936.515851:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593256960 00000100:00100000:1.0:1789117936.515854:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593256960 00000100:00100000:1.0:1789117936.515867:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789117936.515874:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88624f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876025593256576:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789117936.515896:0:19313:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789117936.515967:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88624f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876025593256576:12345-0@lo:8:kworker.0 Request processed in 92us (8741us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789117936.515998:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789117936.516016:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789117936.516036:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88626580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876025593256960:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789117936.516047:0:19313:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789117936.516094:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88626580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876025593256960:12345-0@lo:8:kworker.0 Request processed in 72us (8779us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789117936.516100:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00080000:1.0:1789117936.522257:0:17778:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1789117936.526106:0:17823:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:2.0:1789117936.526141:0:17823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf776580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17823:1876025593257600:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789117936.526214:0:17823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117936.526248:0:17823:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbcdd4180 going to sleep for 11 seconds 00000100:00100000:2.0:1789117936.526266:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593257472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117936.526288:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117936.526343:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593257472 00000100:00100000:2.0:1789117936.526349:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593257472 00000100:00100000:2.0:1789117936.526402:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117936.526411:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf775e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876025593257472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789117936.526438:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789117936.526615:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf775e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876025593257472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 203us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117936.526623:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789117936.526648:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789117936.526678:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf7770c0 x1876025593257472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117952 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117936.526698:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593257472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117936.526723:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593257600 00000100:00100000:2.0:1789117936.526727:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593257600 00000100:00100000:2.0:1789117936.526756:0:19311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789117936.526763:0:19311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf775680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17823:x1876025593257600:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1789117936.527939:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b853e0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789117936.527949:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789117936.527953:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0718780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593256576:0@lo:8:kworker.0 00000100:00080000:3.0:1789117936.527989:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bc1a36800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789117936.527993:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789117936.527996:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593256960:0@lo:8:kworker.0 00002000:00080000:2.0:1789117936.533800:0:19311:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789117936.533813:0:19311:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1789117936.533819:0:19311:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00002000:00010000:2.0:1789117936.552033:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789117936.552047:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be20daf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.552091:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=588s v=(0 0) 00010000:00010000:2.0:1789117936.552097:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117936.552105:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be20daf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.552137:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be20daf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.552149:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be20daf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.552158:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be20daf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.552179:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789117936.552714:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789117936.552721:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000308f762/0xaa253ed19be20db6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.552731:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=588s v=(0 0) 00010000:00010000:2.0:1789117936.552735:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117936.552739:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000308f762/0xaa253ed19be20db6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.552749:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000308f762/0xaa253ed19be20db6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.552757:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000308f762/0xaa253ed19be20db6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.552777:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000308f762/0xaa253ed19be20db6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.552796:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789117936.552809:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789117936.552815:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be20daf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.552823:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f2000 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117936.552828:0:17787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be20daf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.552838:0:17787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be20daf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.552856:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be20daf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.552865:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011d81103/0xaa253ed19be20daf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.552881:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117936.552884:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000308f762/0xaa253ed19be20db6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.552901:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f3400 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117936.552904:0:17787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000308f762/0xaa253ed19be20db6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.552912:0:17787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000308f762/0xaa253ed19be20db6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.552924:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000308f762/0xaa253ed19be20db6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.552932:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000308f762/0xaa253ed19be20db6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.552944:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117936.552946:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117936.552948:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117936.553093:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789117936.553407:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789117936.553414:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9e9d94b/0xaa253ed19be20dbd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.553423:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=588s v=(0 0) 00010000:00010000:2.0:1789117936.553427:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117936.553431:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9e9d94b/0xaa253ed19be20dbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.553441:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9e9d94b/0xaa253ed19be20dbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.553455:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9e9d94b/0xaa253ed19be20dbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.553462:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9e9d94b/0xaa253ed19be20dbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.554900:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789117936.554919:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117936.554926:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9e9d94b/0xaa253ed19be20dbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.554937:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f3e00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117936.554940:0:18557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9e9d94b/0xaa253ed19be20dbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.554949:0:18557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9e9d94b/0xaa253ed19be20dbd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.554966:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9e9d94b/0xaa253ed19be20dbd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.554973:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9e9d94b/0xaa253ed19be20dbd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.555004:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117936.555013:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117936.555015:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789117936.555842:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789117936.555851:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d7d7fb5/0xaa253ed19be20dc4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.555863:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=588s v=(0 0) 00010000:00010000:2.0:1789117936.555866:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117936.555873:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d7d7fb5/0xaa253ed19be20dc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.555884:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d7d7fb5/0xaa253ed19be20dc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.555892:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d7d7fb5/0xaa253ed19be20dc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.555899:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d7d7fb5/0xaa253ed19be20dc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.555918:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789117936.555927:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117936.555932:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d7d7fb5/0xaa253ed19be20dc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.555938:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f3c00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117936.555943:0:17787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d7d7fb5/0xaa253ed19be20dc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.555962:0:17787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d7d7fb5/0xaa253ed19be20dc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.555973:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d7d7fb5/0xaa253ed19be20dc4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.555993:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d7d7fb5/0xaa253ed19be20dc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.556007:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117936.556009:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117936.556010:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789117936.556413:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789117936.556419:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba575216/0xaa253ed19be20dcb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.556426:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=588s v=(0 0) 00010000:00010000:2.0:1789117936.556429:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117936.556433:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba575216/0xaa253ed19be20dcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.556442:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba575216/0xaa253ed19be20dcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.556449:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba575216/0xaa253ed19be20dcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.556463:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba575216/0xaa253ed19be20dcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.556494:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789117936.556864:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789117936.556870:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056e441d1/0xaa253ed19be20dd2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.556878:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=588s v=(0 0) 00010000:00010000:2.0:1789117936.556880:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117936.556884:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056e441d1/0xaa253ed19be20dd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.556891:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056e441d1/0xaa253ed19be20dd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.556898:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056e441d1/0xaa253ed19be20dd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.556904:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056e441d1/0xaa253ed19be20dd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.556923:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789117936.556933:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789117936.556938:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba575216/0xaa253ed19be20dcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.556951:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f2e00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117936.556955:0:18557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba575216/0xaa253ed19be20dcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.556963:0:18557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba575216/0xaa253ed19be20dcb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.557174:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba575216/0xaa253ed19be20dcb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.557183:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba575216/0xaa253ed19be20dcb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.557203:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117936.557206:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056e441d1/0xaa253ed19be20dd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.557213:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f2600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117936.557216:0:18557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056e441d1/0xaa253ed19be20dd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.557223:0:18557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056e441d1/0xaa253ed19be20dd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.557233:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056e441d1/0xaa253ed19be20dd2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.557246:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056e441d1/0xaa253ed19be20dd2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.557257:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117936.557259:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117936.557261:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117936.557635:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789117936.557715:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789117936.557722:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007834083c/0xaa253ed19be20dd9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.557731:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=588s v=(0 0) 00010000:00010000:2.0:1789117936.557734:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117936.557738:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007834083c/0xaa253ed19be20dd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.557749:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007834083c/0xaa253ed19be20dd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.557757:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007834083c/0xaa253ed19be20dd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.557765:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007834083c/0xaa253ed19be20dd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.557831:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789117936.558166:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789117936.558177:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc9e834b/0xaa253ed19be20de0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.558185:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=588s v=(0 0) 00010000:00010000:2.0:1789117936.558188:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117936.558192:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9e834b/0xaa253ed19be20de0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.558202:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc9e834b/0xaa253ed19be20de0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.558210:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc9e834b/0xaa253ed19be20de0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.558217:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9e834b/0xaa253ed19be20de0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.559747:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789117936.559761:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007834083c/0xaa253ed19be20dd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.559773:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f3200 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789117936.559777:0:17787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007834083c/0xaa253ed19be20dd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.559787:0:17787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007834083c/0xaa253ed19be20dd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.559819:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007834083c/0xaa253ed19be20dd9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.559828:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007834083c/0xaa253ed19be20dd9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.559851:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117936.559854:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc9e834b/0xaa253ed19be20de0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.559860:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f3000 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789117936.559871:0:17787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc9e834b/0xaa253ed19be20de0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.559878:0:17787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc9e834b/0xaa253ed19be20de0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.559888:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc9e834b/0xaa253ed19be20de0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.559895:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117936.559896:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117936.559898:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117936.563247:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789117936.563260:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc9e834b/0xaa253ed19be20de0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.563779:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789117936.563916:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789117936.563924:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000853a7cdc/0xaa253ed19be20de7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.563937:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=588s v=(0 0) 00010000:00010000:2.0:1789117936.563941:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117936.563954:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000853a7cdc/0xaa253ed19be20de7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.563969:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000853a7cdc/0xaa253ed19be20de7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.564184:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000853a7cdc/0xaa253ed19be20de7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.564194:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000853a7cdc/0xaa253ed19be20de7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.564217:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789117936.564464:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117936.564482:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000853a7cdc/0xaa253ed19be20de7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.564491:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f2c00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117936.564496:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000853a7cdc/0xaa253ed19be20de7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.564512:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000853a7cdc/0xaa253ed19be20de7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.564535:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000853a7cdc/0xaa253ed19be20de7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.564542:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000853a7cdc/0xaa253ed19be20de7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.564572:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117936.564574:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117936.564576:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789117936.564747:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789117936.564753:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce58800/0xaa253ed19be20dee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.564762:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=588s v=(0 0) 00010000:00010000:2.0:1789117936.564765:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117936.564769:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce58800/0xaa253ed19be20dee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.564778:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce58800/0xaa253ed19be20dee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.564786:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce58800/0xaa253ed19be20dee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.564918:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce58800/0xaa253ed19be20dee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.564987:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789117936.565364:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789117936.565371:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000841f5c4e/0xaa253ed19be20df5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.565379:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=588s v=(0 0) 00010000:00010000:2.0:1789117936.565383:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117936.565387:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000841f5c4e/0xaa253ed19be20df5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.565396:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000841f5c4e/0xaa253ed19be20df5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.565404:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000841f5c4e/0xaa253ed19be20df5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.565411:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000841f5c4e/0xaa253ed19be20df5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.566160:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789117936.566168:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce58800/0xaa253ed19be20dee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.566178:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92400 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117936.566183:0:17787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce58800/0xaa253ed19be20dee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.566193:0:17787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce58800/0xaa253ed19be20dee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.566209:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce58800/0xaa253ed19be20dee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.566217:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce58800/0xaa253ed19be20dee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.566234:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117936.566238:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000841f5c4e/0xaa253ed19be20df5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.566244:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93e00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117936.566257:0:17787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000841f5c4e/0xaa253ed19be20df5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.566266:0:17787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000841f5c4e/0xaa253ed19be20df5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.566276:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000841f5c4e/0xaa253ed19be20df5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.566284:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117936.566286:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117936.566288:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117936.566594:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789117936.566601:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000841f5c4e/0xaa253ed19be20df5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789117936.567141:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789117936.567148:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079d9f570/0xaa253ed19be20dfc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.567158:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=588s v=(0 0) 00010000:00010000:2.0:1789117936.567162:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117936.567168:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079d9f570/0xaa253ed19be20dfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.567179:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079d9f570/0xaa253ed19be20dfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.567188:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079d9f570/0xaa253ed19be20dfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.567196:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079d9f570/0xaa253ed19be20dfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.569974:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117936.569996:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079d9f570/0xaa253ed19be20dfc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.570009:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93400 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789117936.570013:0:18557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079d9f570/0xaa253ed19be20dfc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.570034:0:18557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079d9f570/0xaa253ed19be20dfc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.570076:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079d9f570/0xaa253ed19be20dfc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.570088:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117936.570090:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117936.570091:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117936.572709:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789117936.572726:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079d9f570/0xaa253ed19be20dfc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.573098:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789117936.574407:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789117936.574419:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a55ee79f/0xaa253ed19be20e03 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.574447:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=588s v=(0 0) 00010000:00010000:2.0:1789117936.574452:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117936.574459:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a55ee79f/0xaa253ed19be20e03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.574486:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a55ee79f/0xaa253ed19be20e03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.574497:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a55ee79f/0xaa253ed19be20e03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.575207:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a55ee79f/0xaa253ed19be20e03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.575268:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789117936.577188:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117936.577199:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fa09b25/0xaa253ed19be20e0a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.577214:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=588s v=(0 0) 00010000:00010000:0.0:1789117936.577218:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117936.577224:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fa09b25/0xaa253ed19be20e0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.577242:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fa09b25/0xaa253ed19be20e0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.577253:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fa09b25/0xaa253ed19be20e0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.577260:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fa09b25/0xaa253ed19be20e0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.577384:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789117936.577393:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a55ee79f/0xaa253ed19be20e03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.577401:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93800 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117936.577405:0:17787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a55ee79f/0xaa253ed19be20e03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.577415:0:17787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a55ee79f/0xaa253ed19be20e03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.577430:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a55ee79f/0xaa253ed19be20e03 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.577438:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a55ee79f/0xaa253ed19be20e03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.577462:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117936.577555:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fa09b25/0xaa253ed19be20e0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.577563:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9a600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117936.577566:0:17787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fa09b25/0xaa253ed19be20e0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.577575:0:17787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fa09b25/0xaa253ed19be20e0a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.577586:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fa09b25/0xaa253ed19be20e0a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.577594:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117936.577595:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117936.577597:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117936.578104:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789117936.578110:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fa09b25/0xaa253ed19be20e0a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789117936.578659:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117936.578666:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a438b78b/0xaa253ed19be20e11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.578676:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=588s v=(0 0) 00010000:00010000:0.0:1789117936.578679:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117936.578684:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a438b78b/0xaa253ed19be20e11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.578695:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a438b78b/0xaa253ed19be20e11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.578714:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a438b78b/0xaa253ed19be20e11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.578722:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a438b78b/0xaa253ed19be20e11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.578734:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789117936.579792:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117936.579801:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024136832/0xaa253ed19be20e18 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.579812:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=588s v=(0 0) 00010000:00010000:0.0:1789117936.579815:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117936.579820:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024136832/0xaa253ed19be20e18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.579831:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024136832/0xaa253ed19be20e18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.579838:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024136832/0xaa253ed19be20e18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.579844:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024136832/0xaa253ed19be20e18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.579872:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789117936.580322:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117936.580328:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099c12d13/0xaa253ed19be20e1f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.580337:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=588s v=(0 0) 00010000:00010000:0.0:1789117936.580341:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117936.580345:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099c12d13/0xaa253ed19be20e1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.580353:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099c12d13/0xaa253ed19be20e1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.580361:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099c12d13/0xaa253ed19be20e1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.580367:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099c12d13/0xaa253ed19be20e1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.580375:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1789117936.580871:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117936.580877:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff3b8b90/0xaa253ed19be20e26 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.580886:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=588s v=(0 0) 00010000:00010000:0.0:1789117936.580896:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117936.580900:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff3b8b90/0xaa253ed19be20e26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.580910:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff3b8b90/0xaa253ed19be20e26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.580919:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff3b8b90/0xaa253ed19be20e26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.580926:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff3b8b90/0xaa253ed19be20e26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.580935:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1789117936.583756:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117936.583769:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000109c4dac/0xaa253ed19be20e2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.583783:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=588s v=(0 0) 00010000:00010000:0.0:1789117936.583788:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117936.583793:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000109c4dac/0xaa253ed19be20e2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.583806:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000109c4dac/0xaa253ed19be20e2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.583816:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000109c4dac/0xaa253ed19be20e2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.583836:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000109c4dac/0xaa253ed19be20e2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.583847:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1789117936.585507:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789117936.585521:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a438b78b/0xaa253ed19be20e11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.585533:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9a400 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117936.585538:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a438b78b/0xaa253ed19be20e11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.585565:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a438b78b/0xaa253ed19be20e11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.585585:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a438b78b/0xaa253ed19be20e11 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.585593:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a438b78b/0xaa253ed19be20e11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.585616:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789117936.585620:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024136832/0xaa253ed19be20e18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.585627:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9b000 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117936.585630:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024136832/0xaa253ed19be20e18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.585637:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024136832/0xaa253ed19be20e18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.585647:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024136832/0xaa253ed19be20e18 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.585653:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024136832/0xaa253ed19be20e18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.585677:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789117936.585680:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099c12d13/0xaa253ed19be20e1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.585687:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9b600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117936.585689:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099c12d13/0xaa253ed19be20e1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.585697:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099c12d13/0xaa253ed19be20e1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.585707:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099c12d13/0xaa253ed19be20e1f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.585715:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099c12d13/0xaa253ed19be20e1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.585725:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789117936.585729:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff3b8b90/0xaa253ed19be20e26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.585735:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9bc00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117936.585738:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff3b8b90/0xaa253ed19be20e26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.585757:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff3b8b90/0xaa253ed19be20e26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.585767:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff3b8b90/0xaa253ed19be20e26 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.585775:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff3b8b90/0xaa253ed19be20e26 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.585788:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117936.585791:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000109c4dac/0xaa253ed19be20e2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.585797:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9be00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117936.585801:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000109c4dac/0xaa253ed19be20e2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.585808:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000109c4dac/0xaa253ed19be20e2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.585818:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000109c4dac/0xaa253ed19be20e2d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.585825:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000109c4dac/0xaa253ed19be20e2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.585849:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117936.585850:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117936.585852:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117936.585859:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117936.585878:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789117936.586453:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117936.586462:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d5b0706/0xaa253ed19be20e34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.586486:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=588s v=(0 0) 00010000:00010000:0.0:1789117936.586491:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117936.586496:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d5b0706/0xaa253ed19be20e34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.587154:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d5b0706/0xaa253ed19be20e34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.587166:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d5b0706/0xaa253ed19be20e34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.587186:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d5b0706/0xaa253ed19be20e34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.587208:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789117936.588249:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117936.588260:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d5b0706/0xaa253ed19be20e34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.588270:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9b400 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117936.588274:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d5b0706/0xaa253ed19be20e34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.588283:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d5b0706/0xaa253ed19be20e34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.588299:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d5b0706/0xaa253ed19be20e34 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.588305:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d5b0706/0xaa253ed19be20e34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.588328:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117936.588330:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117936.588332:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789117936.589816:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117936.589828:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5cb8eec/0xaa253ed19be20e3b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.589850:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=588s v=(0 0) 00010000:00010000:0.0:1789117936.589855:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117936.589861:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5cb8eec/0xaa253ed19be20e3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.589874:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5cb8eec/0xaa253ed19be20e3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.589882:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5cb8eec/0xaa253ed19be20e3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.589889:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5cb8eec/0xaa253ed19be20e3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.589910:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789117936.590105:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117936.590117:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5cb8eec/0xaa253ed19be20e3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.590124:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9a800 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117936.590128:0:18557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5cb8eec/0xaa253ed19be20e3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.590135:0:18557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5cb8eec/0xaa253ed19be20e3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.590149:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5cb8eec/0xaa253ed19be20e3b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.590156:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5cb8eec/0xaa253ed19be20e3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.590172:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117936.590174:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117936.590175:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789117936.591248:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117936.591259:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f29bf47d/0xaa253ed19be20e42 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.591270:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=588s v=(0 0) 00010000:00010000:0.0:1789117936.591273:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117936.591279:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f29bf47d/0xaa253ed19be20e42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.591290:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f29bf47d/0xaa253ed19be20e42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.591310:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f29bf47d/0xaa253ed19be20e42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.591318:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f29bf47d/0xaa253ed19be20e42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.591338:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789117936.591502:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117936.591509:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f29bf47d/0xaa253ed19be20e42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.591516:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9aa00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789117936.591520:0:17787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f29bf47d/0xaa253ed19be20e42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.592906:0:17787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f29bf47d/0xaa253ed19be20e42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.592932:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f29bf47d/0xaa253ed19be20e42 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.592938:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f29bf47d/0xaa253ed19be20e42 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117936.592955:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117936.592966:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117936.592969:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117936.593256:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789117936.593263:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ffab202/0xaa253ed19be20e49 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.593274:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=588s v=(0 0) 00010000:00010000:3.0:1789117936.593278:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117936.593283:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ffab202/0xaa253ed19be20e49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.593294:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ffab202/0xaa253ed19be20e49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.593303:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ffab202/0xaa253ed19be20e49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.593311:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ffab202/0xaa253ed19be20e49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.593342:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789117936.593607:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117936.593614:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ffab202/0xaa253ed19be20e49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.593622:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b80030c00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117936.593626:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ffab202/0xaa253ed19be20e49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.593634:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ffab202/0xaa253ed19be20e49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.593658:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ffab202/0xaa253ed19be20e49 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.593665:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ffab202/0xaa253ed19be20e49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.593681:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117936.593683:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117936.593684:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117936.596221:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789117936.596232:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5b60311/0xaa253ed19be20e50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.596247:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=588s v=(0 0) 00010000:00010000:3.0:1789117936.596251:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117936.596257:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5b60311/0xaa253ed19be20e50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.596270:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5b60311/0xaa253ed19be20e50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.596280:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5b60311/0xaa253ed19be20e50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.596288:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5b60311/0xaa253ed19be20e50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.596313:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789117936.597168:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1789117936.597547:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789117936.597556:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000459e3a3a/0xaa253ed19be20e57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.597568:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=588s v=(0 0) 00010000:00010000:3.0:1789117936.597579:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117936.597584:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000459e3a3a/0xaa253ed19be20e57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.597597:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000459e3a3a/0xaa253ed19be20e57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.597606:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000459e3a3a/0xaa253ed19be20e57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.597613:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000459e3a3a/0xaa253ed19be20e57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.597632:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789117936.598136:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789117936.598142:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f39f1f1/0xaa253ed19be20e5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.598151:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=588s v=(0 0) 00010000:00010000:3.0:1789117936.598155:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117936.598159:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f39f1f1/0xaa253ed19be20e5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.598168:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f39f1f1/0xaa253ed19be20e5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.598188:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f39f1f1/0xaa253ed19be20e5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.598201:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f39f1f1/0xaa253ed19be20e5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.598221:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789117936.598619:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5b60311/0xaa253ed19be20e50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.598628:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b80031600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117936.598633:0:18557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5b60311/0xaa253ed19be20e50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.598653:0:18557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5b60311/0xaa253ed19be20e50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.598670:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5b60311/0xaa253ed19be20e50 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.598678:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5b60311/0xaa253ed19be20e50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.598696:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789117936.598699:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000459e3a3a/0xaa253ed19be20e57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.598705:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f5a00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117936.598708:0:18557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000459e3a3a/0xaa253ed19be20e57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.598715:0:18557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000459e3a3a/0xaa253ed19be20e57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.598723:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000459e3a3a/0xaa253ed19be20e57 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.598730:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000459e3a3a/0xaa253ed19be20e57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.598755:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117936.598758:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f39f1f1/0xaa253ed19be20e5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.598763:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9aa00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117936.598766:0:18557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f39f1f1/0xaa253ed19be20e5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.598773:0:18557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f39f1f1/0xaa253ed19be20e5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.598783:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f39f1f1/0xaa253ed19be20e5e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.598791:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f39f1f1/0xaa253ed19be20e5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117936.598802:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117936.598804:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117936.598806:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117936.598904:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789117936.598911:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000862618a4/0xaa253ed19be20e65 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.598920:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=588s v=(0 0) 00010000:00010000:3.0:1789117936.598924:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117936.598928:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862618a4/0xaa253ed19be20e65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.598939:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862618a4/0xaa253ed19be20e65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.598948:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000862618a4/0xaa253ed19be20e65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.598956:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862618a4/0xaa253ed19be20e65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.598975:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789117936.599423:0:19311:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789117936.599429:0:19311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000138d0b9f/0xaa253ed19be20e6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.599442:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=588s v=(0 0) 00010000:00010000:3.0:1789117936.599445:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117936.599449:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000138d0b9f/0xaa253ed19be20e6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.599458:0:19311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000138d0b9f/0xaa253ed19be20e6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.599466:0:19311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000138d0b9f/0xaa253ed19be20e6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.599483:0:19311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000138d0b9f/0xaa253ed19be20e6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117936.599492:0:19311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:3.0:1789117936.599531:0:19311:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:3.0:1789117936.599621:0:19311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf775680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17823:x1876025593257600:12345-0@lo:5:osp-pre-0-0.0 Request processed in 72855us (73403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117936.599631:0:19311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1789117936.599816:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789117936.599822:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862618a4/0xaa253ed19be20e65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.599830:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9b600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117936.599834:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862618a4/0xaa253ed19be20e65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.599842:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862618a4/0xaa253ed19be20e65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.599855:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862618a4/0xaa253ed19be20e65 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.599862:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862618a4/0xaa253ed19be20e65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.599890:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117936.599893:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000138d0b9f/0xaa253ed19be20e6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.599900:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9a600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117936.599903:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000138d0b9f/0xaa253ed19be20e6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.599910:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000138d0b9f/0xaa253ed19be20e6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.599920:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000138d0b9f/0xaa253ed19be20e6c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.599927:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000138d0b9f/0xaa253ed19be20e6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117936.599938:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117936.599939:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117936.599941:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117936.599990:0:17823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf776580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17823:1876025593257600:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789117936.600004:0:17823:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:2.0:1789117936.600079:0:17823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf776580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17823:1876025593257728:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789117936.600115:0:17823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117936.600149:0:17823:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a88434f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117936.600304:0:19312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593257728 00000100:00100000:3.0:1789117936.600310:0:19312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593257728 00000100:00100000:3.0:1789117936.600352:0:19312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789117936.600359:0:19312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17823:x1876025593257728:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789117936.600391:0:19312:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:0.0:1789117936.602029:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117936.602142:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117936.614088:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789117936.618224:0:19307:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1789117936.618265:0:19307:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789117936.618490:0:19312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17823:x1876025593257728:12345-0@lo:5:osp-pre-0-0.0 Request processed in 18127us (18369us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789117936.618515:0:19312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789117936.619326:0:17823:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1789117936.619339:0:17823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf776580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17823:1876025593257728:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789117936.619356:0:17823:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:0.0:1789117937.638636:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117938.661349:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117939.559531:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593257856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789117939.559748:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117939.559825:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593257856 00000100:00100000:0.0:1789117939.559833:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593257856 00000100:00100000:0.0:1789117939.559979:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789117939.559993:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593257856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789117939.560027:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789117939.562263:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593257856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2266us (2647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117939.562279:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789117939.562322:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789117939.563871:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593257856:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789117939.685368:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789117939.698488:0:19678:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789117940.709236:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789117940.880769:0:19731:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789117940.881371:0:19731:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789117941.093527:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789117941.093555:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593257984:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789117941.093639:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117941.093709:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593257984 00000100:00100000:0.0:1789117941.093718:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593257984 00000100:00100000:0.0:1789117941.093770:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789117941.093781:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593257984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789117941.093830:0:18751:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789117941.093889:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593257984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117941.093896:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789117941.093964:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593257984:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789117941.094402:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789117941.105307:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593258112:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789117941.105396:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117941.107831:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593258112 00000100:00100000:1.0:1789117941.107849:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593258112 00000100:00100000:1.0:1789117941.107955:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789117941.107966:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88624780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593258112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789117941.108009:0:17804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789117941.108710:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88624780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593258112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 743us (3311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117941.108719:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789117941.108780:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593258112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117941.606214:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf776580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593258240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117941.606297:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117941.606502:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593258240 00000100:00100000:2.0:1789117941.606511:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593258240 00000100:00100000:2.0:1789117941.606582:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789117941.606591:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593258240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789117941.606619:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789117941.606668:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593258240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117941.606674:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789117941.606730:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf776580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593258240:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789117941.606791:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789117941.609591:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117941.609598:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789117941.609602:0:37:0:(import.c:65:import_set_state_nolock()) ffff962b853e0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789117941.609612:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 588 00000100:00080000:1.0:1789117941.609617:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789117941.609625:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff962b853e0000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789117941.609652:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a8681ad00 x1876025593258496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789117941.609697:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117941.609701:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789117941.609703:0:37:0:(import.c:65:import_set_state_nolock()) ffff962bc1a36800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789117941.609706:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 588 00000100:00080000:1.0:1789117941.609709:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789117941.609712:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff962bc1a36800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789117941.609723:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a868192c0 x1876025593258880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789117941.609791:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593258496:0@lo:8:kworker.0 00000100:00100000:2.0:1789117941.610972:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a868183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593258624:0@lo:400:kworker.0 00000100:00100000:2.0:1789117941.611045:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117941.611099:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593259264:0@lo:400:kworker.0 00000100:00100000:2.0:1789117941.611122:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117941.611152:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789117941.611158:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf05977c-16b5-4df3-81bb-3835e509f77c:3645:1876025593258368:0@lo:400:kworker.0 00000100:00100000:2.0:1789117941.611188:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117941.611220:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86818f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593259136:0@lo:400:kworker.0 00000100:00100000:2.0:1789117941.611263:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117941.611300:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593258624 00000100:00100000:2.0:1789117941.611308:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593258624 00000100:00100000:2.0:1789117941.611361:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593259264 00000100:00100000:2.0:1789117941.611364:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593259264 00000100:00100000:2.0:1789117941.611388:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593259136 00000100:00100000:2.0:1789117941.611391:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593259136 00000100:00100000:2.0:1789117941.611908:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789117941.611922:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf776580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593258624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117941.612000:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf776580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593258624:12345-0@lo:400:kworker.0 Request processed in 82us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117941.612008:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789117941.612028:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789117941.612035:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf776940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593259264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117941.612090:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf776940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593259264:12345-0@lo:400:kworker.0 Request processed in 56us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117941.612097:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789117941.612110:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789117941.612116:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593259136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117941.612143:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593259136:12345-0@lo:400:kworker.0 Request processed in 28us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117941.612149:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789117941.612173:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593258368 00000100:00100000:2.0:1789117941.612177:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593258368 00000100:00100000:2.0:1789117941.612208:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789117941.612214:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+21:3645:x1876025593258368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117941.612244:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+21:3645:x1876025593258368:12345-0@lo:400:kworker.0 Request processed in 30us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117941.612260:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1789117941.612292:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789117941.612297:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789117941.612314:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86818780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593259008:0@lo:400:kworker.0 00000100:00100000:2.0:1789117941.612355:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117941.612380:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789117941.612387:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593258752:0@lo:400:kworker.0 00000100:00100000:2.0:1789117941.612501:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117941.612557:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf05977c-16b5-4df3-81bb-3835e509f77c:3645:1876025593258368:0@lo:400:kworker.0 00010000:00080000:2.0:1789117941.612575:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a86818f00 x1876025593259136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117941.612587:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86818f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593259136:0@lo:400:kworker.0 00010000:00080000:2.0:1789117941.612597:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a868183c0 x1876025593258624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117941.612605:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a868183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593258624:0@lo:400:kworker.0 00010000:00080000:2.0:1789117941.612615:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a8681a940 x1876025593259264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117941.612623:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593259264:0@lo:400:kworker.0 00000100:00100000:2.0:1789117941.612656:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593259008 00000100:00100000:2.0:1789117941.612661:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593259008 00000100:00100000:2.0:1789117941.612690:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789117941.612696:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593259008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117941.612731:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593259008:12345-0@lo:400:kworker.0 Request processed in 35us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117941.612744:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1789117941.612771:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a86818780 x1876025593259008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117941.612780:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86818780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593259008:0@lo:400:kworker.0 00000100:00100000:1.0:1789117941.613569:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117941.613611:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a868192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593258880:0@lo:8:kworker.0 00000100:00100000:1.0:1789117941.613666:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117941.613723:0:19312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593258752 00000100:00100000:1.0:1789117941.613731:0:19312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593258752 00000100:00100000:1.0:1789117941.613784:0:19312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593258496 00000100:00100000:1.0:1789117941.613788:0:19312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593258496 00000100:00100000:1.0:1789117941.613797:0:19312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593258880 00000100:00100000:1.0:1789117941.613799:0:19312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593258880 00000100:00100000:1.0:1789117941.613824:0:19312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789117941.613832:0:19312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf777840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593258752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117941.613880:0:19312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf777840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593258752:12345-0@lo:400:kworker.0 Request processed in 49us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117941.613888:0:19312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789117941.613903:0:19312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789117941.613908:0:19312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876025593258496:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789117941.613943:0:19312:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789117941.613979:0:19312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876025593258496:12345-0@lo:8:kworker.0 Request processed in 69us (413us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789117941.613986:0:19312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789117941.613998:0:19312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789117941.614001:0:19312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86818780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876025593258880:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789117941.614011:0:19312:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789117941.614034:0:19312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86818780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876025593258880:12345-0@lo:8:kworker.0 Request processed in 31us (368us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789117941.614039:0:19312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1789117941.614103:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b853e0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789117941.614110:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789117941.614114:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593258496:0@lo:8:kworker.0 00000100:00080000:1.0:1789117941.614124:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bc1a36800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789117941.614128:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789117941.614139:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a868192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593258880:0@lo:8:kworker.0 00000100:00080000:2.0:1789117941.614340:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789117941.614375:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593258752:0@lo:400:kworker.0 00010000:00010000:2.0:1789117941.743844:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789117941.975906:0:19781:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789117941.976164:0:19781:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789117942.759768:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789117942.825938:0:18556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789117943.782154:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117944.680268:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789117944.680309:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593259392:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789117944.680398:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117944.681429:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593259392 00000100:00100000:0.0:1789117944.681441:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593259392 00000100:00100000:0.0:1789117944.681515:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789117944.681527:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593259392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789117944.681563:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789117944.681633:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593259392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117944.681642:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789117944.681744:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789117944.681798:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593259392:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789117944.812246:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789117945.259238:0:17834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789117945.836324:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117946.213457:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789117946.213480:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88625e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593259648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789117946.213553:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117946.213629:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593259648 00000100:00100000:3.0:1789117946.213637:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593259648 00000100:00100000:1.0:1789117946.213641:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593259520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789117946.213701:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789117946.213716:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88624b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593259648:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117946.213727:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1789117946.213852:0:17803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789117946.213911:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88624b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593259648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 200us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117946.213918:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789117946.213941:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593259520 00000100:00100000:3.0:1789117946.213945:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593259520 00000100:00100000:3.0:1789117946.213960:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789117946.213966:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86818f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593259520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789117946.213985:0:17803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789117946.214233:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86818f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593259520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 264us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117946.214261:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789117946.214324:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88625e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593259648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117946.214580:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593259520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789117946.725314:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789117946.725350:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593259776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117946.725447:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117946.725547:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593259776 00000100:00100000:2.0:1789117946.725558:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593259776 00000100:00100000:2.0:1789117946.725659:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789117946.725672:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593259776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789117946.725715:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789117946.725799:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593259776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117946.725808:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789117946.725890:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593259776:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789117946.726357:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117946.726363:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789117946.726369:0:37:0:(import.c:65:import_set_state_nolock()) ffff962b853e0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789117946.726375:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 593 00000100:00080000:1.0:1789117946.726380:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789117946.726386:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff962b853e0000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789117946.726414:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a868183c0 x1876025593260160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789117946.726456:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117946.726459:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789117946.726461:0:37:0:(import.c:65:import_set_state_nolock()) ffff962bc1a36800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789117946.726465:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 593 00000100:00080000:1.0:1789117946.726468:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789117946.726472:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff962bc1a36800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789117946.726485:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bc1a761c0 x1876025593260672/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789117946.726535:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593259904:0@lo:400:kworker.0 00000100:00100000:1.0:1789117946.726630:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117946.726684:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593260544:0@lo:400:kworker.0 00000100:00100000:1.0:1789117946.726717:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117946.726747:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789117946.726754:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593260032:0@lo:400:kworker.0 00000100:00100000:1.0:1789117946.726785:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117946.726809:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593260800:0@lo:400:kworker.0 00000100:00100000:1.0:1789117946.726852:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117946.726889:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a868183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593260160:0@lo:8:kworker.0 00000100:00100000:1.0:1789117946.726922:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117946.726944:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593260672:0@lo:8:kworker.0 00000100:00100000:1.0:1789117946.726967:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117946.727017:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593259904 00000100:00100000:1.0:1789117946.727025:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593259904 00000100:00100000:1.0:1789117946.727104:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789117946.727116:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+21:3646:x1876025593259904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117946.727169:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+21:3646:x1876025593259904:12345-0@lo:400:kworker.0 Request processed in 57us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117946.727214:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789117946.727258:0:19312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593260544 00000100:00100000:1.0:1789117946.727263:0:19312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593260544 00000100:00100000:1.0:1789117946.727293:0:19312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593260160 00000100:00100000:1.0:1789117946.727297:0:19312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593260160 00000100:00100000:1.0:1789117946.727314:0:19312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593260672 00000100:00100000:1.0:1789117946.727317:0:19312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593260672 00000100:00100000:1.0:1789117946.727329:0:19312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789117946.727335:0:19312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593260544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117946.727382:0:19312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593260544:12345-0@lo:400:kworker.0 Request processed in 46us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117946.727389:0:19312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789117946.727400:0:19312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789117946.727403:0:19312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876025593260160:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789117946.727429:0:19312:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789117946.730020:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a868192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593260416:0@lo:400:kworker.0 00000100:00100000:3.0:1789117946.730163:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117946.730211:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593261056:0@lo:400:kworker.0 00000100:00100000:3.0:1789117946.730237:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117946.730263:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789117946.730270:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593260288:0@lo:400:kworker.0 00000100:00100000:3.0:1789117946.730289:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117946.730301:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593260928:0@lo:400:kworker.0 00000100:00100000:3.0:1789117946.730324:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117946.730357:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593260032 00000100:00100000:3.0:1789117946.730365:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593260032 00000100:00100000:3.0:1789117946.730529:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593260416 00000100:00100000:3.0:1789117946.730533:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593260416 00000100:00100000:3.0:1789117946.730553:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789117946.730562:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593260032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117946.730626:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593260032:12345-0@lo:400:kworker.0 Request processed in 64us (3840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117946.730633:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789117946.730652:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789117946.730657:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88626d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593260416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117946.730685:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88626d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593260416:12345-0@lo:400:kworker.0 Request processed in 28us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117946.730691:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789117946.730755:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a868192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593260416:0@lo:400:kworker.0 00000100:00100000:2.0:1789117946.731101:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593260800 00000100:00100000:2.0:1789117946.731106:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593260800 00000100:00100000:2.0:1789117946.731156:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593261056 00000100:00100000:2.0:1789117946.731159:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593261056 00000100:00100000:2.0:1789117946.731177:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593260288 00000100:00100000:2.0:1789117946.731179:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593260288 00000100:00100000:2.0:1789117946.731189:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593260928 00000100:00100000:2.0:1789117946.731191:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593260928 00000100:00100000:2.0:1789117946.731205:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789117946.731213:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593260800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117946.731270:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593260800:12345-0@lo:400:kworker.0 Request processed in 59us (4417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117946.731276:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789117946.731289:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789117946.731295:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88625a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593261056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117946.731330:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88625a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593261056:12345-0@lo:400:kworker.0 Request processed in 35us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117946.731336:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789117946.731347:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789117946.731353:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593260288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117946.731381:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593260288:12345-0@lo:400:kworker.0 Request processed in 29us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117946.731398:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789117946.731410:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789117946.731415:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593260928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117946.731445:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593260928:12345-0@lo:400:kworker.0 Request processed in 30us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117946.731451:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1789117946.731512:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a8681ad00 x1876025593260288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117946.731534:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593260288:0@lo:400:kworker.0 00010000:00080000:2.0:1789117946.731549:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bc1a77c00 x1876025593260928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117946.731560:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593260928:0@lo:400:kworker.0 00010000:00080000:2.0:1789117946.731572:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bc1a752c0 x1876025593261056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117946.731582:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593261056:0@lo:400:kworker.0 00000100:00080000:0.0:1789117946.731860:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789117946.731867:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789117946.731871:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117946.734380:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593260032:0@lo:400:kworker.0 00010000:00080000:0.0:1789117946.734420:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bc1a77480 x1876025593260800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117946.734434:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593260800:0@lo:400:kworker.0 00000100:00100000:0.0:1789117946.734448:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593259904:0@lo:400:kworker.0 00000100:00100000:0.0:1789117946.734478:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593260544:0@lo:400:kworker.0 00000100:00100000:0.0:1789117946.764268:0:19312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876025593260160:12345-0@lo:8:kworker.0 Request processed in 36847us (37331us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789117946.764289:0:19312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789117946.764338:0:19312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789117946.764347:0:19312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876025593260672:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789117946.764379:0:19312:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789117946.764410:0:19312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876025593260672:12345-0@lo:8:kworker.0 Request processed in 63us (37442us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789117946.764416:0:19312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1789117946.764953:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b853e0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789117946.764963:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789117946.764970:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a868183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593260160:0@lo:8:kworker.0 00000100:00080000:1.0:1789117946.765152:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bc1a36800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789117946.765158:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789117946.765162:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593260672:0@lo:8:kworker.0 00010000:00010000:1.0:1789117946.862669:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117947.878275:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117948.902870:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117949.797224:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789117949.797255:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593261184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789117949.797334:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117949.797485:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593261184 00000100:00100000:2.0:1789117949.797495:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593261184 00000100:00100000:2.0:1789117949.797566:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789117949.797577:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593261184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789117949.797617:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789117949.797675:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593261184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117949.797696:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789117949.797747:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593261184:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789117949.797837:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789117949.943709:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117950.950478:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789117951.104461:0:20126:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789117951.104466:0:20126:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789117951.104467:0:20126:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789117951.104584:0:20126:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff962a87e28800 00000020:01000004:3.0:1789117951.104602:0:20126:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789117951.104616:0:20126:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789117951.104630:0:20126:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff962b8ee0ced8) 00000020:00000080:3.0:1789117951.104647:0:20126:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789117951.260303:0:20126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789117951.262704:0:20126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789117951.263711:0:20126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789117951.264178:0:20126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789117951.264537:0:20126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789117951.264731:0:20126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1789117951.268420:0:20126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:2.0:1789117951.280348:0:20126:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789117951.280673:0:20126:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789117951.280694:0:20126:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789117951.280713:0:20126:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xaa253ed19be20e7a 00000020:01000004:2.0:1789117951.280723:0:20126:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789117951.280773:0:20126:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.130@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789117951.280778:0:20126:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789117951.280802:0:20126:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789117951.280848:0:20126:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789117951.280854:0:20126:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.130@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789117951.320638:0:20126:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789117951.320710:0:20126:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.130@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789117951.320715:0:20126:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789117951.320717:0:20126:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789117951.320719:0:20126:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789117951.320720:0:20126:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789117951.320721:0:20126:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789117951.320723:0:20126:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789117951.320725:0:20126:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789117951.320727:0:20126:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789117951.320728:0:20126:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789117951.320734:0:20126:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789117951.320736:0:20126:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789117951.320755:0:20126:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789117951.320756:0:20126:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789117951.320757:0:20126:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789117951.320758:0:20126:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789117951.320759:0:20126:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789117951.320760:0:20126:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789117951.320761:0:20126:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789117951.320762:0:20126:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789117951.320803:0:20126:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789117951.320835:0:20126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593261312:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789117951.322027:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117951.322124:0:20126:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c646c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117951.322613:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593261312 00000100:00100000:2.0:1789117951.322629:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593261312 00000100:00100000:2.0:1789117951.322723:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789117951.322737:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+21:20126:x1876025593261312:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789117951.322814:0:17791:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789117951.322818:0:17791:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789117951.322826:0:17791:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789117951.323868:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+21:20126:x1876025593261312:12345-0@lo:253:mount.lustre.0 Request processed in 1124us (1838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117951.323947:0:20126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593261312:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789117951.323995:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 10000000:01000000:1.0:1789117951.324098:0:20126:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789117951.324103:0:20126:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789117951.324105:0:20126:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789117951.324106:0:20126:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789117951.324108:0:20126:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789117951.324109:0:20126:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789117951.324112:0:20126:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789117951.324114:0:20126:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789117951.324117:0:20126:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789117951.324119:0:20126:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789117951.324156:0:20126:0:(tgt_mount.c:101:server_register_mount()) register mount ffff962a87e28800 from lustre-OST0001 10000000:01000000:1.0:1789117951.324271:0:20126:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789117951.324276:0:20126:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789117951.324292:0:20126:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff962bbfacced8 local copy 00010000:00010000:1.0:1789117951.324309:0:20126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be20ac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20ad0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117951.324655:0:20126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593261440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117951.324710:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117951.324772:0:20126:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a88434c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789117951.324817:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593261440 00000100:00100000:0.0:1789117951.324827:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593261440 00000100:00100000:1.0:1789117951.324927:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789117951.324947:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+21:20126:x1876025593261440:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117951.325278:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+21:20126:x1876025593261440:12345-0@lo:501:mount.lustre.0 Request processed in 332us (565us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789117951.325287:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789117951.325393:0:20126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593261440:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789117951.325412:0:20126:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789117951.325440:0:20126:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789117951.325449:0:20126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be20ac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20ad0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.325460:0:20126:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be20ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20ad0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117951.325505:0:20126:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff962a87e28800 10000000:01000000:2.0:1789117951.325511:0:20126:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789117951.325517:0:20126:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789117951.325520:0:20126:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789117951.325525:0:20126:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789117951.325528:0:20126:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789117951.325573:0:20126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be20e81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.325581:0:20126:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be20e81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.325591:0:20126:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be20e81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117951.325608:0:20126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593261568:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789117951.325646:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117951.325684:0:20126:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84c5d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117951.325836:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593261568 00000100:00100000:0.0:1789117951.325842:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593261568 00000100:00100000:2.0:1789117951.325931:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789117951.325942:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+21:20126:x1876025593261568:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789117951.325955:0:17790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117951.326468:0:17790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d93400/0xaa253ed19be20e88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20e81 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.326507:0:17790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d93400/0xaa253ed19be20e88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20e81 expref: 22 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.326521:0:17790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d93400/0xaa253ed19be20e88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20e81 expref: 22 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.326533:0:17790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93400, rc 0) 00000100:00100000:2.0:1789117951.326645:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+22:20126:x1876025593261568:12345-0@lo:101:mount.lustre.0 Request processed in 704us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117951.326654:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789117951.334304:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117951.334347:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a886252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593261696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789117951.334453:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117951.335101:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593261696 00000100:00100000:1.0:1789117951.335162:0:20126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593261568:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789117951.335275:0:20126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be20e81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20e88 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117951.335289:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1789117951.335296:0:20126:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be20e81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20e88 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117951.335316:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593261824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789117951.335373:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117951.335524:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593261696 00000100:00100000:0.0:1789117951.335611:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593261824 00000100:00100000:0.0:1789117951.335615:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593261824 00000100:00100000:0.0:1789117951.335639:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789117951.335653:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88627c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593261696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789117951.335712:0:17804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789117951.335856:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789117951.335865:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593261824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789117951.335921:0:18751:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789117951.335978:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593261824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117951.335988:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789117951.336863:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88627c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593261696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1207us (2404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117951.336940:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789117951.337150:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593261824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789117951.337326:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a886252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593261696:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1789117951.345542:0:20126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789117951.348554:0:20126:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789117951.349803:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789117951.349929:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789117951.349947:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789117951.349974:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789117951.349996:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789117951.350015:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789117951.350042:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789117951.350049:0:20126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789117951.350579:0:20126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88626940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593261952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789117951.350684:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117951.350765:0:20126:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b831ecb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789117951.356155:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593261952 00000100:00100000:1.0:1789117951.356182:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593261952 00000100:00100000:1.0:1789117951.356299:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789117951.356314:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+22:20126:x1876025593261952:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117951.356676:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+22:20126:x1876025593261952:12345-0@lo:501:mount.lustre.0 Request processed in 363us (5990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117951.356688:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789117951.357128:0:20126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88626940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593261952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789117951.357236:0:20126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88626940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593262080:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789117951.357335:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117951.357403:0:20126:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b831ecb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789117951.357546:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593262080 00000100:00100000:2.0:1789117951.357554:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593262080 00000100:00100000:2.0:1789117951.357605:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789117951.357617:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+22:20126:x1876025593262080:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789117951.359369:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+22:20126:x1876025593262080:12345-0@lo:503:mount.lustre.0 Request processed in 1740us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117951.359391:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789117951.359707:0:20126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88626940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593262080:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789117951.360588:0:20126:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789117951.360712:0:20126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88626940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593262208:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789117951.363444:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117951.363520:0:20126:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b831eca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789117951.363616:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593262208 00000100:00100000:1.0:1789117951.363630:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593262208 00000100:00100000:1.0:1789117951.363710:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789117951.363721:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+22:20126:x1876025593262208:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789117951.364565:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+22:20126:x1876025593262208:12345-0@lo:502:mount.lustre.0 Request processed in 841us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117951.364577:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789117951.364749:0:20126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88626940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593262208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789117951.365140:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789117951.365178:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789117951.365393:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789117951.365410:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789117951.365425:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789117951.365439:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789117951.365453:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789117951.365466:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789117951.365480:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789117951.365553:0:20126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88626940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593262336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789117951.365630:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117951.365672:0:20126:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b831eca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789117951.365904:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593262336 00000100:00100000:1.0:1789117951.365912:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593262336 00000100:00100000:1.0:1789117951.365987:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789117951.365999:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+22:20126:x1876025593262336:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789117951.366167:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+22:20126:x1876025593262336:12345-0@lo:502:mount.lustre.0 Request processed in 170us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117951.366175:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789117951.366587:0:20126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88626940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593262336:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789117951.366709:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789117951.366723:0:20126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1789117951.373476:0:20130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789117951.373492:0:20130:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1789117951.373501:0:20130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117951.373504:0:20130:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789117951.373513:0:20130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789117951.373564:0:20130:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff962a88d18000) 00000020:00000080:3.0:1789117951.373603:0:20130:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789117951.373609:0:20130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789117951.373716:0:20130:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962a87e28800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789117951.373726:0:20130:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789117951.373733:0:20130:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xaa253ed19be20e96 00010000:00010000:2.0:1789117951.404433:0:20130:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1789117951.405802:0:20130:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1789117951.412915:0:20130:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1789117951.419495:0:20130:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789117951.419519:0:20130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117951.419530:0:20130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117951.419533:0:20130:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789117951.419540:0:20130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117951.419545:0:20130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117951.419547:0:20130:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789117951.419552:0:20130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789117951.419555:0:20130:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789117951.419558:0:20130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117951.419561:0:20130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117951.419563:0:20130:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789117951.419566:0:20130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117951.419569:0:20130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117951.419570:0:20130:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789117951.419574:0:20130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789117951.419620:0:20130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117951.419624:0:20130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117951.419625:0:20130:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789117951.419629:0:20130:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1789117951.420019:0:20126:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1789117951.420109:0:20126:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789117951.420142:0:20126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be20e81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20e88 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117951.420160:0:20126:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be20e81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20e88 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117951.420172:0:20126:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962a87e28800 from 1 10000000:01000000:1.0:1789117951.420185:0:20126:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789117951.420262:0:20126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be20e9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117951.420272:0:20126:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be20e9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117951.420288:0:20126:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be20e9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117951.420331:0:20126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593262464:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789117951.420445:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117951.420513:0:20126:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d78240 going to sleep for 11 seconds 00000100:00100000:3.0:1789117951.420793:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593262464 00000100:00100000:3.0:1789117951.420807:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593262464 00000100:00100000:3.0:1789117951.420894:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789117951.420908:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+22:20126:x1876025593262464:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789117951.420929:0:17790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117951.420950:0:17790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a88d9b000/0xaa253ed19be20ea4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20e9d expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117951.423763:0:17790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a88d9b000/0xaa253ed19be20ea4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20e9d expref: 23 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117951.423815:0:17790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a88d9b000/0xaa253ed19be20ea4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20e9d expref: 23 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117951.423829:0:17790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a88d9b000, rc 0) 00000100:00100000:3.0:1789117951.427420:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+23:20126:x1876025593262464:12345-0@lo:101:mount.lustre.0 Request processed in 6497us (6958us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117951.427437:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789117951.431799:0:20126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593262464:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789117951.431848:0:20126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be20e9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20ea4 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117951.431867:0:20126:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be20e9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20ea4 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789117951.436042:0:20126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789117951.439146:0:20126:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789117951.439493:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789117951.439526:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789117951.439547:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789117951.439555:0:20126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789117951.439700:0:20126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593262592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789117951.439814:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117951.439881:0:20126:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86fe96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117951.440749:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593262592 00000100:00100000:2.0:1789117951.440761:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593262592 00000100:00100000:2.0:1789117951.440836:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789117951.440848:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+23:20126:x1876025593262592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789117951.441089:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+23:20126:x1876025593262592:12345-0@lo:501:mount.lustre.0 Request processed in 240us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117951.441115:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789117951.444713:0:20126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593262592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789117951.444846:0:20126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593262720:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789117951.445023:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117951.445111:0:20126:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86fe96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117951.448233:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593262720 00000100:00100000:2.0:1789117951.448257:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593262720 00000100:00100000:2.0:1789117951.448358:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789117951.448375:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+23:20126:x1876025593262720:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789117951.448689:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+23:20126:x1876025593262720:12345-0@lo:503:mount.lustre.0 Request processed in 318us (3667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117951.448698:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789117951.449169:0:20126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593262720:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789117951.450451:0:20126:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789117951.450624:0:20126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593262848:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789117951.450761:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117951.450817:0:20126:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b9838f240 going to sleep for 11 seconds 00000100:00100000:2.0:1789117951.451781:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593262848 00000100:00100000:2.0:1789117951.451794:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593262848 00000100:00100000:2.0:1789117951.451872:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789117951.451884:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+23:20126:x1876025593262848:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789117951.452195:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+23:20126:x1876025593262848:12345-0@lo:502:mount.lustre.0 Request processed in 311us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117951.452204:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789117951.452876:0:20126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593262848:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789117951.453472:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789117951.453528:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789117951.453545:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789117951.453560:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789117951.453573:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789117951.453587:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789117951.453597:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789117951.453609:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:0.0:1789117951.453621:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:0.0:1789117951.453633:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:0.0:1789117951.453645:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 144 off10272 00000040:00080000:0.0:1789117951.453659:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10496 00000040:00080000:0.0:1789117951.453673:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10720 00000040:00080000:0.0:1789117951.453686:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 128 off10848 00000040:00080000:0.0:1789117951.453699:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off11072 00000040:00080000:0.0:1789117951.453713:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11296 00000040:00080000:0.0:1789117951.453727:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 128 off11424 00000100:00100000:0.0:1789117951.453795:0:20126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593262976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789117951.453891:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117951.453930:0:20126:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d78240 going to sleep for 11 seconds 00000100:00100000:2.0:1789117951.454192:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593262976 00000100:00100000:2.0:1789117951.454201:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593262976 00000100:00100000:2.0:1789117951.454465:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789117951.454480:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+23:20126:x1876025593262976:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789117951.454682:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+23:20126:x1876025593262976:12345-0@lo:502:mount.lustre.0 Request processed in 204us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117951.454690:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789117951.454907:0:20126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593262976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789117951.455547:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11648 00000040:00080000:0.0:1789117951.455570:0:20126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:3.0:1789117951.457510:0:20134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117951.457528:0:20134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117951.457531:0:20134:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789117951.457539:0:20134:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962a87e28800 00000020:00000080:3.0:1789117951.457542:0:20134:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789117951.457552:0:20134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117951.457554:0:20134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117951.457556:0:20134:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789117951.457558:0:20134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117951.457561:0:20134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117951.457562:0:20134:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789117951.457566:0:20134:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962a87e28800 00000020:00000080:3.0:1789117951.457568:0:20134:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789117951.457688:0:20134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117951.457692:0:20134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117951.457694:0:20134:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789117951.457696:0:20134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117951.457699:0:20134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117951.457700:0:20134:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789117951.457704:0:20134:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962a87e28800 00000020:00000080:3.0:1789117951.457706:0:20134:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789117951.459437:0:20134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117951.459453:0:20134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117951.459463:0:20134:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789117951.459469:0:20134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117951.459474:0:20134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117951.459476:0:20134:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789117951.459481:0:20134:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962a87e28800 00000020:00000080:3.0:1789117951.459484:0:20134:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789117951.459529:0:20134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117951.459532:0:20134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117951.459533:0:20134:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789117951.459536:0:20134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117951.459539:0:20134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117951.459540:0:20134:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789117951.459543:0:20134:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962a87e28800 00000020:00000080:3.0:1789117951.459546:0:20134:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789117951.459561:0:20134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117951.459563:0:20134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117951.459565:0:20134:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789117951.459567:0:20134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117951.459569:0:20134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117951.459571:0:20134:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789117951.459575:0:20134:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962a87e28800 00000020:00000080:3.0:1789117951.459577:0:20134:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789117951.459623:0:20134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117951.459627:0:20134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117951.459629:0:20134:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789117951.459633:0:20134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 19 count 19 00000020:01000000:0.0:1789117951.461490:0:20126:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:0.0:1789117951.461561:0:20126:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789117951.461597:0:20126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be20e9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20ea4 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117951.461614:0:20126:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be20e9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20ea4 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117951.461749:0:20126:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789117951.461752:0:20126:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff962a87e28800 10000000:01000000:0.0:1789117951.461756:0:20126:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff962a87e28800 10000000:01000000:0.0:1789117951.461763:0:20126:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789117951.461771:0:20126:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962a87e28800 from 1 10000000:01000000:0.0:1789117951.461774:0:20126:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789117951.461828:0:20126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9a800/0xaa253ed19be20eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117951.461837:0:20126:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962baea9a800/0xaa253ed19be20eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117951.461878:0:20126:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962baea9a800/0xaa253ed19be20eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117951.461920:0:20126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593263104:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789117951.462016:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117951.462085:0:20126:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a88434780 going to sleep for 11 seconds 00000100:00100000:2.0:1789117951.462430:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593263104 00000100:00100000:2.0:1789117951.462441:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593263104 00000100:00100000:2.0:1789117951.462513:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789117951.462525:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+23:20126:x1876025593263104:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789117951.462562:0:17791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117951.462580:0:17791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d93e00/0xaa253ed19be20eb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20eab expref: -99 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.462613:0:17791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d93e00/0xaa253ed19be20eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20eab expref: 24 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.462626:0:17791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d93e00/0xaa253ed19be20eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20eab expref: 24 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.462637:0:17791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93e00, rc 0) 00000100:00100000:2.0:1789117951.462814:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+24:20126:x1876025593263104:12345-0@lo:101:mount.lustre.0 Request processed in 290us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117951.462822:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789117951.467652:0:20126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593263104:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789117951.467709:0:20126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962baea9a800/0xaa253ed19be20eab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20eb2 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117951.467726:0:20126:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962baea9a800/0xaa253ed19be20eab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20eb2 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789117951.473675:0:20126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1789117951.476470:0:20126:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789117951.476884:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789117951.476914:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789117951.476927:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789117951.476940:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789117951.476953:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789117951.476967:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789117951.476980:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789117951.476994:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789117951.477008:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789117951.477044:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789117951.477087:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789117951.477102:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789117951.477114:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789117951.477501:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789117951.477518:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789117951.477534:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789117951.477549:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789117951.477562:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789117951.477576:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789117951.477593:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789117951.477610:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789117951.477626:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789117951.477640:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789117951.477675:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789117951.477693:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1789117951.477729:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1789117951.477760:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1789117951.477775:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1789117951.477792:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1789117951.477806:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1789117951.477820:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1789117951.477834:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1789117951.477848:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1789117951.477862:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1789117951.477876:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1789117951.477891:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1789117951.477904:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1789117951.477917:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1789117951.477930:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1789117951.477945:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1789117951.477959:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1789117951.478003:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1789117951.478021:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1789117951.478033:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1789117951.478047:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1789117951.478103:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1789117951.479409:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1789117951.479433:0:20126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1789117951.479608:0:20126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593263232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117951.479723:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117951.479807:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593263232 00000100:00100000:1.0:1789117951.479817:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593263232 00000100:00100000:1.0:1789117951.479895:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789117951.479907:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+24:20126:x1876025593263232:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117951.480992:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+24:20126:x1876025593263232:12345-0@lo:501:mount.lustre.0 Request processed in 1078us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117951.481004:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789117951.481093:0:20126:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b88605300 going to sleep for 11 seconds 00000100:00100000:1.0:1789117951.481133:0:20126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593263232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117951.481205:0:20126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593263360:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789117951.481453:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117951.481483:0:20126:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b88605300 going to sleep for 11 seconds 00000100:00100000:2.0:1789117951.481609:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593263360 00000100:00100000:2.0:1789117951.481618:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593263360 00000100:00100000:2.0:1789117951.481675:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789117951.481687:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+24:20126:x1876025593263360:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789117951.481836:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+24:20126:x1876025593263360:12345-0@lo:503:mount.lustre.0 Request processed in 151us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117951.481844:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789117951.481936:0:20126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593263360:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789117951.483039:0:20126:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789117951.483449:0:20126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593263488:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789117951.483552:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117951.483684:0:20126:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b88605300 going to sleep for 11 seconds 00000100:00100000:2.0:1789117951.490440:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593263488 00000100:00100000:2.0:1789117951.490471:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593263488 00000100:00100000:3.0:1789117951.494588:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789117951.494608:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+24:20126:x1876025593263488:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789117951.494863:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+24:20126:x1876025593263488:12345-0@lo:502:mount.lustre.0 Request processed in 259us (11311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117951.494872:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789117951.495026:0:20126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593263488:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789117951.495700:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789117951.495755:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789117951.495773:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789117951.495788:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789117951.495801:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789117951.495836:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789117951.495850:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789117951.495861:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789117951.495873:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789117951.495887:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789117951.495900:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789117951.495913:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789117951.495937:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789117951.495952:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789117951.496019:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789117951.496036:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789117951.496048:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789117951.496334:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789117951.496348:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789117951.496360:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789117951.496371:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789117951.496399:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789117951.496413:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789117951.496426:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789117951.496438:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1789117951.496449:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1789117951.496462:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1789117951.496473:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1789117951.496485:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1789117951.496498:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1789117951.496510:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1789117951.496520:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1789117951.496536:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1789117951.496549:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1789117951.496561:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1789117951.496574:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1789117951.496586:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1789117951.496613:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1789117951.496631:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1789117951.496645:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1789117951.496657:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1789117951.496670:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1789117951.496682:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1789117951.496696:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1789117951.496709:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1789117951.496731:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1789117951.501008:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1789117951.501072:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1789117951.501169:0:20126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593263616:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789117951.502542:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117951.502605:0:20126:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b88605300 going to sleep for 11 seconds 00000100:00100000:2.0:1789117951.505983:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593263616 00000100:00100000:2.0:1789117951.506007:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593263616 00000100:00100000:2.0:1789117951.506169:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789117951.506457:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+24:20126:x1876025593263616:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789117951.506764:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+24:20126:x1876025593263616:12345-0@lo:502:mount.lustre.0 Request processed in 583us (4226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117951.506782:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789117951.507475:0:20126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593263616:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789117951.507812:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1789117951.507846:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1789117951.507898:0:20126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593263744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789117951.507974:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117951.508024:0:20126:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b88605300 going to sleep for 11 seconds 00000100:00100000:1.0:1789117951.508084:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593263744 00000100:00100000:1.0:1789117951.508093:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593263744 00000100:00100000:1.0:1789117951.508144:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789117951.508154:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+24:20126:x1876025593263744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789117951.510517:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+24:20126:x1876025593263744:12345-0@lo:502:mount.lustre.0 Request processed in 2346us (2525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117951.510538:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789117951.510945:0:20126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593263744:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789117951.511145:0:20126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1789117951.511169:0:20126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789117951.514277:0:20139:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789117951.514304:0:20139:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff962b88028000) 00000020:00000080:1.0:1789117951.514340:0:20139:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1789117951.514469:0:20139:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962a87e28800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789117951.514475:0:20139:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962a87e28800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789117951.514480:0:20139:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962a87e28800 3 00010000:00080000:1.0:1789117951.514535:0:20139:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962a81e47000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.130@tcp at head 00010000:00010000:1.0:1789117951.516654:0:20139:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1789117951.525546:0:20139:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789117951.525648:0:20139:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789117951.525666:0:20139:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xaa253ed19be20ec0 00000100:00080000:1.0:1789117951.525681:0:20139:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789117951.525689:0:20139:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff962a81e47000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789117951.525764:0:20139:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87f47c00 x1876025593263872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789117951.525812:0:20139:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789117951.526016:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876025593263872:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789117951.526166:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789117951.530404:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789117951.530413:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789117951.530418:0:37:0:(import.c:65:import_set_state_nolock()) ffff962b853e0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789117951.530429:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 599 00000100:00080000:2.0:1789117951.530435:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789117951.530443:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff962b853e0000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789117951.530480:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbfd16580 x1876025593264128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789117951.530529:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789117951.530534:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789117951.530536:0:37:0:(import.c:65:import_set_state_nolock()) ffff962bc1a36800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789117951.530540:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 599 00000100:00080000:2.0:1789117951.530542:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789117951.530546:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff962bc1a36800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789117951.530558:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbfd170c0 x1876025593264512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789117951.530812:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593263872 00000100:00100000:2.0:1789117951.530825:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593263872 00000100:00100000:2.0:1789117951.530880:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789117951.530890:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0718780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876025593263872:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789117951.530934:0:17798:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 603 last 0 00000020:00000080:2.0:1789117951.530988:0:17798:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xaa253ed19be20ec7 00000004:00100000:2.0:1789117951.531018:0:17798:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789117951.531109:0:17798:0:(import.c:65:import_set_state_nolock()) ffff962a86ccb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789117951.531231:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0718780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876025593263872:12345-0@lo:38:llog_process_th.0 Request processed in 341us (5064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117951.531240:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789117951.531277:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593264000:0@lo:400:kworker.0 00000100:00100000:2.0:1789117951.531329:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117951.531362:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593264768:0@lo:400:kworker.0 00000100:00100000:2.0:1789117951.531387:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117951.531413:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000020:01000004:1.0:1789117951.532210:0:20139:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789117951.532244:0:20139:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff962b8802b490) 00000020:00000080:1.0:1789117951.532273:0:20139:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1789117951.532406:0:20139:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962a87e28800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789117951.532411:0:20139:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962a87e28800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789117951.532414:0:20139:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962a87e28800 3 00010000:00080000:1.0:1789117951.532460:0:20139:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962a81e45800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.130@tcp at head 00010000:00010000:1.0:1789117951.534463:0:20139:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000100:00100000:2.0:1789117951.535324:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593264640:0@lo:400:kworker.0 00000100:00100000:2.0:1789117951.535374:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593264256:0@lo:400:kworker.0 00000100:00100000:2.0:1789117951.535534:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117951.535590:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593264896:0@lo:400:kworker.0 00000100:00100000:2.0:1789117951.535616:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117951.535637:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789117951.535644:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593264384:0@lo:400:kworker.0 00000100:00100000:2.0:1789117951.535674:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117951.536441:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593264768 00000100:00100000:2.0:1789117951.536518:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593264768 00000100:00100000:2.0:1789117951.536834:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593264256 00000100:00100000:2.0:1789117951.536852:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593264256 00000100:00100000:2.0:1789117951.536879:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593264896 00000100:00100000:2.0:1789117951.536882:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593264896 00000100:00100000:0.0:1789117951.536981:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593264000 00000100:00100000:0.0:1789117951.536990:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593264000 00000100:00100000:0.0:1789117951.537038:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593264384 00000100:00100000:0.0:1789117951.537042:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593264384 00000100:00100000:0.0:1789117951.537087:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789117951.537099:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593264000:12345-0@lo:400:kworker.0 00000020:00000080:1.0:1789117951.537405:0:20139:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1789117951.537573:0:20139:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789117951.537590:0:20139:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xaa253ed19be20ed5 00000100:00080000:1.0:1789117951.537601:0:20139:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789117951.537608:0:20139:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff962a81e45800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1789117951.537784:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593264000:12345-0@lo:400:kworker.0 Request processed in 686us (6453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117951.537794:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789117951.537823:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789117951.537834:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88564f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593264384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117951.537899:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88564f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593264384:12345-0@lo:400:kworker.0 Request processed in 69us (2224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117951.537906:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789117951.537930:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789117951.537935:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117951.537989:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593264384:0@lo:400:kworker.0 00000100:00100000:1.0:1789117951.538151:0:20139:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a8680b480 x1876025593265024/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789117951.538174:0:20139:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789117951.539143:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789117951.539161:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593264768:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789117951.539189:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789117951.539279:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593264768:12345-0@lo:400:kworker.0 Request processed in 124us (7888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117951.539287:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789117951.539308:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789117951.539315:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88567840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593264256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117951.539376:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88567840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593264256:12345-0@lo:400:kworker.0 Request processed in 60us (3841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117951.539383:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789117951.539398:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789117951.539407:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88564780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593264896:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789117951.539609:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbfd17480 x1876025593264256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117951.539629:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593264256:0@lo:400:kworker.0 00000100:00100000:2.0:1789117951.540380:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88564780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593264896:12345-0@lo:400:kworker.0 Request processed in 968us (4755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117951.540400:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789117951.540421:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593264128:0@lo:8:kworker.0 00000100:00100000:3.0:1789117951.540515:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117951.540561:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593264512:0@lo:8:kworker.0 00000100:00100000:3.0:1789117951.540591:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117951.540616:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8680b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876025593265024:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789117951.540660:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789117951.540724:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a87f47c00 x1876025593263872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789117961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117951.540847:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789117951.540863:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789117951.540874:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789117951.540890:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789117951.540895:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a81e47000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789117951.540903:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876025593263872:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789117951.540952:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593264128 00000100:00100000:3.0:1789117951.540960:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593264128 00000100:00100000:3.0:1789117951.540994:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593264512 00000100:00100000:3.0:1789117951.540998:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593264512 00000100:00100000:3.0:1789117951.541012:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789117951.541020:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88626940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876025593264128:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789117951.541102:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bc1a77480 x1876025593264896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117951.541114:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593264896:0@lo:400:kworker.0 00000100:00100000:3.0:1789117951.541267:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88626940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876025593264128:12345-0@lo:8:kworker.0 Request processed in 245us (752us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789117951.541276:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789117951.541297:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789117951.541301:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a886261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876025593264512:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789117951.541339:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a886261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876025593264512:12345-0@lo:8:kworker.0 Request processed in 35us (746us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789117951.541353:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789117951.541383:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593265024 00000100:00100000:3.0:1789117951.541390:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593265024 00000100:00100000:3.0:1789117951.541420:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789117951.541425:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88625680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876025593265024:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789117951.541451:0:17799:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 603 last 0 00000020:00000080:3.0:1789117951.541512:0:17799:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xaa253ed19be20edc 00000004:00100000:3.0:1789117951.541535:0:17799:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789117951.541585:0:17799:0:(import.c:65:import_set_state_nolock()) ffff962a88d48000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789117951.541637:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88625680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876025593265024:12345-0@lo:38:llog_process_th.0 Request processed in 210us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117951.541644:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789117951.541680:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789117951.541685:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b853e0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789117951.541690:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789117951.541693:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593264128:0@lo:8:kworker.0 00000100:00100000:3.0:1789117951.541701:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789117951.541706:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bc1a36800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789117951.541710:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789117951.541713:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593264512:0@lo:8:kworker.0 00010000:00080000:3.0:1789117951.541725:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a8680b480 x1876025593265024/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789117961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117951.541733:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789117951.542227:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789117951.542237:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789117951.542250:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789117951.542253:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a81e45800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789117951.542261:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8680b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876025593265024:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789117951.542355:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117951.542416:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593264000:0@lo:400:kworker.0 00010000:00080000:3.0:1789117951.542435:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bc1a761c0 x1876025593264768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117951.542444:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593264768:0@lo:400:kworker.0 00000100:00100000:3.0:1789117951.542477:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593264640 00000100:00100000:3.0:1789117951.542481:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593264640 00000100:00100000:3.0:1789117951.542543:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789117951.542554:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a886252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593264640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117951.542610:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a886252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593264640:12345-0@lo:400:kworker.0 Request processed in 59us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117951.542617:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1789117951.542646:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbfd17840 x1876025593264640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117951.542656:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593264640:0@lo:400:kworker.0 00000040:00080000:3.0:1789117951.545451:0:20139:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1789117951.555227:0:20126:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789117951.555315:0:20126:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789117951.555353:0:20126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9a800/0xaa253ed19be20eab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20eb2 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117951.555370:0:20126:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962baea9a800/0xaa253ed19be20eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20eb2 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789117951.555467:0:20126:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789117951.555470:0:20126:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789117951.555472:0:20126:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789117951.555474:0:20126:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789117951.555475:0:20126:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789117951.555478:0:20126:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789117951.555479:0:20126:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789117951.555482:0:20126:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789117951.555484:0:20126:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789117951.555490:0:20126:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789117951.555493:0:20126:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789117951.555495:0:20126:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789117951.555496:0:20126:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789117951.555497:0:20126:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789117951.555498:0:20126:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789117951.555499:0:20126:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789117951.555501:0:20126:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789117951.555502:0:20126:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789117951.555503:0:20126:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789117951.555545:0:20126:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789117951.555575:0:20126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88625e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593265152:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789117951.555690:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117951.556985:0:20126:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bc20f1840 going to sleep for 11 seconds 00000100:00100000:2.0:1789117951.557974:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593265152 00000100:00100000:2.0:1789117951.557993:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593265152 00000100:00100000:2.0:1789117951.558189:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789117951.558206:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+24:20126:x1876025593265152:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789117951.558246:0:17791:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789117951.558262:0:17791:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789117951.569423:0:17791:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789117951.569463:0:17791:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789117951.570416:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+24:20126:x1876025593265152:12345-0@lo:253:mount.lustre.0 Request processed in 12205us (14715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117951.570434:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789117951.570502:0:20126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88625e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf05977c-16b5-4df3-81bb-3835e509f77c:20126:1876025593265152:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789117951.570536:0:20126:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789117951.570542:0:20126:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789117951.570544:0:20126:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789117951.570546:0:20126:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789117951.570547:0:20126:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789117951.570548:0:20126:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789117951.570550:0:20126:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789117951.570552:0:20126:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789117951.570555:0:20126:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789117951.570557:0:20126:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789117951.570586:0:20126:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1789117951.573937:0:17814:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789117951.573961:0:17814:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789117951.574844:0:17814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962b813da000/0xaa253ed19be20ee3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117951.574888:0:17814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b80030000/0xaa253ed19be20d8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20d85 expref: 23 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117951.574897:0:17814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962a887f2200/0xaa253ed19be20d9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20d93 expref: 23 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117951.574905:0:17814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962b813da000/0xaa253ed19be20ee3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117951.574961:0:17814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962a887f2200/0xaa253ed19be20d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be20d93 expref: 23 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117951.575108:0:17814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962a887f2200/0xaa253ed19be20d9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be20d93 expref: 23 pid: 17791 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117951.575133:0:17814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86809e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17814:1876025593265280:0@lo:104: 00000100:00100000:1.0:1789117951.576421:0:17814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789117951.576537:0:17814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b80030000/0xaa253ed19be20d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be20d85 expref: 23 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117951.576554:0:17814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962b80030000/0xaa253ed19be20d8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be20d85 expref: 23 pid: 17790 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117951.576558:0:17781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593265280 00000100:00100000:1.0:1789117951.576571:0:17814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86808780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17814:1876025593265408:0@lo:104: 00000100:00100000:2.0:1789117951.576590:0:17781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593265280 00000100:00100000:1.0:1789117951.576609:0:17814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117951.576661:0:17781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593265408 00000100:00100000:1.0:1789117951.576662:0:17814:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b88605900 going to sleep for 11 seconds 00000100:00100000:2.0:1789117951.576668:0:17781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593265408 00000100:00100000:2.0:1789117951.576699:0:17781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789117951.576711:0:17781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf05977c-16b5-4df3-81bb-3835e509f77c+4:17814:x1876025593265280:12345-0@lo:104: 00010000:00010000:2.0:1789117951.576730:0:17781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be20d93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20d9a expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.576902:0:17781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789117951.576908:0:17781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf05977c-16b5-4df3-81bb-3835e509f77c+4:17814:x1876025593265280:12345-0@lo:104: Request processed in 201us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117951.576918:0:17781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789117951.576938:0:17781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789117951.576945:0:17781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf05977c-16b5-4df3-81bb-3835e509f77c+3:17814:x1876025593265408:12345-0@lo:104: 00010000:00010000:2.0:1789117951.576953:0:17781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962a887f2400/0xaa253ed19be20d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20d8c expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.576992:0:17781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789117951.576997:0:17781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf05977c-16b5-4df3-81bb-3835e509f77c+3:17814:x1876025593265408:12345-0@lo:104: Request processed in 54us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117951.577004:0:17781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1789117951.577022:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789117951.577028:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be20d93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20d9a expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.577527:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9b800 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:2.0:1789117951.577532:0:17787:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be20d93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be20d9a expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.577553:0:17787:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be20d93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be20d9a expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117951.577561:0:17787:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be20d93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be20d9a expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117951.577568:0:17787:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789117951.577612:0:17787:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be20d93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20d9a expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.577620:0:17787:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789117951.577649:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be20d93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20d9a expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.577657:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962baea9b800/0xaa253ed19be20d93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20d9a expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.577675:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117951.577678:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962a887f2400/0xaa253ed19be20d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20d8c expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.577684:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f2400 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:2.0:1789117951.577688:0:17787:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962a887f2400/0xaa253ed19be20d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be20d8c expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.577694:0:17787:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962a887f2400/0xaa253ed19be20d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be20d8c expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117951.577700:0:17787:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962a887f2400/0xaa253ed19be20d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be20d8c expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117951.577714:0:17787:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789117951.577730:0:17787:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962a887f2400/0xaa253ed19be20d85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20d8c expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.577747:0:17787:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789117951.578022:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962a887f2400/0xaa253ed19be20d85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20d8c expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.578030:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962a887f2400/0xaa253ed19be20d85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20d8c expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.578188:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117951.578190:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117951.578193:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117951.578286:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88565680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593265536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789117951.578347:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117951.578407:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a885670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf05977c-16b5-4df3-81bb-3835e509f77c:3644:1876025593265664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789117951.578435:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117951.578469:0:17785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593265536 00000100:00100000:2.0:1789117951.578475:0:17785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593265536 00010000:00010000:2.0:1789117951.578504:0:17785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962a887f2200/0xaa253ed19be20d9a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20d93 expref: 24 pid: 17791 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117951.578527:0:17785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593265664 00000100:00100000:2.0:1789117951.578531:0:17785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593265664 00010000:00010000:2.0:1789117951.578545:0:17785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b80030000/0xaa253ed19be20d8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20d85 expref: 25 pid: 17790 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117951.578560:0:17785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789117951.578581:0:17785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885661c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf05977c-16b5-4df3-81bb-3835e509f77c+25:3647:x1876025593265536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789117951.578598:0:17785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117951.578605:0:17785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962a887f2200/0xaa253ed19be20d9a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20d93 expref: 25 pid: 17791 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.578616:0:17785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962a887f2200/0xaa253ed19be20d9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be20d93 expref: 25 pid: 17791 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.578634:0:17785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117951.578670:0:17785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885661c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf05977c-16b5-4df3-81bb-3835e509f77c+25:3647:x1876025593265536:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117951.578677:0:17785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789117951.578696:0:17785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789117951.578703:0:17785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88565e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf05977c-16b5-4df3-81bb-3835e509f77c+24:3644:x1876025593265664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789117951.578710:0:17785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117951.578714:0:17785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b80030000/0xaa253ed19be20d8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20d85 expref: 24 pid: 17790 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.578722:0:17785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b80030000/0xaa253ed19be20d8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be20d85 expref: 24 pid: 17790 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.578747:0:17785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962b813da000/0xaa253ed19be20ee3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.578757:0:17785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813da000/0xaa253ed19be20ee3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117951.579538:0:17814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a887f2200/0xaa253ed19be20d9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be20d93 expref: 24 pid: 17791 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117951.579586:0:17814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86809e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17814:1876025593265280:0@lo:104: 00010000:00010000:1.0:1789117951.579607:0:17814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b80030000/0xaa253ed19be20d8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be20d85 expref: 23 pid: 17790 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117951.579618:0:17814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86808780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17814:1876025593265408:0@lo:104: 00010000:00010000:1.0:1789117951.579649:0:17814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962b813da000/0xaa253ed19be20ee3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117951.579661:0:17814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff962b813da000/0xaa253ed19be20ee3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117951.579669:0:17814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962b813da000/0xaa253ed19be20ee3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789117951.580172:0:17785:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015770246s 00010000:00010000:2.0:1789117951.580192:0:17785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962b813da000/0xaa253ed19be20ee3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117951.580240:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117951.580356:0:17785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962b813da000/0xaa253ed19be20ee3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.580364:0:17785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962b813da000/0xaa253ed19be20ee3 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.580372:0:17785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962b813da000/0xaa253ed19be20ee3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.580380:0:17785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813da000 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117951.580387:0:17785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962b813da000/0xaa253ed19be20ee3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.580395:0:17785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962b813da000/0xaa253ed19be20ee3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.580416:0:17785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962b813da000/0xaa253ed19be20ee3 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.580427:0:17785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813da000/0xaa253ed19be20ee3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117951.580466:0:17785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117951.580598:0:17785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88565e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf05977c-16b5-4df3-81bb-3835e509f77c+22:3644:x1876025593265664:12345-0@lo:103:ldlm_bl.0 Request processed in 1891us (2157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117951.580611:0:17785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789117951.580693:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88565680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593265536:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1789117951.581640:0:20126:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1789117951.581893:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a885670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf05977c-16b5-4df3-81bb-3835e509f77c:3644:1876025593265664:0@lo:103:ldlm_bl.0 00002000:00080000:0.0:1789117951.594979:0:20126:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789117951.594995:0:20126:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789117951.595093:0:20126:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789117951.595174:0:20126:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.130@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789117951.595545:0:20126:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1789117951.595585:0:20126:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1789117951.596847:0:20126:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789117951.597187:0:20126:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789117951.851116:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117951.851161:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a885670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593265792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117951.851512:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117951.858890:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593265792 00000100:00100000:3.0:1789117951.858916:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593265792 00000100:00100000:3.0:1789117951.859034:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789117951.859049:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88565680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593265792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789117951.859124:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789117951.859520:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88565680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593265792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 473us (8009us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117951.859529:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789117951.860532:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a885670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593265792:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789117951.974704:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789117952.038783:0:18556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1789117952.687916:0:20196:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789117952.688489:0:20196:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789117952.998414:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789117953.318589:0:17796:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789117953.318611:0:17796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962bbf6a1000 from 10 10000000:01000000:1.0:1789117953.318617:0:17796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789117953.318671:0:17796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20eea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117953.318683:0:17796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20eea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117953.318696:0:17796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20eea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117953.318734:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593265920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789117953.318823:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117953.318870:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b88605900 going to sleep for 11 seconds 00000100:00100000:3.0:1789117953.318982:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593265920 00000100:00100000:3.0:1789117953.318988:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593265920 00000100:00100000:3.0:1789117953.319046:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789117953.319082:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+22:17796:x1876025593265920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117953.319095:0:17793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117953.319109:0:17793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a88d9ac00/0xaa253ed19be20ef1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20eea expref: -99 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117953.319133:0:17793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a88d9ac00/0xaa253ed19be20ef1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20eea expref: 23 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117953.319143:0:17793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a88d9ac00/0xaa253ed19be20ef1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20eea expref: 23 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117953.319153:0:17793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a88d9ac00, rc 0) 00000100:00100000:3.0:1789117953.319195:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+23:17796:x1876025593265920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117953.319202:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789117953.319257:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593265920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117953.319272:0:17796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20eea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20ef1 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117953.319280:0:17796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20eea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20ef1 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117953.319327:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a886243c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593266048:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789117953.319361:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117953.319377:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bae470180 going to sleep for 11 seconds 00000100:00100000:2.0:1789117953.319444:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593266048 00000100:00100000:2.0:1789117953.319449:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593266048 00000100:00100000:2.0:1789117953.319485:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789117953.319493:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+23:17796:x1876025593266048:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789117953.319509:0:17791:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789117953.319527:0:17791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789117953.319530:0:17791:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1789117953.319629:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+23:17796:x1876025593266048:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117953.319637:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789117953.319669:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a886243c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593266048:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789117953.319740:0:17796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789117953.319748:0:17796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20eea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20ef1 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117953.319756:0:17796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20eea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20ef1 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117953.319766:0:17796:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789117953.319768:0:17796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962a88713800 from 10 10000000:01000000:2.0:1789117953.319771:0:17796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789117953.319787:0:17796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d92600/0xaa253ed19be20ef8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117953.319794:0:17796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a87d92600/0xaa253ed19be20ef8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117953.319807:0:17796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a87d92600/0xaa253ed19be20ef8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117953.319820:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a885643c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593266176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789117953.319847:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117953.319865:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b87cf6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789117953.319877:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593266176 00000100:00100000:2.0:1789117953.319880:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593266176 00000100:00100000:2.0:1789117953.319898:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789117953.319903:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+23:17796:x1876025593266176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117953.319910:0:17791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117953.319918:0:17791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d92e00/0xaa253ed19be20eff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be20ef8 expref: -99 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117953.319931:0:17791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d92e00/0xaa253ed19be20eff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be20ef8 expref: 24 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117953.319939:0:17791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d92e00/0xaa253ed19be20eff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20ef8 expref: 24 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117953.319946:0:17791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92e00, rc 0) 00000100:00100000:2.0:1789117953.319975:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+24:17796:x1876025593266176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 71us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117953.319981:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789117953.320012:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a885643c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593266176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117953.320023:0:17796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a87d92600/0xaa253ed19be20ef8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20eff expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117953.320036:0:17796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a87d92600/0xaa253ed19be20ef8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20eff expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117953.320099:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a885643c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593266304:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789117953.320127:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117953.320143:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b87cf6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789117953.320154:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593266304 00000100:00100000:2.0:1789117953.320157:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593266304 00000100:00100000:2.0:1789117953.320174:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789117953.320179:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+24:17796:x1876025593266304:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789117953.320188:0:17791:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789117953.320200:0:17791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789117953.320202:0:17791:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1789117953.320263:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+24:17796:x1876025593266304:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 81us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117953.320269:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789117953.320296:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a885643c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593266304:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789117953.320332:0:17796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789117953.320337:0:17796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d92600/0xaa253ed19be20ef8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20eff expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117953.320344:0:17796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a87d92600/0xaa253ed19be20ef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20eff expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117954.021396:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117954.929327:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593266432:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789117954.929419:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117954.929581:0:19315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593266432 00000100:00100000:0.0:1789117954.929589:0:19315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593266432 00000100:00100000:0.0:1789117954.929657:0:19315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789117954.929667:0:19315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86808f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593266432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789117954.929721:0:19315:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789117954.929784:0:19315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86808f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593266432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (364us total) trans 0 rc 0/0 00000100:00080000:1.0:1789117954.929876:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117954.929941:0:19315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789117954.930926:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593266432:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789117955.045354:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789117955.500415:0:17834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789117956.075098:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117956.453942:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117956.453972:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a868092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593266560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789117956.454071:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117956.454141:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593266560 00000100:00100000:1.0:1789117956.454150:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593266560 00000100:00100000:1.0:1789117956.454213:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789117956.454224:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593266560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789117956.454266:0:18751:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789117956.454324:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593266560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117956.454332:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789117956.454381:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a868092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593266560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789117956.455208:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789117956.455224:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a886243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593266688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117956.455444:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117956.455502:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593266688 00000100:00100000:0.0:1789117956.455509:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593266688 00000100:00100000:0.0:1789117956.455558:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789117956.455565:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88567c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593266688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789117956.455593:0:17803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789117956.455656:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88567c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593266688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117956.455664:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789117956.455835:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a886243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593266688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117956.967688:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789117956.967726:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0719e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593266816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117956.967820:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117956.968097:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593266816 00000100:00100000:3.0:1789117956.968105:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593266816 00000100:00080000:1.0:1789117956.968157:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789117956.968198:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789117956.968209:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593266816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789117956.968243:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789117956.968313:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593266816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117956.968322:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789117956.968798:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0719e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593266816:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789117956.980718:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117956.980726:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789117956.980731:0:37:0:(import.c:65:import_set_state_nolock()) ffff962b853e0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789117956.980745:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff962b853e0000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789117956.980771:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a8680a580 x1876025593267200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789117956.980849:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117956.980853:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789117956.980855:0:37:0:(import.c:65:import_set_state_nolock()) ffff962bc1a36800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789117956.980860:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff962bc1a36800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789117956.980871:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a8680ad00 x1876025593267712/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789117956.980942:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a868092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593266944:0@lo:400:kworker.0 00000100:00100000:3.0:1789117956.981025:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117956.981093:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593267584:0@lo:400:kworker.0 00000100:00100000:3.0:1789117956.981123:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117956.981142:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86808780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593268224:0@lo:400:kworker.0 00000100:00100000:3.0:1789117956.981255:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117956.981292:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789117956.981298:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8680b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593267072:0@lo:400:kworker.0 00000100:00100000:3.0:1789117956.981328:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117956.981349:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8680bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593267840:0@lo:400:kworker.0 00000100:00100000:3.0:1789117956.981371:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117956.981388:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86809e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593268352:0@lo:400:kworker.0 00000100:00100000:3.0:1789117956.981411:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117956.981440:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8680a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593267200:0@lo:8:kworker.0 00000100:00100000:3.0:1789117956.981465:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117956.981483:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8680ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593267712:0@lo:8:kworker.0 00000100:00100000:3.0:1789117956.981504:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117956.981540:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593266944 00000100:00100000:3.0:1789117956.981549:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593266944 00000100:00100000:3.0:1789117956.981593:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789117956.981602:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+24:3646:x1876025593266944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117956.982293:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+24:3646:x1876025593266944:12345-0@lo:400:kworker.0 Request processed in 687us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117956.982304:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789117956.982353:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593267584 00000100:00100000:3.0:1789117956.982358:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593267584 00000100:00100000:3.0:1789117956.982404:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593267200 00000100:00100000:3.0:1789117956.982407:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593267200 00000100:00100000:3.0:1789117956.982417:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593267712 00000100:00100000:3.0:1789117956.982419:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593267712 00000100:00100000:3.0:1789117956.982428:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789117956.982436:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a886243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593267584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117956.982475:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a886243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593267584:12345-0@lo:400:kworker.0 Request processed in 40us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117956.982487:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789117956.982499:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789117956.982503:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876025593267200:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789117956.982545:0:19313:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 609 last 0 00000020:00000080:3.0:1789117956.982572:0:19313:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa253ed19be20f06 00002000:00100000:3.0:1789117956.982586:0:19313:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff962a88d49800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789117956.982590:0:19313:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789117956.982592:0:19313:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789117956.984403:0:19313:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789117956.984440:0:19313:0:(import.c:65:import_set_state_nolock()) ffff962a88d4d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789117956.984526:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1876025593267200:12345-0@lo:8:kworker.0 Request processed in 2019us (3059us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117956.984537:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789117956.984565:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789117956.984571:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876025593267712:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789117956.984596:0:19313:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 609 last 0 00000020:00000080:3.0:1789117956.984619:0:19313:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xaa253ed19be20f0d 00002000:00100000:3.0:1789117956.984645:0:19313:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff962a88d4f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398c ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1789117956.984649:0:19313:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1789117956.984651:0:19313:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789117956.984931:0:19313:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1789117956.984946:0:19313:0:(import.c:65:import_set_state_nolock()) ffff962a88d4c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789117956.984978:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3643:x1876025593267712:12345-0@lo:8:kworker.0 Request processed in 406us (3472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117956.984985:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789117956.985026:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593268224 00000100:00100000:3.0:1789117956.985034:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593268224 00000100:00100000:3.0:1789117956.985102:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593267840 00000100:00100000:3.0:1789117956.985105:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593267840 00000100:00100000:3.0:1789117956.985116:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593268352 00000100:00100000:3.0:1789117956.985118:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593268352 00000100:00100000:3.0:1789117956.985153:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789117956.985372:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a868092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593266944:0@lo:400:kworker.0 00000100:00100000:0.0:1789117956.985392:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593267584:0@lo:400:kworker.0 00000100:00100000:3.0:1789117956.985757:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593268224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117956.985832:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593268224:12345-0@lo:400:kworker.0 Request processed in 673us (4577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117956.985839:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789117956.985858:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789117956.985865:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a868183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593267840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117956.985891:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a868183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593267840:12345-0@lo:400:kworker.0 Request processed in 27us (4519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117956.985897:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789117956.985908:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789117956.985913:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593268352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117956.985940:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593268352:12345-0@lo:400:kworker.0 Request processed in 27us (4529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117956.985946:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789117956.985971:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593267072 00000100:00100000:3.0:1789117956.985976:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593267072 00000100:00100000:3.0:1789117956.986012:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789117956.986019:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593267072:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789117956.986038:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a8680bc00 x1876025593267840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117956.986076:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593267072:12345-0@lo:400:kworker.0 Request processed in 35us (4724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117956.986080:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8680bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593267840:0@lo:400:kworker.0 00000100:00100000:3.0:1789117956.986098:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1789117956.986098:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a86809e00 x1876025593268352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117956.986107:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86809e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593268352:0@lo:400:kworker.0 00010000:00080000:0.0:1789117956.986118:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a86808780 x1876025593268224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117956.986126:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86808780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593268224:0@lo:400:kworker.0 00000100:00100000:0.0:1789117956.986146:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8680b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593267072:0@lo:400:kworker.0 00010000:00080000:3.0:1789117956.988322:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a8680a580 x1876025593267200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789117981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789117956.988346:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789117956.988359:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789117956.988364:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789117956.988368:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b853e0000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789117956.988392:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789117956.988399:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8680a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593267200:0@lo:8:kworker.0 00010000:00080000:3.0:1789117956.988431:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a8680ad00 x1876025593267712/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789117981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789117956.988442:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789117956.988447:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789117956.988450:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789117956.988452:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bc1a36800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789117956.988464:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789117956.988467:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8680ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593267712:0@lo:8:kworker.0 00000004:00080000:3.0:1789117956.988512:0:17824:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789117956.988617:0:17824:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 609271562008ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789117956.988626:0:17824:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1789117956.988701:0:18545:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789117956.989482:0:18545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a868192c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18545:1876025593268608:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1789117956.989561:0:18545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117956.989595:0:18545:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bae470a80 going to sleep for 11 seconds 00000004:00080000:0.0:1789117956.991138:0:17825:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1789117956.991170:0:17825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071b0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17825:1876025593268864:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789117956.991235:0:17825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117956.991268:0:17825:0:(client.c:2715:ptlrpc_set_wait()) set ffff962ba0727480 going to sleep for 11 seconds 00000004:00080000:0.0:1789117956.991289:0:18544:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789117956.991393:0:18544:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 609274338348ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789117956.991400:0:18544:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789117956.991574:0:19312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593268608 00000100:00100000:0.0:1789117956.991582:0:19312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593268608 00000100:00100000:0.0:1789117956.991628:0:19312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593268864 00000100:00100000:0.0:1789117956.991643:0:19312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593268864 00000100:00100000:0.0:1789117956.991664:0:19312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789117956.991673:0:19312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:18545:x1876025593268608:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1789117956.992857:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86809680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593267328:0@lo:400:kworker.0 00000100:00100000:1.0:1789117956.992948:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117956.992997:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86808b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593267968:0@lo:400:kworker.0 00000100:00100000:1.0:1789117956.993020:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117956.993037:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593268480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789117956.993089:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117956.993112:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789117956.993118:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a868083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593267456:0@lo:400:kworker.0 00000100:00100000:1.0:1789117956.993144:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117956.993161:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593268096:0@lo:400:kworker.0 00000100:00100000:1.0:1789117956.993181:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117956.993193:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0719e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593268736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117956.993210:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117956.993246:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593267328 00000100:00100000:1.0:1789117956.993253:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593267328 00000100:00100000:1.0:1789117956.993300:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593267968 00000100:00100000:1.0:1789117956.993303:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593267968 00000100:00100000:1.0:1789117956.993332:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593268096 00000100:00100000:1.0:1789117956.993345:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593268096 00000100:00100000:1.0:1789117956.993367:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789117956.993376:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593267328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117956.993436:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593267328:12345-0@lo:400:kworker.0 Request processed in 61us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117956.993445:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789117956.993466:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789117956.993471:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593267968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117956.993499:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593267968:12345-0@lo:400:kworker.0 Request processed in 29us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117956.993505:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789117956.993516:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789117956.993521:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86808780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593268096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117956.993552:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86808780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593268096:12345-0@lo:400:kworker.0 Request processed in 30us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117956.993558:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789117956.993586:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593268480 00000100:00100000:1.0:1789117956.993589:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593268480 00000100:00100000:1.0:1789117956.993606:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593268736 00000100:00100000:1.0:1789117956.993608:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593268736 00000100:00100000:1.0:1789117956.993620:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789117956.993627:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3644:x1876025593268480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789117956.993664:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789117956.993713:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3644:x1876025593268480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117956.993720:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789117956.993732:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789117956.993745:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86809e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1876025593268736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789117956.993755:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789117956.993780:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86809e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1876025593268736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117956.993787:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1789117956.993821:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a86809a40 x1876025593268096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117956.993837:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593268096:0@lo:400:kworker.0 00010000:00080000:1.0:1789117956.993848:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962ba0719e00 x1876025593268736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117956.993862:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0719e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593268736:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789117956.993871:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a86809680 x1876025593267328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117956.993879:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86809680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593267328:0@lo:400:kworker.0 00010000:00080000:1.0:1789117956.993888:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a86808b40 x1876025593267968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117956.993896:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86808b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593267968:0@lo:400:kworker.0 00010000:00080000:1.0:1789117956.993905:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a8681ad00 x1876025593268480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117956.993916:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593268480:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789117956.993954:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789117956.993960:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789117956.993962:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789117956.993970:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117956.995524:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593267456 00000100:00100000:0.0:1789117956.995538:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593267456 00000100:00100000:0.0:1789117956.995589:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789117956.995598:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593267456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117956.995701:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593267456:12345-0@lo:400:kworker.0 Request processed in 104us (2555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117956.995710:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789117956.996312:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a868083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593267456:0@lo:400:kworker.0 00000004:00080000:1.0:1789117957.000030:0:18534:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:3.0:1789117957.005605:0:17778:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1789117957.005685:0:19312:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789117957.005695:0:19312:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789117957.006941:0:19312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:18545:x1876025593268608:12345-0@lo:7:osp-pre-1-1.0 Request processed in 15262us (17373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117957.006953:0:19312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1789117957.006962:0:18545:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a868192c0 x1876025593268608/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789117972 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117957.006978:0:18545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a868192c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18545:1876025593268608:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1789117957.006989:0:19312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000004:00080000:1.0:1789117957.006993:0:18545:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789117957.007000:0:19312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0719680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17825:x1876025593268864:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789117957.007036:0:18545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a868083c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18545:1876025593268992:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789117957.007095:0:18545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117957.007548:0:18545:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b886053c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117957.007570:0:19311:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789117957.007578:0:19311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789117957.007692:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593268992 00000100:00100000:1.0:1789117957.007700:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593268992 00000100:00100000:1.0:1789117957.007801:0:20393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789117957.007810:0:20393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:18545:x1876025593268992:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789117957.007829:0:20393:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1789117957.007869:0:20393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:18545:x1876025593268992:12345-0@lo:5:osp-pre-1-1.0 Request processed in 61us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117957.007877:0:20393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789117957.007903:0:18545:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a868083c0 x1876025593268992/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789117973 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117957.007914:0:18545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a868083c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18545:1876025593268992:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1789117957.007925:0:18545:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789117957.007955:0:18545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a868083c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18545:1876025593269120:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789117957.007989:0:18545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117957.008004:0:18545:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b886053c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117957.008015:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593269120 00000100:00100000:1.0:1789117957.008018:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593269120 00000100:00100000:1.0:1789117957.008035:0:19311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789117957.008041:0:19311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86809680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:18545:x1876025593269120:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789117957.010260:0:19311:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:3.0:1789117957.013381:0:19312:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1789117957.013392:0:19312:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1789117957.013399:0:19312:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00010000:1.0:1789117957.030963:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789117957.030978:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000459e3a3a/0xaa253ed19be20f14 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.030999:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=609s v=(0 0) 00010000:00010000:1.0:1789117957.031005:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117957.031013:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000459e3a3a/0xaa253ed19be20f14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.031037:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000459e3a3a/0xaa253ed19be20f14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.031048:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000459e3a3a/0xaa253ed19be20f14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.031081:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000459e3a3a/0xaa253ed19be20f14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.031102:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789117957.031327:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117957.031336:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000459e3a3a/0xaa253ed19be20f14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117957.031345:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f5a00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789117957.031351:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000459e3a3a/0xaa253ed19be20f14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117957.031360:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000459e3a3a/0xaa253ed19be20f14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117957.031382:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000459e3a3a/0xaa253ed19be20f14 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117957.031390:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000459e3a3a/0xaa253ed19be20f14 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117957.031430:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117957.031433:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117957.031435:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789117957.031585:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789117957.031598:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4684bcc/0xaa253ed19be20f1b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.031607:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=609s v=(0 0) 00010000:00010000:1.0:1789117957.031611:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117957.031616:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4684bcc/0xaa253ed19be20f1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.031626:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4684bcc/0xaa253ed19be20f1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.031648:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4684bcc/0xaa253ed19be20f1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.031656:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4684bcc/0xaa253ed19be20f1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.031675:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789117957.031685:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117957.031689:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4684bcc/0xaa253ed19be20f1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.031697:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d800 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117957.031700:0:18557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4684bcc/0xaa253ed19be20f1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.031708:0:18557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4684bcc/0xaa253ed19be20f1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.031738:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4684bcc/0xaa253ed19be20f1b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.031745:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4684bcc/0xaa253ed19be20f1b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.031758:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117957.031760:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117957.031762:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789117957.032085:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789117957.032092:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c1da87b/0xaa253ed19be20f22 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.032101:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=609s v=(0 0) 00010000:00010000:1.0:1789117957.032104:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117957.032109:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c1da87b/0xaa253ed19be20f22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.032130:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c1da87b/0xaa253ed19be20f22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.032138:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c1da87b/0xaa253ed19be20f22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.032146:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c1da87b/0xaa253ed19be20f22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.032170:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789117957.032265:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117957.032272:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c1da87b/0xaa253ed19be20f22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117957.032281:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d400 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789117957.032285:0:17787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c1da87b/0xaa253ed19be20f22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117957.032293:0:17787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c1da87b/0xaa253ed19be20f22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117957.032305:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c1da87b/0xaa253ed19be20f22 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117957.032313:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c1da87b/0xaa253ed19be20f22 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117957.032326:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117957.032328:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117957.032329:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789117957.032599:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789117957.032605:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088914707/0xaa253ed19be20f29 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.032613:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=609s v=(0 0) 00010000:00010000:1.0:1789117957.032616:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117957.032620:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088914707/0xaa253ed19be20f29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.032629:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088914707/0xaa253ed19be20f29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.032650:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088914707/0xaa253ed19be20f29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.032657:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088914707/0xaa253ed19be20f29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.032669:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789117957.032684:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117957.032689:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088914707/0xaa253ed19be20f29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117957.032709:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789117957.032712:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088914707/0xaa253ed19be20f29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117957.032721:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088914707/0xaa253ed19be20f29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117957.032732:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088914707/0xaa253ed19be20f29 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117957.032748:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088914707/0xaa253ed19be20f29 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117957.032763:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117957.032764:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117957.032766:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789117957.033286:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789117957.033294:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000224d64f3/0xaa253ed19be20f30 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.033302:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=609s v=(0 0) 00010000:00010000:1.0:1789117957.033311:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117957.033643:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000224d64f3/0xaa253ed19be20f30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.033657:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000224d64f3/0xaa253ed19be20f30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.033666:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000224d64f3/0xaa253ed19be20f30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.033674:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000224d64f3/0xaa253ed19be20f30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.033699:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789117957.034028:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789117957.034034:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000598e082a/0xaa253ed19be20f37 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.034041:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=609s v=(0 0) 00010000:00010000:1.0:1789117957.034044:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117957.034048:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000598e082a/0xaa253ed19be20f37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.034080:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000598e082a/0xaa253ed19be20f37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.034088:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000598e082a/0xaa253ed19be20f37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.034102:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000598e082a/0xaa253ed19be20f37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.034225:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789117957.038934:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789117957.038952:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be20f3e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.038973:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=609s v=(0 0) 00010000:00010000:1.0:1789117957.038978:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117957.038986:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be20f3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.039001:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be20f3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.039012:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be20f3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.039019:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be20f3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.040642:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789117957.040656:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000224d64f3/0xaa253ed19be20f30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.040669:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70ce00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789117957.040674:0:18557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000224d64f3/0xaa253ed19be20f30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.040685:0:18557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000224d64f3/0xaa253ed19be20f30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.040714:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000224d64f3/0xaa253ed19be20f30 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.040722:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000224d64f3/0xaa253ed19be20f30 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.040762:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789117957.040766:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000598e082a/0xaa253ed19be20f37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.040773:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c400 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789117957.040776:0:18557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000598e082a/0xaa253ed19be20f37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.040784:0:18557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000598e082a/0xaa253ed19be20f37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.040794:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000598e082a/0xaa253ed19be20f37 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.040802:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000598e082a/0xaa253ed19be20f37 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.040813:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117957.040816:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be20f3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.040822:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d000 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789117957.040824:0:18557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be20f3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.040843:0:18557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be20f3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.040853:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be20f3e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.040860:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117957.040861:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117957.040863:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117957.041720:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117957.043294:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789117957.043309:0:19312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be20f3e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.044453:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789117957.044953:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117957.044963:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000846df2e1/0xaa253ed19be20f45 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.044980:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1789117957.044985:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117957.044993:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000846df2e1/0xaa253ed19be20f45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.045009:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000846df2e1/0xaa253ed19be20f45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.045019:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000846df2e1/0xaa253ed19be20f45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.045026:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000846df2e1/0xaa253ed19be20f45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.045098:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789117957.045204:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117957.045212:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000846df2e1/0xaa253ed19be20f45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.045221:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9b800 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117957.045227:0:18557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000846df2e1/0xaa253ed19be20f45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.045238:0:18557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000846df2e1/0xaa253ed19be20f45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.045259:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000846df2e1/0xaa253ed19be20f45 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.045267:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000846df2e1/0xaa253ed19be20f45 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117957.045285:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117957.045287:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117957.045289:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789117957.048470:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117957.048490:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d5b0706/0xaa253ed19be20f4c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.048512:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1789117957.048517:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117957.048526:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d5b0706/0xaa253ed19be20f4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.048541:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d5b0706/0xaa253ed19be20f4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.048551:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d5b0706/0xaa253ed19be20f4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.048560:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d5b0706/0xaa253ed19be20f4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.048592:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789117957.048973:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117957.048983:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d5b0706/0xaa253ed19be20f4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.048992:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9b400 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117957.048997:0:17787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d5b0706/0xaa253ed19be20f4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.049007:0:17787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d5b0706/0xaa253ed19be20f4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.049031:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d5b0706/0xaa253ed19be20f4c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.049040:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d5b0706/0xaa253ed19be20f4c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.049080:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.049083:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.049085:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789117957.049583:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117957.049591:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000109c4dac/0xaa253ed19be20f53 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.049600:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1789117957.049613:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117957.049619:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000109c4dac/0xaa253ed19be20f53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.049642:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000109c4dac/0xaa253ed19be20f53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.049651:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000109c4dac/0xaa253ed19be20f53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.049659:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000109c4dac/0xaa253ed19be20f53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.049686:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789117957.049929:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117957.049935:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000109c4dac/0xaa253ed19be20f53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.049944:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9be00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117957.049948:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000109c4dac/0xaa253ed19be20f53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.049965:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000109c4dac/0xaa253ed19be20f53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.049978:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000109c4dac/0xaa253ed19be20f53 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.049986:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000109c4dac/0xaa253ed19be20f53 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.050002:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.050004:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.050005:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789117957.050417:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117957.050426:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff3b8b90/0xaa253ed19be20f5a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.050437:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1789117957.050440:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117957.050445:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff3b8b90/0xaa253ed19be20f5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.050455:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff3b8b90/0xaa253ed19be20f5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.050464:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff3b8b90/0xaa253ed19be20f5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.050479:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff3b8b90/0xaa253ed19be20f5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.050505:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789117957.050653:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117957.050659:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff3b8b90/0xaa253ed19be20f5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.050668:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9bc00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117957.050672:0:18557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff3b8b90/0xaa253ed19be20f5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.050681:0:18557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff3b8b90/0xaa253ed19be20f5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.050694:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff3b8b90/0xaa253ed19be20f5a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.050714:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff3b8b90/0xaa253ed19be20f5a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.050729:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.050731:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.050732:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789117957.051005:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117957.051011:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099c12d13/0xaa253ed19be20f61 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.051020:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1789117957.051023:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117957.051027:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099c12d13/0xaa253ed19be20f61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.051037:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099c12d13/0xaa253ed19be20f61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.051045:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099c12d13/0xaa253ed19be20f61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.051094:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099c12d13/0xaa253ed19be20f61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.051207:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789117957.051521:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117957.051527:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024136832/0xaa253ed19be20f68 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.051542:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1789117957.051545:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117957.051549:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024136832/0xaa253ed19be20f68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.051559:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024136832/0xaa253ed19be20f68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.051566:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024136832/0xaa253ed19be20f68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.051573:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024136832/0xaa253ed19be20f68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.051847:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789117957.051855:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099c12d13/0xaa253ed19be20f61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.051863:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9b600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117957.051868:0:17787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099c12d13/0xaa253ed19be20f61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.051877:0:17787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099c12d13/0xaa253ed19be20f61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.051891:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099c12d13/0xaa253ed19be20f61 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.051898:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099c12d13/0xaa253ed19be20f61 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.051917:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117957.051920:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024136832/0xaa253ed19be20f68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.051935:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9b000 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117957.051938:0:17787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024136832/0xaa253ed19be20f68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.051947:0:17787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024136832/0xaa253ed19be20f68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.051957:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024136832/0xaa253ed19be20f68 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.051965:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.051967:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.051969:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117957.052013:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789117957.052019:0:19312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024136832/0xaa253ed19be20f68 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.052333:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789117957.052468:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117957.052475:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a438b78b/0xaa253ed19be20f6f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.052483:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1789117957.052486:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117957.052490:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a438b78b/0xaa253ed19be20f6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.052510:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a438b78b/0xaa253ed19be20f6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.052517:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a438b78b/0xaa253ed19be20f6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.052524:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a438b78b/0xaa253ed19be20f6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.052545:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789117957.052772:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117957.052778:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a438b78b/0xaa253ed19be20f6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.052787:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9a400 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117957.052791:0:18557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a438b78b/0xaa253ed19be20f6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.052800:0:18557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a438b78b/0xaa253ed19be20f6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.052813:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a438b78b/0xaa253ed19be20f6f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.052827:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a438b78b/0xaa253ed19be20f6f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.052844:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.052846:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.052847:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789117957.052923:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117957.052928:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f29bf47d/0xaa253ed19be20f76 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.052935:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1789117957.052938:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117957.052942:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f29bf47d/0xaa253ed19be20f76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.052950:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f29bf47d/0xaa253ed19be20f76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.052958:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f29bf47d/0xaa253ed19be20f76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.052977:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f29bf47d/0xaa253ed19be20f76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.052998:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789117957.053286:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117957.053292:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f29bf47d/0xaa253ed19be20f76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.053299:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9aa00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117957.053302:0:17787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f29bf47d/0xaa253ed19be20f76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.053309:0:17787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f29bf47d/0xaa253ed19be20f76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.053321:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f29bf47d/0xaa253ed19be20f76 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.053329:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f29bf47d/0xaa253ed19be20f76 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.053343:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.053345:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.053346:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789117957.053428:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117957.053434:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fa09b25/0xaa253ed19be20f7d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.053443:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1789117957.053446:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117957.053450:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fa09b25/0xaa253ed19be20f7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.053460:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fa09b25/0xaa253ed19be20f7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.053468:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fa09b25/0xaa253ed19be20f7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.053475:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fa09b25/0xaa253ed19be20f7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.053527:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789117957.053836:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117957.053842:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d06da3/0xaa253ed19be20f84 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.053856:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1789117957.053860:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117957.053865:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029d06da3/0xaa253ed19be20f84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.053875:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029d06da3/0xaa253ed19be20f84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.053885:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d06da3/0xaa253ed19be20f84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.053893:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029d06da3/0xaa253ed19be20f84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.053945:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789117957.053951:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fa09b25/0xaa253ed19be20f7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.053960:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9a600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117957.053963:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fa09b25/0xaa253ed19be20f7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.053971:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fa09b25/0xaa253ed19be20f7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.053983:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fa09b25/0xaa253ed19be20f7d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.053990:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fa09b25/0xaa253ed19be20f7d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.054005:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117957.054008:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029d06da3/0xaa253ed19be20f84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.054015:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9ac00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117957.054018:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d06da3/0xaa253ed19be20f84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.054025:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d06da3/0xaa253ed19be20f84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.054048:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029d06da3/0xaa253ed19be20f84 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.054078:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.054080:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.054082:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117957.054213:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789117957.054219:0:19312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029d06da3/0xaa253ed19be20f84 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789117957.054536:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117957.054542:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034f770aa/0xaa253ed19be20f8b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.054551:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1789117957.054554:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117957.054558:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034f770aa/0xaa253ed19be20f8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.054577:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034f770aa/0xaa253ed19be20f8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.054585:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034f770aa/0xaa253ed19be20f8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.054593:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034f770aa/0xaa253ed19be20f8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.054643:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117957.054649:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034f770aa/0xaa253ed19be20f8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.054656:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc10800 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117957.054659:0:18557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034f770aa/0xaa253ed19be20f8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.054667:0:18557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034f770aa/0xaa253ed19be20f8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.054678:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034f770aa/0xaa253ed19be20f8b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.054686:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.054688:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.054690:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117957.054752:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789117957.054757:0:19312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034f770aa/0xaa253ed19be20f8b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789117957.055100:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117957.055105:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6eac3f5/0xaa253ed19be20f92 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.055126:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1789117957.055129:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117957.055133:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6eac3f5/0xaa253ed19be20f92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.055143:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6eac3f5/0xaa253ed19be20f92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.055163:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6eac3f5/0xaa253ed19be20f92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.055171:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6eac3f5/0xaa253ed19be20f92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.055257:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117957.055262:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6eac3f5/0xaa253ed19be20f92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.055281:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc10600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117957.055284:0:17787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6eac3f5/0xaa253ed19be20f92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.055292:0:17787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6eac3f5/0xaa253ed19be20f92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.055303:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6eac3f5/0xaa253ed19be20f92 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.055311:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.055312:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.055314:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117957.055367:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789117957.055373:0:19312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6eac3f5/0xaa253ed19be20f92 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789117957.060114:0:20127:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1789117957.060141:0:20127:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1789117957.060146:0:20127:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1789117957.060477:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117957.060487:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ba996e3/0xaa253ed19be20f99 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.060505:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1789117957.060510:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117957.060517:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ba996e3/0xaa253ed19be20f99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.060533:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ba996e3/0xaa253ed19be20f99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.060544:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ba996e3/0xaa253ed19be20f99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.060566:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ba996e3/0xaa253ed19be20f99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.060582:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789117957.061095:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117957.061101:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015c0bd32/0xaa253ed19be20fa0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.061122:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1789117957.061127:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117957.061131:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015c0bd32/0xaa253ed19be20fa0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.061142:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015c0bd32/0xaa253ed19be20fa0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.061150:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015c0bd32/0xaa253ed19be20fa0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.061158:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015c0bd32/0xaa253ed19be20fa0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.061171:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1789117957.061387:0:19311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86809680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:18545:x1876025593269120:12345-0@lo:5:osp-pre-1-1.0 Request processed in 53343us (53394us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789117957.061405:0:19311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789117957.061720:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789117957.061727:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ba996e3/0xaa253ed19be20f99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.061735:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc11800 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117957.061740:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ba996e3/0xaa253ed19be20f99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.061749:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ba996e3/0xaa253ed19be20f99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.061769:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ba996e3/0xaa253ed19be20f99 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.061786:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ba996e3/0xaa253ed19be20f99 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.061807:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117957.061811:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015c0bd32/0xaa253ed19be20fa0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.061817:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc10e00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117957.061820:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015c0bd32/0xaa253ed19be20fa0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.061828:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015c0bd32/0xaa253ed19be20fa0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.061838:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015c0bd32/0xaa253ed19be20fa0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.061845:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015c0bd32/0xaa253ed19be20fa0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.061856:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.061858:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.061859:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.061866:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.061871:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789117957.062268:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117957.062275:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4e11f06/0xaa253ed19be20fa7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.062284:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1789117957.062288:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117957.062292:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e11f06/0xaa253ed19be20fa7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.062303:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4e11f06/0xaa253ed19be20fa7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.062414:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4e11f06/0xaa253ed19be20fa7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.062424:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e11f06/0xaa253ed19be20fa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.062442:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789117957.062755:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117957.062761:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b58be210/0xaa253ed19be20fae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.062769:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1789117957.062772:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117957.062782:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b58be210/0xaa253ed19be20fae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.062791:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b58be210/0xaa253ed19be20fae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.062799:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b58be210/0xaa253ed19be20fae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.062806:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b58be210/0xaa253ed19be20fae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.062818:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789117957.063082:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789117957.063094:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4e11f06/0xaa253ed19be20fa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.063102:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc10000 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117957.063106:0:18557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4e11f06/0xaa253ed19be20fa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.063125:0:18557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4e11f06/0xaa253ed19be20fa7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.063139:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4e11f06/0xaa253ed19be20fa7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.063146:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4e11f06/0xaa253ed19be20fa7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.063162:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117957.063165:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b58be210/0xaa253ed19be20fae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.063172:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc10a00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117957.063175:0:18557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b58be210/0xaa253ed19be20fae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.063182:0:18557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b58be210/0xaa253ed19be20fae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.063205:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b58be210/0xaa253ed19be20fae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.063212:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b58be210/0xaa253ed19be20fae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.063225:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.063227:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.063229:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.063235:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789117957.063591:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117957.063598:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037aa5e21/0xaa253ed19be20fb5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.063606:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1789117957.063610:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117957.063614:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037aa5e21/0xaa253ed19be20fb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.063624:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037aa5e21/0xaa253ed19be20fb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.063644:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037aa5e21/0xaa253ed19be20fb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.063662:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037aa5e21/0xaa253ed19be20fb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.063681:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789117957.063933:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117957.063939:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037aa5e21/0xaa253ed19be20fb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.063947:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc10400 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117957.063951:0:17787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037aa5e21/0xaa253ed19be20fb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.063959:0:17787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037aa5e21/0xaa253ed19be20fb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.063971:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037aa5e21/0xaa253ed19be20fb5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.063979:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037aa5e21/0xaa253ed19be20fb5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.064006:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.064008:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.064009:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789117957.064488:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117957.064495:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7018b1f/0xaa253ed19be20fbc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.064504:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1789117957.064507:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117957.064512:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7018b1f/0xaa253ed19be20fbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.064522:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7018b1f/0xaa253ed19be20fbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.064529:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7018b1f/0xaa253ed19be20fbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.064535:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7018b1f/0xaa253ed19be20fbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.064554:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789117957.064564:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117957.064568:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7018b1f/0xaa253ed19be20fbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.064582:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc11600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789117957.064585:0:18557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7018b1f/0xaa253ed19be20fbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.064593:0:18557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7018b1f/0xaa253ed19be20fbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.064604:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7018b1f/0xaa253ed19be20fbc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.064611:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7018b1f/0xaa253ed19be20fbc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.064624:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117957.064626:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117957.064628:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789117957.068470:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117957.068485:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb8e4426/0xaa253ed19be20fc3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.068502:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1789117957.068507:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117957.068514:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb8e4426/0xaa253ed19be20fc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.068528:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb8e4426/0xaa253ed19be20fc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.068547:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb8e4426/0xaa253ed19be20fc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.068555:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb8e4426/0xaa253ed19be20fc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.068582:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789117957.069297:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117957.069306:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb8e4426/0xaa253ed19be20fc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.069559:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc11a00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117957.069563:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb8e4426/0xaa253ed19be20fc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.069573:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb8e4426/0xaa253ed19be20fc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.069591:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb8e4426/0xaa253ed19be20fc3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.069599:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb8e4426/0xaa253ed19be20fc3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.069624:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.069625:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.069627:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789117957.069762:0:19312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789117957.069768:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c025e39/0xaa253ed19be20fca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.069777:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1789117957.069781:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117957.069786:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c025e39/0xaa253ed19be20fca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.069796:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c025e39/0xaa253ed19be20fca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.069805:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c025e39/0xaa253ed19be20fca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.069812:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c025e39/0xaa253ed19be20fca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117957.069882:0:19312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1789117957.069937:0:19312:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:0.0:1789117957.070042:0:19312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0719680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17825:x1876025593268864:12345-0@lo:5:osp-pre-1-0.0 Request processed in 63043us (78804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117957.070070:0:19312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789117957.070144:0:17825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071b0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17825:1876025593268864:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789117957.070721:0:18545:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789117957.070730:0:18545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a868083c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18545:1876025593269120:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1789117957.070747:0:18545:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1789117957.070800:0:18545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a868083c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:18545:1876025593269248:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1789117957.070858:0:18545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117957.070887:0:18545:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c14900 going to sleep for 11 seconds 00000100:00100000:1.0:1789117957.070909:0:17810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593269248 00000100:00100000:1.0:1789117957.070914:0:17810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593269248 00000100:00100000:1.0:1789117957.070961:0:17810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789117957.070970:0:17810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86809a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:18545:x1876025593269248:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1789117957.071016:0:17810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86809a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:18545:x1876025593269248:12345-0@lo:900:osp-pre-1-1.0 Request processed in 47us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117957.071023:0:17810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789117957.071082:0:18545:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a868083c0 x1876025593269248/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789117973 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117957.071094:0:18545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a868083c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:18545:1876025593269248:0@lo:900:osp-pre-1-1.0 00000004:00080000:0.0:1789117957.071186:0:17825:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1789117957.071217:0:17825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071b0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17825:1876025593269376:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789117957.071245:0:17825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117957.071274:0:17825:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a88434840 going to sleep for 11 seconds 00000100:00100000:0.0:1789117957.071287:0:19312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593269376 00000100:00100000:0.0:1789117957.071290:0:19312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593269376 00000100:00100000:0.0:1789117957.071336:0:19312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789117957.071343:0:19312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0719a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17825:x1876025593269376:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1789117957.071386:0:19312:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:2.0:1789117957.074280:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117957.074294:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c025e39/0xaa253ed19be20fca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.074442:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc11200 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117957.074448:0:17787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c025e39/0xaa253ed19be20fca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.074461:0:17787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c025e39/0xaa253ed19be20fca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.074486:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c025e39/0xaa253ed19be20fca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.074495:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c025e39/0xaa253ed19be20fca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117957.074521:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.074523:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117957.074525:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117957.082434:0:19312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0719a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17825:x1876025593269376:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11081us (11178us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789117957.082450:0:19312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789117957.083324:0:17825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071b0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17825:1876025593269376:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789117957.083346:0:17825:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:2.0:1789117957.105305:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117958.117323:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789117958.898159:0:20487:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789117959.143930:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789117959.885276:0:20539:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789117959.885924:0:20539:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789117960.039632:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789117960.039661:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88566d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593269504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789117960.039736:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117960.039835:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593269504 00000100:00100000:2.0:1789117960.039844:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593269504 00000100:00100000:2.0:1789117960.039907:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789117960.039918:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593269504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789117960.039946:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789117960.039989:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593269504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117960.039996:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1789117960.040184:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789117960.040227:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88566d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593269504:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789117960.173610:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789117960.967259:0:20589:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789117960.967547:0:20589:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789117961.197186:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117961.281247:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117961.285341:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572190208 00000100:00100000:1.0:1789117961.285378:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572190208 00000100:00100000:1.0:1789117961.285564:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 120 00000100:00100000:1.0:1789117961.285576:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2403:x1876025572190208:12345-192.168.204.30@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789117961.285612:0:17790:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from b49ad67d-7c33-42bd-82d9-5cd0df812c7c@192.168.204.30@tcp t0 exp 0000000000000000 cur 613 last 0 00000020:00000080:1.0:1789117961.285653:0:17790:0:(genops.c:1385:class_connect()) connect: client b49ad67d-7c33-42bd-82d9-5cd0df812c7c, cookie 0xaa253ed19be20fd1 00000100:00080000:1.0:1789117961.285846:0:17790:0:(import.c:65:import_set_state_nolock()) ffff962a81e46800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789117961.285945:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+5:2403:x1876025572190208:12345-192.168.204.30@tcp:250:mount.lustre.0 Request processed in 370us (4710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117961.285970:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 120 00000100:00100000:2.0:1789117961.304437:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117961.304517:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572190336 00000100:00100000:3.0:1789117961.304526:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572190336 00000100:00100000:3.0:1789117961.304593:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 121 00000100:00100000:3.0:1789117961.304604:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+5:15159:x1876025572190336:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789117961.304625:0:17793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117961.304643:0:17793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a88d9bc00/0xaa253ed19be20fd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f20f expref: -99 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117961.304674:0:17793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a88d9bc00/0xaa253ed19be20fd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f20f expref: 6 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117961.304686:0:17793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a88d9bc00/0xaa253ed19be20fd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f20f expref: 6 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117961.304695:0:17793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a88d9bc00, rc 0) 00000100:00100000:3.0:1789117961.304762:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+6:15159:x1876025572190336:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 160us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117961.304769:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 121 00000100:00100000:2.0:1789117961.309586:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117961.309753:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572190464 00000100:00100000:1.0:1789117961.309764:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572190464 00000100:00100000:1.0:1789117961.309842:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 122 00000100:00100000:1.0:1789117961.309852:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+6:15159:x1876025572190464:12345-192.168.204.30@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789117961.309978:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+6:15159:x1876025572190464:12345-192.168.204.30@tcp:501:mount.lustre.0 Request processed in 127us (405us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789117961.309987:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 122 00000100:00100000:1.0:1789117961.319354:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117961.319659:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572190592 00000100:00100000:2.0:1789117961.319672:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572190592 00000100:00100000:2.0:1789117961.319734:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 123 00000100:00100000:2.0:1789117961.319744:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+6:15159:x1876025572190592:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789117961.319763:0:17791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117961.320906:0:17791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d92800/0xaa253ed19be20fdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f216 expref: -99 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117961.320947:0:17791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d92800/0xaa253ed19be20fdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f216 expref: 7 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117961.320961:0:17791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d92800/0xaa253ed19be20fdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f216 expref: 7 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117961.320970:0:17791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92800, rc 0) 00000100:00100000:2.0:1789117961.321228:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+7:15159:x1876025572190592:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 1484us (1883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117961.321236:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 123 00000100:00100000:2.0:1789117961.325383:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117961.325476:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572190720 00000100:00100000:3.0:1789117961.325487:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572190720 00000100:00100000:3.0:1789117961.325547:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 124 00000100:00100000:3.0:1789117961.325568:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+7:15159:x1876025572190720:12345-192.168.204.30@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789117961.325737:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+8:15159:x1876025572190720:12345-192.168.204.30@tcp:501:mount.lustre.0 Request processed in 171us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117961.325762:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 124 00000100:00100000:1.0:1789117961.332500:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117961.332676:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572190848 00000100:00100000:2.0:1789117961.332688:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572190848 00000100:00100000:2.0:1789117961.332753:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 125 00000100:00100000:2.0:1789117961.332763:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+8:15159:x1876025572190848:12345-192.168.204.30@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789117961.333215:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+8:15159:x1876025572190848:12345-192.168.204.30@tcp:503:mount.lustre.0 Request processed in 452us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117961.333231:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 125 00000100:00100000:2.0:1789117961.341291:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117961.348277:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572190976 00000100:00100000:3.0:1789117961.348293:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572190976 00000100:00100000:3.0:1789117961.348365:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 126 00000100:00100000:3.0:1789117961.348376:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+8:15177:x1876025572190976:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789117961.348620:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+8:15177:x1876025572190976:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 246us (7342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117961.348629:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 126 00000100:00100000:3.0:1789117961.423259:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117961.427287:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572191104 00000100:00100000:2.0:1789117961.427502:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572191104 00000100:00100000:2.0:1789117961.427703:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 127 00000100:00100000:2.0:1789117961.427726:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+8:15177:x1876025572191104:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789117961.427997:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+8:15177:x1876025572191104:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 273us (4756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117961.428006:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 127 00000100:00100000:3.0:1789117961.439672:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117961.439948:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572191232 00000100:00100000:1.0:1789117961.439974:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572191232 00000100:00100000:1.0:1789117961.440051:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 128 00000100:00100000:1.0:1789117961.440543:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+8:15177:x1876025572191232:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789117961.443969:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+8:15177:x1876025572191232:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 3410us (4296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117961.444001:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 128 00000100:00100000:1.0:1789117961.453648:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117961.453962:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572191360 00000100:00100000:2.0:1789117961.453978:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572191360 00000100:00100000:2.0:1789117961.454121:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 129 00000100:00100000:2.0:1789117961.454133:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+8:15159:x1876025572191360:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789117961.454162:0:17790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117961.454186:0:17790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d92c00/0xaa253ed19be20fe6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f247 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117961.454225:0:17790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d92c00/0xaa253ed19be20fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f247 expref: 9 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117961.454237:0:17790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d92c00/0xaa253ed19be20fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f247 expref: 9 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117961.454248:0:17790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92c00, rc 0) 00000100:00100000:2.0:1789117961.454338:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+9:15159:x1876025572191360:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 207us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117961.454594:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 129 00000100:00100000:0.0:1789117961.459159:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117961.459576:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572191488 00000100:00100000:2.0:1789117961.459596:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572191488 00000100:00100000:2.0:1789117961.459698:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 130 00000100:00100000:2.0:1789117961.459713:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+9:15159:x1876025572191488:12345-192.168.204.30@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789117961.459760:0:17791:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789117961.459815:0:17791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789117961.459821:0:17791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789117961.459825:0:17791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789117961.459828:0:17791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789117961.459831:0:17791:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1789117961.465956:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+9:15159:x1876025572191488:12345-192.168.204.30@tcp:256:mount.lustre.0 Request processed in 6224us (6799us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117961.465984:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 130 00000100:00100000:3.0:1789117961.471694:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117961.472915:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572191616 00000100:00100000:0.0:1789117961.472943:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572191616 00000100:00100000:0.0:1789117961.474659:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 131 00000100:00100000:0.0:1789117961.474689:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+9:15159:x1876025572191616:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789117961.474734:0:17793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117961.474762:0:17793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbbc11400/0xaa253ed19be20fed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f24e expref: -99 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117961.474818:0:17793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbbc11400/0xaa253ed19be20fed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f24e expref: 10 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117961.474832:0:17793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbbc11400/0xaa253ed19be20fed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f24e expref: 10 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117961.474843:0:17793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbbc11400, rc 0) 00000100:00100000:0.0:1789117961.474947:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+10:15159:x1876025572191616:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 273us (3268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117961.474955:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 131 00000100:00100000:2.0:1789117961.481728:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117961.483665:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572191744 00000100:00100000:1.0:1789117961.483697:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572191744 00000100:00100000:1.0:1789117961.483824:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 132 00000100:00100000:1.0:1789117961.483840:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+10:15159:x1876025572191744:12345-192.168.204.30@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789117961.484598:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+10:15159:x1876025572191744:12345-192.168.204.30@tcp:501:mount.lustre.0 Request processed in 757us (2891us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117961.484648:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 132 00000100:00100000:1.0:1789117961.489982:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117961.490255:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572191872 00000100:00100000:2.0:1789117961.490270:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572191872 00000100:00100000:2.0:1789117961.490386:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 133 00000100:00100000:2.0:1789117961.490398:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+10:15159:x1876025572191872:12345-192.168.204.30@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789117961.490639:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+10:15159:x1876025572191872:12345-192.168.204.30@tcp:503:mount.lustre.0 Request processed in 242us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117961.490650:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 133 00000100:00100000:2.0:1789117961.495839:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117961.496247:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572192000 00000100:00100000:0.0:1789117961.496265:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572192000 00000100:00100000:0.0:1789117961.496350:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 134 00000100:00100000:0.0:1789117961.496363:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+10:15183:x1876025572192000:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789117961.496606:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+10:15183:x1876025572192000:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 244us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117961.496616:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 134 00000100:00100000:3.0:1789117961.504986:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117961.505371:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572192128 00000100:00100000:2.0:1789117961.505385:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572192128 00000100:00100000:2.0:1789117961.505475:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 135 00000100:00100000:2.0:1789117961.505637:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+10:15183:x1876025572192128:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789117961.505865:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+10:15183:x1876025572192128:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 231us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117961.513221:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 135 00000100:00100000:1.0:1789117961.530543:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117961.530846:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572192256 00000100:00100000:2.0:1789117961.530860:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572192256 00000100:00100000:2.0:1789117961.530935:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:2.0:1789117961.530947:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8680bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1876025572192256:12345-192.168.204.30@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789117961.530990:0:17799:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 369a8077-26bb-4780-baf3-16abc59c8ae5@192.168.204.30@tcp t0 exp 0000000000000000 cur 613 last 0 00000020:00000080:2.0:1789117961.531120:0:17799:0:(genops.c:1385:class_connect()) connect: client 369a8077-26bb-4780-baf3-16abc59c8ae5, cookie 0xaa253ed19be20ff4 00000004:00100000:2.0:1789117961.531153:0:17799:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789117961.531430:0:17799:0:(import.c:65:import_set_state_nolock()) ffff962a86cc8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789117961.531721:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8680bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+6:2403:x1876025572192256:12345-192.168.204.30@tcp:38:mount.lustre.0 Request processed in 772us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117961.531730:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:1.0:1789117961.538563:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117961.538614:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117961.538659:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117961.538834:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572192512 00000100:00100000:0.0:1789117961.538847:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572192512 00000100:00100000:0.0:1789117961.538899:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572192384 00000100:00100000:0.0:1789117961.538901:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572192384 00000100:00100000:0.0:1789117961.538961:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572192768 00000100:00100000:0.0:1789117961.538964:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572192768 00000100:00100000:0.0:1789117961.538987:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:0.0:1789117961.539015:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1876025572192512:12345-192.168.204.30@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789117961.539107:0:17799:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 369a8077-26bb-4780-baf3-16abc59c8ae5@192.168.204.30@tcp t0 exp 0000000000000000 cur 613 last 0 00000020:00000080:0.0:1789117961.539179:0:17799:0:(genops.c:1385:class_connect()) connect: client 369a8077-26bb-4780-baf3-16abc59c8ae5, cookie 0xaa253ed19be20ffb 00000004:00100000:0.0:1789117961.539213:0:17799:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789117961.539487:0:17799:0:(import.c:65:import_set_state_nolock()) ffff962a86a7a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789117961.539801:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+6:2403:x1876025572192512:12345-192.168.204.30@tcp:38:mount.lustre.0 Request processed in 785us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117961.539812:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:0.0:1789117961.539841:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:0.0:1789117961.539851:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a868092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+7:0:x1876025572192384:12345-192.168.204.30@tcp:41:mount.lustre.0 00000100:00080000:1.0:1789117961.540194:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1789117961.541766:0:17799:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789117961.543175:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a868092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+7:0:x1876025572192384:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 3310us (4545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117961.543193:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:0.0:1789117961.543238:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:0.0:1789117961.543255:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a868083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+6:15159:x1876025572192768:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789117961.543291:0:17799:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789117961.548279:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117961.548408:0:17800:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789117961.548425:0:17800:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789117961.549506:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572192640 00000100:00100000:1.0:1789117961.549529:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572192640 00000100:00100000:3.0:1789117961.549995:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:3.0:1789117961.550012:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+6:0:x1876025572192640:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789117961.550110:0:20601:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789117961.550233:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+6:0:x1876025572192640:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 226us (1982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117961.550243:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00080000:2.0:1789117961.550675:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789117961.553843:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a868083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+6:15159:x1876025572192768:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 10577us (15164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117961.553863:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:3.0:1789117961.559802:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117961.560690:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572192896 00000100:00100000:1.0:1789117961.560707:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572192896 00000100:00100000:1.0:1789117961.560815:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:1.0:1789117961.560830:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+6:15159:x1876025572192896:12345-192.168.204.30@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789117961.562220:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+6:15159:x1876025572192896:12345-192.168.204.30@tcp:40:mount.lustre.0 Request processed in 1377us (2423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117961.562236:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:3.0:1789117961.574340:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593269632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789117961.574472:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117961.574613:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593269632 00000100:00100000:3.0:1789117961.574624:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593269632 00000100:00100000:3.0:1789117961.574709:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789117961.574720:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593269632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789117961.574784:0:18751:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789117961.574853:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593269632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117961.574862:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789117961.574931:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593269632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117961.575274:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789117961.575290:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593269760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789117961.575337:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117961.575381:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593269760 00000100:00100000:0.0:1789117961.575396:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593269760 00000100:00100000:0.0:1789117961.575434:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789117961.575439:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593269760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789117961.575472:0:17804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789117961.575525:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593269760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117961.575533:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789117961.575582:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593269760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789117961.579673:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117961.579784:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117961.579987:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117961.580619:0:17810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572193280 00000100:00100000:3.0:1789117961.580642:0:17810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572193280 00000100:00100000:0.0:1789117961.580662:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572193024 00000100:00100000:0.0:1789117961.580666:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572193024 00000100:00100000:0.0:1789117961.580712:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572193152 00000100:00100000:0.0:1789117961.580715:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572193152 00000100:00100000:3.0:1789117961.580722:0:17810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:0.0:1789117961.580733:0:19311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:3.0:1789117961.580734:0:17810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88564b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:369a8077-26bb-4780-baf3-16abc59c8ae5+6:15159:x1876025572193280:12345-192.168.204.30@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789117961.580739:0:19311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88567480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2403:x1876025572193024:12345-192.168.204.30@tcp:8:mount.lustre.0 00000100:00100000:3.0:1789117961.580862:0:17810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88564b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:369a8077-26bb-4780-baf3-16abc59c8ae5+6:15159:x1876025572193280:12345-192.168.204.30@tcp:900:mount.lustre.0 Request processed in 129us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117961.580885:0:17810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 3 00010000:00080000:0.0:1789117961.581185:0:19311:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 369a8077-26bb-4780-baf3-16abc59c8ae5@192.168.204.30@tcp t0 exp 0000000000000000 cur 613 last 0 00000100:00100000:2.0:1789117961.581215:0:20393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:2.0:1789117961.581221:0:20393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2403:x1876025572193152:12345-192.168.204.30@tcp:8:mount.lustre.0 00000020:00000080:0.0:1789117961.581234:0:19311:0:(genops.c:1385:class_connect()) connect: client 369a8077-26bb-4780-baf3-16abc59c8ae5, cookie 0xaa253ed19be21002 00010000:00080000:2.0:1789117961.581239:0:20393:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 369a8077-26bb-4780-baf3-16abc59c8ae5@192.168.204.30@tcp t0 exp 0000000000000000 cur 613 last 0 00002000:00100000:0.0:1789117961.581251:0:19311:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 369a8077-26bb-4780-baf3-16abc59c8ae5/ffff962a86a78000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000020:00000080:2.0:1789117961.581259:0:20393:0:(genops.c:1385:class_connect()) connect: client 369a8077-26bb-4780-baf3-16abc59c8ae5, cookie 0xaa253ed19be21009 00002000:00100000:2.0:1789117961.581264:0:20393:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 369a8077-26bb-4780-baf3-16abc59c8ae5/ffff962a86ccc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789117961.581266:0:19311:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:2.0:1789117961.581298:0:20393:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789117961.581510:0:20393:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:0.0:1789117961.581511:0:19311:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789117961.581559:0:20393:0:(import.c:65:import_set_state_nolock()) ffff962a86cc8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789117961.581627:0:20393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+6:2403:x1876025572193152:12345-192.168.204.30@tcp:8:mount.lustre.0 Request processed in 403us (1842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117961.581637:0:20393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00080000:0.0:1789117961.582292:0:19311:0:(import.c:65:import_set_state_nolock()) ffff962a86a7d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789117961.582394:0:19311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88567480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+6:2403:x1876025572193024:12345-192.168.204.30@tcp:8:mount.lustre.0 Request processed in 1651us (2739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117961.582405:0:19311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:3.0:1789117961.586480:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117961.586665:0:17801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572193408 00000100:00100000:1.0:1789117961.586683:0:17801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572193408 00000100:00100000:2.0:1789117961.586935:0:17802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:2.0:1789117961.586952:0:17802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+6:15159:x1876025572193408:12345-192.168.204.30@tcp:33:mount.lustre.0 00000004:00080000:2.0:1789117961.590893:0:17802:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3690us 00000004:00200000:2.0:1789117961.608648:0:17802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789117961.608900:0:17802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+6:15159:x1876025572193408:12345-192.168.204.30@tcp:33:mount.lustre.0 Request processed in 21943us (22431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117961.608913:0:17802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:2.0:1789117961.868878:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117961.876265:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572193536 00000100:00100000:0.0:1789117961.876295:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572193536 00000100:00100000:0.0:1789117961.876418:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:0.0:1789117961.876459:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88566580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+6:15208:x1876025572193536:12345-192.168.204.30@tcp:101:mkdir.0 00010000:00010000:0.0:1789117961.876489:0:17798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117961.876531:0:17798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10600/0xaa253ed19be21010 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f27f expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117961.876641:0:17798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21017 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117961.876659:0:17798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21017 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117961.876678:0:17798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21017 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117961.876749:0:17798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789117961.876753:0:17798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789117961.876811:0:17798:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21017 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117961.876851:0:17798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10600/0xaa253ed19be21010 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f27f expref: 8 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117961.876878:0:17798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21017 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f27f expref: 7 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117961.876888:0:17798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b832cc200) 00010000:00010000:0.0:1789117961.876892:0:17798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789117961.876897:0:17798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbbc11600, rc 0) 00000100:00100000:0.0:1789117961.877012:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88566580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+7:15208:x1876025572193536:12345-192.168.204.30@tcp:101:mkdir.0 Request processed in 555us (8161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117961.878296:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:3.0:1789117962.085598:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117962.085636:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a868192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593269888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117962.085739:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117962.086228:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593270144:0@lo:400:kworker.0 00000100:00100000:3.0:1789117962.086268:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117962.086302:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593270656:0@lo:400:kworker.0 00000100:00100000:3.0:1789117962.086327:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117962.086344:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876025593271168:0@lo:400:kworker.0 00000100:00100000:3.0:1789117962.086376:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117962.086400:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789117962.086428:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593270016:0@lo:400:kworker.0 00000100:00100000:3.0:1789117962.086464:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117962.086485:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593270528:0@lo:400:kworker.0 00000100:00100000:3.0:1789117962.086507:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117962.086522:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593271040:0@lo:400:kworker.0 00000100:00100000:3.0:1789117962.086555:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117962.086589:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593270016 00000100:00100000:3.0:1789117962.086598:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593270016 00000100:00100000:3.0:1789117962.086653:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789117962.086664:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+24:3647:x1876025593270016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117962.086727:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+24:3647:x1876025593270016:12345-0@lo:400:kworker.0 Request processed in 64us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117962.086736:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789117962.086777:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593270272:0@lo:400:kworker.0 00000100:00100000:3.0:1789117962.086803:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117962.086821:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593270784:0@lo:400:kworker.0 00000100:00100000:3.0:1789117962.086843:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117962.086857:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593271296:0@lo:400:kworker.0 00000100:00100000:3.0:1789117962.086875:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117962.086890:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789117962.086895:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593270400:0@lo:400:kworker.0 00000100:00100000:3.0:1789117962.086914:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117962.086929:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a49680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593270912:0@lo:400:kworker.0 00000100:00100000:3.0:1789117962.086950:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117962.086959:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593271424:0@lo:400:kworker.0 00000100:00100000:3.0:1789117962.086987:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117962.087023:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593270016:0@lo:400:kworker.0 00000100:00100000:3.0:1789117962.087081:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593271168 00000100:00100000:3.0:1789117962.087086:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593271168 00000100:00100000:3.0:1789117962.087135:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593270528 00000100:00100000:3.0:1789117962.087138:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593270528 00000100:00100000:3.0:1789117962.087149:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593271040 00000100:00100000:3.0:1789117962.087151:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593271040 00000100:00100000:3.0:1789117962.087162:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593271296 00000100:00100000:3.0:1789117962.087164:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593271296 00000100:00100000:3.0:1789117962.087174:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593270912 00000100:00100000:3.0:1789117962.087176:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593270912 00000100:00100000:3.0:1789117962.087185:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593271424 00000100:00100000:3.0:1789117962.087187:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593271424 00000100:00100000:3.0:1789117962.087199:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789117962.087205:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876025593271168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117962.087248:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876025593271168:12345-0@lo:400:kworker.0 Request processed in 43us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117962.087254:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1789117962.087288:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a4a1c0 x1876025593271168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117962.087303:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876025593271168:0@lo:400:kworker.0 00000100:00100000:3.0:1789117962.087321:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789117962.087327:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593270528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117962.087361:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593270528:12345-0@lo:400:kworker.0 Request processed in 34us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117962.087367:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789117962.087401:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593270528:0@lo:400:kworker.0 00000100:00100000:3.0:1789117962.087420:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789117962.087427:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593271040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117962.087460:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593271040:12345-0@lo:400:kworker.0 Request processed in 34us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117962.087467:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789117962.087492:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593271040:0@lo:400:kworker.0 00000100:00100000:3.0:1789117962.087507:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789117962.087513:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593271296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117962.087559:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593271296:12345-0@lo:400:kworker.0 Request processed in 46us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117962.087565:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789117962.087589:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593271296:0@lo:400:kworker.0 00000100:00100000:3.0:1789117962.087605:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789117962.087611:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593270912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117962.087641:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593270912:12345-0@lo:400:kworker.0 Request processed in 31us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117962.087648:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789117962.087671:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a49680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593270912:0@lo:400:kworker.0 00000100:00100000:3.0:1789117962.087686:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789117962.087693:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593271424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117962.087723:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593271424:12345-0@lo:400:kworker.0 Request processed in 31us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117962.087739:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1789117962.087763:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a4c780 x1876025593271424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117962.087773:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593271424:0@lo:400:kworker.0 00000100:00100000:0.0:1789117962.088389:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba071a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593271552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117962.088442:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117962.088504:0:19315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593269888 00000100:00100000:0.0:1789117962.088512:0:19315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593269888 00000100:00100000:0.0:1789117962.088570:0:19315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593271552 00000100:00100000:0.0:1789117962.088573:0:19315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593271552 00000100:00100000:0.0:1789117962.088596:0:19315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789117962.088602:0:19315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593269888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789117962.088625:0:19315:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789117962.088673:0:19315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593269888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (2935us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117962.088680:0:19315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789117962.088696:0:19315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789117962.088702:0:19315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0719e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876025593271552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789117962.088712:0:19315:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789117962.088738:0:19315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0719e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876025593271552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117962.088745:0:19315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789117962.088767:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593270144 00000100:00100000:0.0:1789117962.088771:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593270144 00000100:00100000:0.0:1789117962.088799:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593270656 00000100:00100000:0.0:1789117962.088802:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593270656 00000100:00100000:0.0:1789117962.088816:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789117962.088822:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593270144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117962.088862:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593270144:12345-0@lo:400:kworker.0 Request processed in 40us (2594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117962.088881:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789117962.088893:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789117962.088899:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593270656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117962.088947:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593270656:12345-0@lo:400:kworker.0 Request processed in 48us (2619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117962.088953:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789117962.089000:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba071a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593271552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117962.089046:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593270144:0@lo:400:kworker.0 00000100:00100000:0.0:1789117962.089095:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593270656:0@lo:400:kworker.0 00000100:00080000:2.0:1789117962.089338:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789117962.089345:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789117962.089348:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789117962.089369:0:20393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593270272 00000100:00100000:2.0:1789117962.089374:0:20393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593270272 00000100:00100000:2.0:1789117962.089416:0:20393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593270784 00000100:00100000:2.0:1789117962.089419:0:20393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593270784 00000100:00100000:2.0:1789117962.089435:0:20393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593270400 00000100:00100000:2.0:1789117962.089438:0:20393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593270400 00000100:00100000:2.0:1789117962.089451:0:20393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789117962.089457:0:20393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593270272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117962.089501:0:20393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593270272:12345-0@lo:400:kworker.0 Request processed in 44us (2697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117962.089518:0:20393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789117962.089530:0:20393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789117962.089554:0:20393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593270784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117962.089585:0:20393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593270784:12345-0@lo:400:kworker.0 Request processed in 49us (2741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117962.089591:0:20393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789117962.089601:0:20393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789117962.089607:0:20393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1876025593270400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117962.089634:0:20393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1876025593270400:12345-0@lo:400:kworker.0 Request processed in 27us (2719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117962.089639:0:20393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789117962.089653:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117962.091823:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a868192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593269888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789117962.091900:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593270400:0@lo:400:kworker.0 00000100:00100000:0.0:1789117962.091917:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593270272:0@lo:400:kworker.0 00000100:00100000:0.0:1789117962.091932:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593270784:0@lo:400:kworker.0 00000100:00100000:1.0:1789117962.095762:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117962.095824:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593271680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117962.095961:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117962.096453:0:19315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593271680 00000100:00100000:2.0:1789117962.096468:0:19315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593271680 00000100:00100000:2.0:1789117962.096724:0:19315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789117962.096738:0:19315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593271680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789117962.096845:0:19315:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789117962.096925:0:19315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593271680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 190us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117962.096933:0:19315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789117962.097200:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593271680:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789117962.213621:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789117962.277982:0:18556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:2.0:1789117962.602017:0:20127:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 369a8077-26bb-4780-baf3-16abc59c8ae5 00000001:00080000:2.0:1789117962.602051:0:20127:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:3.0:1789117963.237639:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117963.964497:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117963.967954:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572193664 00000100:00100000:3.0:1789117963.967981:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572193664 00000100:00100000:3.0:1789117963.968162:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:3.0:1789117963.968180:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+7:15260:x1876025572193664:12345-192.168.204.30@tcp:41:lfs.0 00000004:00000024:3.0:1789117963.968258:0:20601:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789117963.968432:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+7:15260:x1876025572193664:12345-192.168.204.30@tcp:41:lfs.0 Request processed in 256us (3949us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117963.968441:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00080000:2.0:1789117963.968642:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117963.980610:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117963.981097:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572193792 00000100:00100000:1.0:1789117963.981111:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572193792 00000100:00100000:1.0:1789117963.981251:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:1.0:1789117963.981264:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+6:15260:x1876025572193792:12345-192.168.204.30@tcp:41:lfs.0 00000004:00000024:1.0:1789117963.981318:0:17800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789117963.981462:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+6:15260:x1876025572193792:12345-192.168.204.30@tcp:41:lfs.0 Request processed in 200us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117963.981470:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00080000:2.0:1789117963.981999:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789117963.989393:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117963.989540:0:19315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572193920 00000100:00100000:2.0:1789117963.989557:0:19315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572193920 00000100:00100000:2.0:1789117963.989698:0:19315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:2.0:1789117963.989712:0:19315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a868192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:369a8077-26bb-4780-baf3-16abc59c8ae5+6:15260:x1876025572193920:12345-192.168.204.30@tcp:13:lfs.0 00002000:00000024:2.0:1789117963.989768:0:19315:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789117963.989908:0:19315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a868192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:369a8077-26bb-4780-baf3-16abc59c8ae5+6:15260:x1876025572193920:12345-192.168.204.30@tcp:13:lfs.0 Request processed in 199us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117963.989918:0:19315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00080000:0.0:1789117963.990009:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117963.992342:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117963.992463:0:19315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572194048 00000100:00100000:2.0:1789117963.992477:0:19315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572194048 00000100:00100000:2.0:1789117963.992572:0:19315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:2.0:1789117963.992585:0:19315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:369a8077-26bb-4780-baf3-16abc59c8ae5+5:15260:x1876025572194048:12345-192.168.204.30@tcp:13:lfs.0 00002000:00000024:2.0:1789117963.992629:0:19315:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789117963.992770:0:19315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:369a8077-26bb-4780-baf3-16abc59c8ae5+5:15260:x1876025572194048:12345-192.168.204.30@tcp:13:lfs.0 Request processed in 187us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117963.992779:0:19315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00080000:0.0:1789117963.993019:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789117964.176295:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117964.176453:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572194176 00000100:00100000:1.0:1789117964.176470:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572194176 00000100:00100000:1.0:1789117964.176574:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 137 00000100:00100000:1.0:1789117964.176589:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+10:15290:x1876025572194176:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789117964.176620:0:17791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117964.176652:0:17791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbf70da00/0xaa253ed19be2101e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f286 expref: -99 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117964.176701:0:17791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbf70da00/0xaa253ed19be2101e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f286 expref: 11 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117964.176717:0:17791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbf70da00/0xaa253ed19be2101e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f286 expref: 11 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117964.176729:0:17791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70da00, rc 0) 00000100:00100000:1.0:1789117964.177134:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+11:15290:x1876025572194176:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 547us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117964.177143:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 137 00000100:00100000:3.0:1789117964.191327:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117964.194665:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572194304 00000100:00100000:2.0:1789117964.194686:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572194304 00000100:00100000:2.0:1789117964.195107:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 138 00000100:00100000:2.0:1789117964.195123:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+11:15290:x1876025572194304:12345-192.168.204.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789117964.195420:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+11:15290:x1876025572194304:12345-192.168.204.30@tcp:501:mount.lustre.0 Request processed in 301us (4113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117964.195430:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 138 00000100:00100000:0.0:1789117964.197254:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117964.197342:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572194432 00000100:00100000:3.0:1789117964.197354:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572194432 00000100:00100000:3.0:1789117964.197417:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 139 00000100:00100000:3.0:1789117964.197427:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+11:15290:x1876025572194432:12345-192.168.204.30@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789117964.197665:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+11:15290:x1876025572194432:12345-192.168.204.30@tcp:503:mount.lustre.0 Request processed in 239us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117964.197674:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 139 00000100:00100000:3.0:1789117964.205245:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117964.206725:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572194560 00000100:00100000:2.0:1789117964.206817:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572194560 00000100:00100000:2.0:1789117964.206956:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 140 00000100:00100000:2.0:1789117964.206971:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+11:15298:x1876025572194560:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789117964.208662:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+11:15298:x1876025572194560:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 1675us (3415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117964.208681:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 140 00000100:00100000:0.0:1789117964.245416:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117964.245602:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572194688 00000100:00100000:1.0:1789117964.245616:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572194688 00000100:00100000:1.0:1789117964.245708:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 141 00000100:00100000:1.0:1789117964.245720:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+11:15298:x1876025572194688:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789117964.246263:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+11:15298:x1876025572194688:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 541us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117964.246274:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 141 00000100:00100000:0.0:1789117964.250984:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117964.251835:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572194816 00000100:00100000:2.0:1789117964.251855:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572194816 00000100:00100000:2.0:1789117964.252606:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 142 00000100:00100000:2.0:1789117964.252624:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+11:15298:x1876025572194816:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789117964.253871:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+11:15298:x1876025572194816:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 1237us (2897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117964.253889:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 142 00010000:00010000:2.0:1789117964.263020:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117964.268239:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117964.270665:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572194944 00000100:00100000:1.0:1789117964.270689:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572194944 00000100:00100000:1.0:1789117964.270814:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 143 00000100:00100000:1.0:1789117964.270831:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+11:15290:x1876025572194944:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789117964.270864:0:17791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117964.270913:0:17791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbf70c800/0xaa253ed19be21025 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f2b7 expref: -99 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117964.270978:0:17791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbf70c800/0xaa253ed19be21025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2b7 expref: 12 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117964.271002:0:17791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbf70c800/0xaa253ed19be21025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2b7 expref: 12 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117964.271016:0:17791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70c800, rc 0) 00000100:00100000:1.0:1789117964.271187:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+12:15290:x1876025572194944:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 359us (2973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117964.271197:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 143 00000100:00100000:0.0:1789117964.288485:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117964.288894:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572195072 00000100:00100000:2.0:1789117964.288912:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572195072 00000100:00100000:2.0:1789117964.289379:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 144 00000100:00100000:2.0:1789117964.289395:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+12:15290:x1876025572195072:12345-192.168.204.30@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789117964.289436:0:17790:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789117964.289472:0:17790:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789117964.289477:0:17790:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789117964.289481:0:17790:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789117964.289485:0:17790:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789117964.289488:0:17790:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1789117964.296238:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+12:15290:x1876025572195072:12345-192.168.204.30@tcp:256:mount.lustre.0 Request processed in 6818us (7741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117964.296265:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 144 00000100:00100000:3.0:1789117964.299789:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117964.300135:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572195200 00000100:00100000:0.0:1789117964.300166:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572195200 00000100:00100000:0.0:1789117964.300242:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 145 00000100:00100000:0.0:1789117964.300255:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+12:15290:x1876025572195200:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789117964.300279:0:17793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117964.300305:0:17793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbbc11800/0xaa253ed19be2102c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f2be expref: -99 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117964.300346:0:17793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbbc11800/0xaa253ed19be2102c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2be expref: 13 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117964.300360:0:17793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbbc11800/0xaa253ed19be2102c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2be expref: 13 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117964.300371:0:17793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbbc11800, rc 0) 00000100:00100000:0.0:1789117964.300443:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:15290:x1876025572195200:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 190us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117964.300451:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 145 00000100:00100000:0.0:1789117964.309736:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117964.309993:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572195328 00000100:00100000:2.0:1789117964.310015:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572195328 00000100:00100000:2.0:1789117964.310177:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 146 00000100:00100000:2.0:1789117964.310192:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:15290:x1876025572195328:12345-192.168.204.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789117964.310467:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:15290:x1876025572195328:12345-192.168.204.30@tcp:501:mount.lustre.0 Request processed in 278us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117964.310477:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 146 00000100:00100000:0.0:1789117964.315041:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117964.315237:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572195456 00000100:00100000:3.0:1789117964.315254:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572195456 00000100:00100000:3.0:1789117964.315362:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 147 00000100:00100000:3.0:1789117964.315380:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:15290:x1876025572195456:12345-192.168.204.30@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789117964.315675:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:15290:x1876025572195456:12345-192.168.204.30@tcp:503:mount.lustre.0 Request processed in 299us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117964.315685:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 147 00000100:00100000:3.0:1789117964.321566:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117964.321713:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572195584 00000100:00100000:0.0:1789117964.321731:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572195584 00000100:00100000:0.0:1789117964.321845:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 148 00000100:00100000:0.0:1789117964.321859:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:15301:x1876025572195584:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789117964.322191:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:15301:x1876025572195584:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 333us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117964.322200:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 148 00000100:00100000:0.0:1789117964.327614:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117964.327875:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572195712 00000100:00100000:2.0:1789117964.327900:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572195712 00000100:00100000:3.0:1789117964.328124:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 149 00000100:00100000:3.0:1789117964.328140:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:15301:x1876025572195712:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789117964.328376:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:15301:x1876025572195712:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 239us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117964.328386:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 149 00000100:00100000:1.0:1789117964.336933:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117964.337391:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572195840 00000100:00100000:3.0:1789117964.337410:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572195840 00000100:00100000:3.0:1789117964.337566:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:3.0:1789117964.337578:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd108f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1876025572195840:12345-192.168.204.30@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789117964.337685:0:20601:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 3a40d558-cfad-4484-8c6e-52e7fbfb6447@192.168.204.30@tcp t0 exp 0000000000000000 cur 616 last 0 00000020:00000080:3.0:1789117964.337735:0:20601:0:(genops.c:1385:class_connect()) connect: client 3a40d558-cfad-4484-8c6e-52e7fbfb6447, cookie 0xaa253ed19be21033 00000004:00100000:3.0:1789117964.337772:0:20601:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789117964.338256:0:20601:0:(import.c:65:import_set_state_nolock()) ffff962a86cc0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789117964.338380:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd108f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:2403:x1876025572195840:12345-192.168.204.30@tcp:38:mount.lustre.0 Request processed in 801us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117964.338391:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:1.0:1789117964.338646:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117964.338687:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572196096 00000100:00100000:1.0:1789117964.338694:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572196096 00000100:00100000:1.0:1789117964.338733:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:1.0:1789117964.338739:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd1083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1876025572196096:12345-192.168.204.30@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789117964.338764:0:17800:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 3a40d558-cfad-4484-8c6e-52e7fbfb6447@192.168.204.30@tcp t0 exp 0000000000000000 cur 616 last 0 00000020:00000080:1.0:1789117964.338797:0:17800:0:(genops.c:1385:class_connect()) connect: client 3a40d558-cfad-4484-8c6e-52e7fbfb6447, cookie 0xaa253ed19be2103a 00000004:00100000:1.0:1789117964.338817:0:17800:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789117964.338906:0:17800:0:(import.c:65:import_set_state_nolock()) ffff962a885d2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789117964.338936:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd1083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:2403:x1876025572196096:12345-192.168.204.30@tcp:38:mount.lustre.0 Request processed in 197us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117964.338944:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:1.0:1789117964.355646:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117964.355693:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117964.355735:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117964.355919:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572195968 00000100:00100000:0.0:1789117964.355934:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572195968 00000100:00100000:0.0:1789117964.356098:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572196352 00000100:00100000:0.0:1789117964.356102:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572196352 00000100:00100000:0.0:1789117964.356119:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572196224 00000100:00100000:0.0:1789117964.356122:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572196224 00000100:00100000:0.0:1789117964.356147:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:0.0:1789117964.356163:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+7:0:x1876025572195968:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789117964.356215:0:17798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789117964.356318:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+7:0:x1876025572195968:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 159us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117964.356327:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:0.0:1789117964.356351:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:0.0:1789117964.356358:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd10b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:15290:x1876025572196352:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789117964.356370:0:17798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789117964.356395:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd10b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:15290:x1876025572196352:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 37us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117964.356401:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:0.0:1789117964.356413:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:0.0:1789117964.356421:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd10a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:0:x1876025572196224:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789117964.356434:0:17798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00080000:1.0:1789117964.356664:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789117964.356670:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117964.359726:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd10a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:0:x1876025572196224:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 3281us (3966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117964.359747:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:1.0:1789117964.367989:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117964.368194:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572196480 00000100:00100000:3.0:1789117964.368210:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572196480 00000100:00100000:3.0:1789117964.368308:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:3.0:1789117964.368322:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd10bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:15290:x1876025572196480:12345-192.168.204.30@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789117964.368599:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd10bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:15290:x1876025572196480:12345-192.168.204.30@tcp:40:mount.lustre.0 Request processed in 278us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117964.368610:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:2.0:1789117964.391531:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117964.391592:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117964.391636:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117964.391872:0:17810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572196864 00000100:00100000:3.0:1789117964.391894:0:17810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572196864 00000100:00100000:3.0:1789117964.391965:0:17810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:3.0:1789117964.391979:0:17810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:15290:x1876025572196864:12345-192.168.204.30@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789117964.392121:0:17810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:15290:x1876025572196864:12345-192.168.204.30@tcp:900:mount.lustre.0 Request processed in 145us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117964.392131:0:17810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:1.0:1789117964.392386:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572196608 00000100:00100000:1.0:1789117964.392391:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572196608 00000100:00100000:1.0:1789117964.392422:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572196736 00000100:00100000:1.0:1789117964.392425:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572196736 00000100:00100000:1.0:1789117964.392460:0:19311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:1.0:1789117964.392466:0:19311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88566d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2403:x1876025572196608:12345-192.168.204.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789117964.392513:0:19311:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 3a40d558-cfad-4484-8c6e-52e7fbfb6447@192.168.204.30@tcp t0 exp 0000000000000000 cur 616 last 0 00000020:00000080:1.0:1789117964.392558:0:19311:0:(genops.c:1385:class_connect()) connect: client 3a40d558-cfad-4484-8c6e-52e7fbfb6447, cookie 0xaa253ed19be21041 00002000:00100000:1.0:1789117964.392579:0:19311:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3a40d558-cfad-4484-8c6e-52e7fbfb6447/ffff962a885d1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789117964.392615:0:19311:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789117964.392732:0:19311:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789117964.392770:0:19311:0:(import.c:65:import_set_state_nolock()) ffff962a885d3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789117964.392811:0:19311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88566d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:2403:x1876025572196608:12345-192.168.204.30@tcp:8:mount.lustre.0 Request processed in 344us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117964.392819:0:19311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:1.0:1789117964.392839:0:19311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:1.0:1789117964.392844:0:19311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88565a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2403:x1876025572196736:12345-192.168.204.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789117964.392863:0:19311:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 3a40d558-cfad-4484-8c6e-52e7fbfb6447@192.168.204.30@tcp t0 exp 0000000000000000 cur 616 last 0 00000020:00000080:1.0:1789117964.392882:0:19311:0:(genops.c:1385:class_connect()) connect: client 3a40d558-cfad-4484-8c6e-52e7fbfb6447, cookie 0xaa253ed19be21048 00002000:00100000:1.0:1789117964.392889:0:19311:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3a40d558-cfad-4484-8c6e-52e7fbfb6447/ffff962a885d2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789117964.392896:0:19311:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789117964.392952:0:19311:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789117964.392969:0:19311:0:(import.c:65:import_set_state_nolock()) ffff962a885d7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789117964.392993:0:19311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88565a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:2403:x1876025572196736:12345-192.168.204.30@tcp:8:mount.lustre.0 Request processed in 148us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117964.393000:0:19311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:1.0:1789117964.402324:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117964.403215:0:17801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572196992 00000100:00100000:2.0:1789117964.403236:0:17801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572196992 00000100:00100000:2.0:1789117964.403340:0:17801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00100000:2.0:1789117964.403353:0:17801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd1092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:15290:x1876025572196992:12345-192.168.204.30@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789117964.403565:0:17801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789117964.403692:0:17801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd1092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:15290:x1876025572196992:12345-192.168.204.30@tcp:33:mount.lustre.0 Request processed in 340us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117964.403700:0:17801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00100000:1.0:1789117964.598748:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117964.598928:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572197120 00000100:00100000:2.0:1789117964.598945:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572197120 00000100:00100000:2.0:1789117964.599043:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:2.0:1789117964.599084:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd10a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:15326:x1876025572197120:12345-192.168.204.30@tcp:101:mkdir.0 00010000:00010000:2.0:1789117964.599127:0:17798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117964.599171:0:17798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be2104f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f2ef expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117964.599294:0:17798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21056 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117964.599346:0:17798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21056 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117964.599367:0:17798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21056 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117964.599500:0:17798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789117964.599505:0:17798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789117964.599543:0:17798:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21056 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117964.599662:0:17798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be2104f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2ef expref: 8 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117964.599689:0:17798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21056 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2ef expref: 7 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117964.599703:0:17798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b832cc200) 00010000:00010000:2.0:1789117964.599708:0:17798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789117964.599713:0:17798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93600, rc 0) 00000100:00100000:2.0:1789117964.599976:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd10a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+7:15326:x1876025572197120:12345-192.168.204.30@tcp:101:mkdir.0 Request processed in 920us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117964.599987:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:3.0:1789117965.160371:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789117965.163882:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a885643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593271808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789117965.164010:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117965.164347:0:19315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593271808 00000100:00100000:2.0:1789117965.164361:0:19315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593271808 00000100:00100000:2.0:1789117965.164469:0:19315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789117965.164494:0:19315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593271808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789117965.164534:0:19315:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789117965.164654:0:19315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593271808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 174us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117965.164663:0:19315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789117965.164791:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a885643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593271808:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789117965.166569:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789117965.285861:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789117965.742346:0:17834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789117966.313586:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117966.695445:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593271936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789117966.695575:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117966.695937:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593271936 00000100:00100000:0.0:1789117966.695950:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593271936 00000100:00100000:0.0:1789117966.696040:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789117966.696100:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593271936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789117966.696157:0:17803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789117966.696244:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593271936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 149us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117966.696253:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789117966.696477:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593271936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789117966.696822:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a885670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593272064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117966.696876:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117966.697010:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593272064 00000100:00100000:2.0:1789117966.697018:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593272064 00000100:00100000:2.0:1789117966.697099:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789117966.697109:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd10b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593272064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789117966.697143:0:17804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789117966.697300:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a885670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593272064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117966.697490:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd10b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593272064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 382us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117966.697499:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789117967.206509:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117967.206558:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593272192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117967.206673:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117967.206746:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbd109680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593272320:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789117967.206779:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117967.206827:0:19315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593272192 00000100:00100000:1.0:1789117967.206838:0:19315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593272192 00000100:00100000:1.0:1789117967.206902:0:19315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593272320 00000100:00100000:1.0:1789117967.206905:0:19315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593272320 00000100:00100000:1.0:1789117967.206930:0:19315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789117967.206940:0:19315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd109a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593272192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789117967.206984:0:19315:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789117967.207036:0:19315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd109a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593272192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117967.207045:0:19315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789117967.207087:0:19315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789117967.207095:0:19315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd10ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593272320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789117967.207109:0:19315:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789117967.207138:0:19315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd10ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593272320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117967.207144:0:19315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1789117967.207171:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789117967.207226:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbd109680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593272320:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789117967.207262:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1789117967.207284:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593272192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117967.207893:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593272704:0@lo:400:kworker.0 00000100:00100000:2.0:1789117967.208234:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593272832:0@lo:400:kworker.0 00000100:00100000:1.0:1789117967.208928:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593272448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117967.216514:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117967.216628:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593273344:0@lo:400:kworker.0 00000100:00100000:2.0:1789117967.216686:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117967.220407:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593273856:0@lo:400:kworker.0 00000100:00100000:2.0:1789117967.220549:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117967.220655:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593273344 00000100:00100000:2.0:1789117967.220669:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593273344 00000100:00100000:2.0:1789117967.222709:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593273856 00000100:00100000:2.0:1789117967.222727:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593273856 00000100:00100000:2.0:1789117967.223270:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789117967.223292:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88566940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593273344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117967.223480:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88566940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593273344:12345-0@lo:400:kworker.0 Request processed in 197us (6792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117967.223489:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789117967.223510:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789117967.223545:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593273856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117967.223583:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593273856:12345-0@lo:400:kworker.0 Request processed in 40us (3036us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117967.223590:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789117967.223681:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593273344:0@lo:400:kworker.0 00010000:00080000:2.0:1789117967.225301:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87fa8000 x1876025593273856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117967.225331:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593273856:0@lo:400:kworker.0 00000100:00100000:2.0:1789117967.227166:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593272832 00000100:00100000:2.0:1789117967.227185:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593272832 00000100:00100000:2.0:1789117967.227316:0:19311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789117967.227330:0:19311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593272832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117967.228190:0:19311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593272832:12345-0@lo:400:kworker.0 Request processed in 859us (11697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117967.228203:0:19311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789117967.228282:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593272832:0@lo:400:kworker.0 00000100:00100000:0.0:1789117967.228708:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117967.228785:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593273216:0@lo:400:kworker.0 00000100:00100000:0.0:1789117967.228848:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117967.228869:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876025593273728:0@lo:400:kworker.0 00000100:00100000:0.0:1789117967.228895:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117967.229146:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789117967.229157:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593272576:0@lo:400:kworker.0 00000100:00100000:0.0:1789117967.229198:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117967.229233:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593273088:0@lo:400:kworker.0 00000100:00100000:0.0:1789117967.229258:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117967.229279:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876025593273600:0@lo:400:kworker.0 00000100:00100000:0.0:1789117967.229303:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117967.229346:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593272704 00000100:00100000:1.0:1789117967.229378:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117967.229427:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593272960:0@lo:400:kworker.0 00000100:00100000:1.0:1789117967.229468:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117967.229490:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593273472:0@lo:400:kworker.0 00000100:00100000:1.0:1789117967.229515:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117967.229552:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593273728 00000100:00100000:1.0:1789117967.229560:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593273728 00000100:00100000:1.0:1789117967.229630:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593273600 00000100:00100000:1.0:1789117967.229633:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593273600 00000100:00100000:1.0:1789117967.229654:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593272960 00000100:00100000:1.0:1789117967.229656:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593272960 00000100:00100000:1.0:1789117967.229669:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593273472 00000100:00100000:1.0:1789117967.229671:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593273472 00000100:00100000:1.0:1789117967.229691:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789117967.229700:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87faa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876025593273728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117967.229767:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87faa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876025593273728:12345-0@lo:400:kworker.0 Request processed in 68us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117967.229776:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789117967.229793:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789117967.229800:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876025593273600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117967.229829:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876025593273600:12345-0@lo:400:kworker.0 Request processed in 30us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117967.229835:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789117967.229845:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789117967.229851:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd109e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593272960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117967.229929:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd109e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593272960:12345-0@lo:400:kworker.0 Request processed in 78us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117967.229936:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789117967.229936:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593272704 00000100:00100000:1.0:1789117967.229954:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789117967.229964:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd10a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593273472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117967.229984:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593273088 00000100:00100000:0.0:1789117967.229989:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593273088 00000100:00100000:1.0:1789117967.230000:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd10a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593273472:12345-0@lo:400:kworker.0 Request processed in 39us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117967.230009:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789117967.230019:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593272704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117967.230026:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1789117967.230082:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789117967.230088:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789117967.230092:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789117967.230110:0:19315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593272448 00000100:00100000:0.0:1789117967.230114:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593272704:12345-0@lo:400:kworker.0 Request processed in 96us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117967.230116:0:19315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593272448 00000100:00100000:0.0:1789117967.230131:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789117967.230151:0:19315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789117967.230154:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789117967.230164:0:19315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd109680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593272448:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117967.230168:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593273088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117967.230207:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593273088:12345-0@lo:400:kworker.0 Request processed in 44us (947us total) trans 0 rc 0/0 00002000:00000024:1.0:1789117967.230212:0:19315:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789117967.230216:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789117967.230241:0:20393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593273216 00000100:00100000:0.0:1789117967.230245:0:20393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593273216 00000100:00100000:1.0:1789117967.230263:0:19315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd109680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593272448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117967.230272:0:19315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789117967.230286:0:20393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789117967.230297:0:20393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb0e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593273216:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789117967.230300:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117967.230335:0:20393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb0e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593273216:12345-0@lo:400:kworker.0 Request processed in 41us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117967.230337:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593273088:0@lo:400:kworker.0 00000100:00100000:0.0:1789117967.230346:0:20393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1789117967.230360:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87fa92c0 x1876025593273600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117967.230375:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876025593273600:0@lo:400:kworker.0 00000100:00100000:1.0:1789117967.230392:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593272704:0@lo:400:kworker.0 00000100:00100000:1.0:1789117967.230420:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593273216:0@lo:400:kworker.0 00000100:00100000:1.0:1789117967.230452:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876025593273728:0@lo:400:kworker.0 00000100:00100000:1.0:1789117967.230510:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593272448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117967.230523:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593272960:0@lo:400:kworker.0 00000100:00100000:1.0:1789117967.230533:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593273472:0@lo:400:kworker.0 00000100:00100000:1.0:1789117967.230595:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593272576 00000100:00100000:1.0:1789117967.230599:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593272576 00000100:00100000:1.0:1789117967.230633:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789117967.230642:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+24:3647:x1876025593272576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117967.230685:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+24:3647:x1876025593272576:12345-0@lo:400:kworker.0 Request processed in 45us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117967.230692:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789117967.230745:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593272576:0@lo:400:kworker.0 00010000:00010000:1.0:1789117967.334557:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789117967.725175:0:19307:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3a40d558-cfad-4484-8c6e-52e7fbfb6447 00000001:00100000:2.0:1789117967.725193:0:19307:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 369a8077-26bb-4780-baf3-16abc59c8ae5 00000001:00100000:1.0:1789117967.725663:0:18534:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3a40d558-cfad-4484-8c6e-52e7fbfb6447 00000001:00100000:1.0:1789117967.725673:0:18534:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 369a8077-26bb-4780-baf3-16abc59c8ae5 00000001:00100000:2.0:1789117967.725741:0:17778:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3a40d558-cfad-4484-8c6e-52e7fbfb6447 00000001:00100000:2.0:1789117967.725749:0:17778:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 369a8077-26bb-4780-baf3-16abc59c8ae5 00000001:02000400:3.0:1789117967.835651:0:20688:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789117968.357453:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117969.381348:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117969.762911:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117969.762957:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117969.762980:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117969.762999:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117969.763016:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117969.763036:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117969.763077:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117969.763099:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117969.763119:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117969.763145:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572197760 00000100:00100000:0.0:1789117969.763154:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572197760 00000100:00100000:0.0:1789117969.763214:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572198272 00000100:00100000:0.0:1789117969.763218:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572198272 00000100:00100000:0.0:1789117969.763233:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572197632 00000100:00100000:0.0:1789117969.763244:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572197632 00000100:00100000:0.0:1789117969.763261:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572198144 00000100:00100000:0.0:1789117969.763264:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572198144 00000100:00100000:0.0:1789117969.763279:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:0.0:1789117969.763288:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87faad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+5:2406:x1876025572197760:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117969.763367:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87faad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+5:2406:x1876025572197760:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 80us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117969.763375:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:0.0:1789117969.763408:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:0.0:1789117969.763415:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf776d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:2406:x1876025572198272:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117969.763442:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf776d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:2406:x1876025572198272:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 28us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117969.763448:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:0.0:1789117969.763458:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:0.0:1789117969.763464:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf775680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+5:2406:x1876025572197632:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117969.763486:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf775680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+5:2406:x1876025572197632:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 23us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117969.763492:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:0.0:1789117969.763502:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:0.0:1789117969.763509:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf777840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2406:x1876025572198144:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117969.763531:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf777840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2406:x1876025572198144:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 22us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117969.763537:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:2.0:1789117969.763614:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572197248 00000100:00100000:2.0:1789117969.763619:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572197248 00000100:00100000:2.0:1789117969.763663:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 151 00000100:00100000:2.0:1789117969.763669:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:2406:x1876025572197248:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117969.763704:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:2406:x1876025572197248:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 35us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117969.763712:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 151 00000100:00100000:1.0:1789117969.763801:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572197504 00000100:00100000:1.0:1789117969.763805:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572197504 00000100:00100000:1.0:1789117969.763844:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572198016 00000100:00100000:1.0:1789117969.763847:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572198016 00000100:00100000:1.0:1789117969.763860:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572197376 00000100:00100000:1.0:1789117969.763862:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572197376 00000100:00100000:1.0:1789117969.763875:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572197888 00000100:00100000:1.0:1789117969.763877:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572197888 00000100:00100000:1.0:1789117969.763902:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 57 00000100:00100000:1.0:1789117969.763908:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+5:2406:x1876025572197504:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117969.763937:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+5:2406:x1876025572197504:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 30us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117969.763944:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 57 00000100:00100000:1.0:1789117969.763957:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 58 00000100:00100000:1.0:1789117969.763963:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf777c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2406:x1876025572198016:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117969.763988:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf777c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2406:x1876025572198016:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 26us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117969.763994:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 58 00000100:00100000:1.0:1789117969.764005:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 59 00000100:00100000:1.0:1789117969.764010:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+6:2406:x1876025572197376:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117969.764032:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+6:2406:x1876025572197376:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 22us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117969.764039:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 59 00000100:00100000:1.0:1789117969.764049:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00100000:1.0:1789117969.764085:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:2406:x1876025572197888:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117969.764104:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:2406:x1876025572197888:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 22us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117969.764110:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00080000:1.0:1789117969.764140:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789117969.764144:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789117969.764146:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789117969.764148:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1789117969.773226:0:20127:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3a40d558-cfad-4484-8c6e-52e7fbfb6447 00000100:00100000:1.0:1789117970.277438:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88564f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593273984:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789117970.277537:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117970.277638:0:19315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593273984 00000100:00100000:2.0:1789117970.277645:0:19315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593273984 00000100:00100000:2.0:1789117970.277707:0:19315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789117970.277717:0:19315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd108b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593273984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789117970.277749:0:19315:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789117970.277798:0:19315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd108b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593273984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117970.277806:0:19315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1789117970.277880:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789117970.277926:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88564f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593273984:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789117970.405334:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117971.430153:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789117971.712812:0:20836:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd2137c100 20000000:00000080:2.0:1789117971.712829:0:20836:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff962a87a26800 uarg=0000000000000000 20000000:01000000:2.0:1789117971.712884:0:20836:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789117971.712891:0:20836:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789117971.712896:0:20836:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789117971.713499:0:20837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 19 20000000:00000400:2.0:1789117971.713688:0:20836:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789117971.726987:0:20836:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789117971.727127:0:20836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962a87d93c00/0xaa253ed19be2105d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117971.727156:0:20836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962baea9ba00/0xaa253ed19be20cf2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20ceb expref: 23 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117971.727165:0:20836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b80030800/0xaa253ed19be20d00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20cf9 expref: 23 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117971.727175:0:20836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b813dba00/0xaa253ed19be20d3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20d38 expref: 23 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117971.727206:0:20836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962a88d9b000/0xaa253ed19be20ea4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be20e9d expref: 23 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117971.727217:0:20836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962bbbc11400/0xaa253ed19be20fed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f24e expref: 12 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117971.727226:0:20836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962bbbc11800/0xaa253ed19be2102c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2be expref: 12 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117971.727234:0:20836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962a87d93c00/0xaa253ed19be2105d lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117971.727294:0:20836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962bbbc11800/0xaa253ed19be2102c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2be expref: 12 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117971.727315:0:20836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962bbbc11800/0xaa253ed19be2102c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2be expref: 12 pid: 17793 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117971.727337:0:20836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a885652c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20836:1876025593274112:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789117971.727717:0:20836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962bbbc11400/0xaa253ed19be20fed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f24e expref: 12 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117971.727728:0:20836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962bbbc11400/0xaa253ed19be20fed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f24e expref: 12 pid: 17793 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117971.727742:0:20836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88567480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20836:1876025593274240:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789117971.727804:0:20836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962a88d9b000/0xaa253ed19be20ea4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be20e9d expref: 23 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117971.727826:0:20836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962a88d9b000/0xaa253ed19be20ea4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be20e9d expref: 23 pid: 17790 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117971.728892:0:20836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88566d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20836:1876025593274368:0@lo:104: 00000100:00100000:2.0:1789117971.728965:0:20836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789117971.729034:0:20836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b813dba00/0xaa253ed19be20d3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be20d38 expref: 23 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117971.729047:0:20836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962b813dba00/0xaa253ed19be20d3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be20d38 expref: 23 pid: 17790 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117971.729077:0:20836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a885670c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20836:1876025593274496:0@lo:104: 00000100:00100000:2.0:1789117971.729101:0:20836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789117971.729128:0:20836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b80030800/0xaa253ed19be20d00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be20cf9 expref: 23 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117971.729138:0:20836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962b80030800/0xaa253ed19be20d00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be20cf9 expref: 23 pid: 17790 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117971.729146:0:20836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd14000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20836:1876025593274624:0@lo:104: 00000100:00100000:2.0:1789117971.729164:0:20836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789117971.729179:0:20836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962baea9ba00/0xaa253ed19be20cf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be20ceb expref: 23 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117971.729188:0:20836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962baea9ba00/0xaa253ed19be20cf2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be20ceb expref: 23 pid: 17790 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117971.729196:0:20836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd16580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20836:1876025593274752:0@lo:104: 00000100:00100000:2.0:1789117971.729230:0:20836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117971.729241:0:20836:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86dce300 going to sleep for 11 seconds 00000100:00100000:1.0:1789117971.730525:0:17782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593274368 00000100:00100000:1.0:1789117971.730539:0:17782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593274368 00000100:00100000:1.0:1789117971.730600:0:17782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593274496 00000100:00100000:1.0:1789117971.730604:0:17782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593274496 00000100:00100000:1.0:1789117971.730615:0:17782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593274624 00000100:00100000:1.0:1789117971.730618:0:17782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593274624 00000100:00100000:1.0:1789117971.730627:0:17782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593274752 00000100:00100000:1.0:1789117971.730629:0:17782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593274752 00000100:00100000:1.0:1789117971.730647:0:17782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789117971.730658:0:17782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88565a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf05977c-16b5-4df3-81bb-3835e509f77c+6:20836:x1876025593274368:12345-0@lo:104: 00010000:00010000:1.0:1789117971.730677:0:17782:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be20e9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20ea4 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.730782:0:17782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789117971.730793:0:17782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88565a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf05977c-16b5-4df3-81bb-3835e509f77c+6:20836:x1876025593274368:12345-0@lo:104: Request processed in 135us (1827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117971.730801:0:17782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789117971.730822:0:17782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789117971.730829:0:17782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88564f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf05977c-16b5-4df3-81bb-3835e509f77c+5:20836:x1876025593274496:12345-0@lo:104: 00010000:00010000:1.0:1789117971.730837:0:17782:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be20d38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20d3f expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.730872:0:17782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789117971.730886:0:17782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88564f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf05977c-16b5-4df3-81bb-3835e509f77c+5:20836:x1876025593274496:12345-0@lo:104: Request processed in 59us (1784us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117971.730893:0:17782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789117971.730906:0:17782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789117971.730911:0:17782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd15680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf05977c-16b5-4df3-81bb-3835e509f77c+4:20836:x1876025593274624:12345-0@lo:104: 00010000:00010000:1.0:1789117971.730920:0:17782:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20cf9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20d00 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.730953:0:17782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789117971.730958:0:17782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd15680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf05977c-16b5-4df3-81bb-3835e509f77c+4:20836:x1876025593274624:12345-0@lo:104: Request processed in 47us (1793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117971.730963:0:17782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789117971.730975:0:17782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789117971.730981:0:17782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd170c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf05977c-16b5-4df3-81bb-3835e509f77c+3:20836:x1876025593274752:12345-0@lo:104: 00010000:00010000:1.0:1789117971.730987:0:17782:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b813da600/0xaa253ed19be20ceb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20cf2 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.731016:0:17782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789117971.731020:0:17782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd170c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf05977c-16b5-4df3-81bb-3835e509f77c+3:20836:x1876025593274752:12345-0@lo:104: Request processed in 41us (1790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117971.731026:0:17782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789117971.731045:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789117971.731614:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be20e9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20ea4 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.731625:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db800 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789117971.731631:0:18557:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be20e9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be20ea4 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.731655:0:18557:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be20e9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be20ea4 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117971.731664:0:18557:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be20e9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be20ea4 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117971.731670:0:18557:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789117971.731732:0:18557:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be20e9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20ea4 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.731738:0:18557:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789117971.731811:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbd10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593274880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789117971.731881:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789117971.731955:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be20e9d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20ea4 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.731965:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b813db800/0xaa253ed19be20e9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20ea4 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.731981:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789117971.731985:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be20d38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20d3f expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.731990:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9a000 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789117971.731993:0:18557:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be20d38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be20d3f expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.731999:0:18557:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be20d38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be20d3f expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117971.732004:0:18557:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be20d38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be20d3f expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117971.732018:0:18557:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789117971.732033:0:18557:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be20d38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20d3f expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.732039:0:18557:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789117971.734293:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789117971.734322:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593275008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789117971.734449:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117971.734535:0:17785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593274880 00000100:00100000:0.0:1789117971.734546:0:17785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593274880 00010000:00010000:0.0:1789117971.734594:0:17785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962a88d9b000/0xaa253ed19be20ea4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20e9d expref: 24 pid: 17790 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117971.734633:0:17785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593275008 00000100:00100000:0.0:1789117971.734637:0:17785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593275008 00010000:00010000:0.0:1789117971.734650:0:17785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b813dba00/0xaa253ed19be20d3f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20d38 expref: 25 pid: 17790 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117971.734665:0:17785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789117971.734675:0:17785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f452c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf05977c-16b5-4df3-81bb-3835e509f77c+25:3646:x1876025593274880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789117971.734693:0:17785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117971.734698:0:17785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962a88d9b000/0xaa253ed19be20ea4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20e9d expref: 25 pid: 17790 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117971.734710:0:17785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962a88d9b000/0xaa253ed19be20ea4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be20e9d expref: 25 pid: 17790 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117971.734739:0:17785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117971.734786:0:17785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f452c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf05977c-16b5-4df3-81bb-3835e509f77c+25:3646:x1876025593274880:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (2904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117971.734795:0:17785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789117971.734815:0:17785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789117971.734838:0:17785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f46d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf05977c-16b5-4df3-81bb-3835e509f77c+24:3646:x1876025593275008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789117971.734848:0:17785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117971.734853:0:17785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b813dba00/0xaa253ed19be20d3f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20d38 expref: 24 pid: 17790 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117971.734862:0:17785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b813dba00/0xaa253ed19be20d3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be20d38 expref: 24 pid: 17790 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117971.734872:0:17785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117971.734894:0:17785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f46d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf05977c-16b5-4df3-81bb-3835e509f77c+24:3646:x1876025593275008:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117971.734900:0:17785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789117971.735036:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593275008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789117971.735046:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbd10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593274880:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789117971.736677:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789117971.736690:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20cf9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20d00 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117971.736702:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b80030200 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117971.736707:0:17786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20cf9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be20d00 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117971.736717:0:17786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20cf9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be20d00 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117971.736724:0:17786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20cf9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be20d00 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117971.736751:0:17786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789117971.737113:0:17786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20cf9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20d00 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117971.737121:0:17786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117971.737154:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20cf9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20d00 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117971.737163:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b80030200/0xaa253ed19be20cf9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20d00 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117971.737177:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117971.737181:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b813da600/0xaa253ed19be20ceb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be20cf2 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117971.737186:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813da600 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789117971.737189:0:17786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b813da600/0xaa253ed19be20ceb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be20cf2 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117971.737197:0:17786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b813da600/0xaa253ed19be20ceb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be20cf2 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117971.737204:0:17786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b813da600/0xaa253ed19be20ceb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be20cf2 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117971.737209:0:17786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789117971.737509:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbd10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf05977c-16b5-4df3-81bb-3835e509f77c:3644:1876025593275136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789117971.737576:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117971.737655:0:17785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593275136 00000100:00100000:3.0:1789117971.737663:0:17785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593275136 00010000:00010000:3.0:1789117971.737693:0:17785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b80030800/0xaa253ed19be20d00 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20cf9 expref: 24 pid: 17790 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117971.737721:0:17785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789117971.737729:0:17785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf05977c-16b5-4df3-81bb-3835e509f77c+24:3644:x1876025593275136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789117971.737741:0:17785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117971.737746:0:17785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b80030800/0xaa253ed19be20d00 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20cf9 expref: 24 pid: 17790 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117971.737756:0:17785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b80030800/0xaa253ed19be20d00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be20cf9 expref: 24 pid: 17790 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117971.737774:0:17785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117971.737806:0:17785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf05977c-16b5-4df3-81bb-3835e509f77c+24:3644:x1876025593275136:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117971.737814:0:17785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789117971.737855:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbd10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf05977c-16b5-4df3-81bb-3835e509f77c:3644:1876025593275136:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789117971.737968:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be20d38 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20d3f expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.737977:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962baea9a000/0xaa253ed19be20d38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20d3f expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.737988:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117971.737989:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117971.737991:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117971.737998:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117971.738039:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117971.738141:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117971.738165:0:17783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572198400 00000100:00100000:1.0:1789117971.738169:0:17783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572198400 00010000:00010000:1.0:1789117971.738187:0:17783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962bbbc11800/0xaa253ed19be2102c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2be expref: 13 pid: 17793 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117971.738205:0:17783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572198528 00000100:00100000:1.0:1789117971.738208:0:17783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572198528 00010000:00010000:1.0:1789117971.738220:0:17783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962bbbc11400/0xaa253ed19be20fed lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f24e expref: 14 pid: 17793 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117971.738232:0:17783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:1.0:1789117971.738238:0:17783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+14:2407:x1876025572198400:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117971.738256:0:17783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117971.738262:0:17783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962bbbc11800/0xaa253ed19be2102c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2be expref: 14 pid: 17793 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.738271:0:17783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962bbbc11800/0xaa253ed19be2102c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2be expref: 14 pid: 17793 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.738282:0:17783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117971.738320:0:17783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+14:2407:x1876025572198400:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 81us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117971.738327:0:17783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:1.0:1789117971.738342:0:17783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:1.0:1789117971.738349:0:17783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81e72c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:2406:x1876025572198528:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117971.738547:0:17783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117971.738554:0:17783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962bbbc11400/0xaa253ed19be20fed lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f24e expref: 13 pid: 17793 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.738564:0:17783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962bbbc11400/0xaa253ed19be20fed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f24e expref: 13 pid: 17793 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.738574:0:17783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117971.738594:0:17783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81e72c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:2406:x1876025572198528:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 245us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117971.738600:0:17783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 13 00010000:00010000:0.0:1789117971.738982:0:17786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b813da600/0xaa253ed19be20ceb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20cf2 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117971.738990:0:17786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117971.739022:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b813da600/0xaa253ed19be20ceb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20cf2 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117971.739029:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b813da600/0xaa253ed19be20ceb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be20cf2 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117971.739044:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117971.739046:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117971.739048:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117971.739140:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbd10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf05977c-16b5-4df3-81bb-3835e509f77c:3645:1876025593275264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117971.739177:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117971.739220:0:17783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593275264 00000100:00100000:1.0:1789117971.739230:0:17783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593275264 00010000:00010000:1.0:1789117971.739249:0:17783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962baea9ba00/0xaa253ed19be20cf2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20ceb expref: 24 pid: 17790 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117971.739270:0:17783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789117971.739277:0:17783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf05977c-16b5-4df3-81bb-3835e509f77c+24:3645:x1876025593275264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789117971.739284:0:17783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117971.739288:0:17783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962baea9ba00/0xaa253ed19be20cf2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be20ceb expref: 24 pid: 17790 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.739296:0:17783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962baea9ba00/0xaa253ed19be20cf2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be20ceb expref: 24 pid: 17790 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.739310:0:17783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962a87d93c00/0xaa253ed19be2105d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.739318:0:17783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d93c00/0xaa253ed19be2105d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.739330:0:17783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962a87d93c00/0xaa253ed19be2105d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.739337:0:17783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962a87d93c00/0xaa253ed19be2105d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.739344:0:17783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962a87d93c00/0xaa253ed19be2105d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.739350:0:17783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962a87d93c00/0xaa253ed19be2105d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.739369:0:17783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93c00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117971.739381:0:17783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962a87d93c00/0xaa253ed19be2105d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.739390:0:17783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962a87d93c00/0xaa253ed19be2105d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.739399:0:17783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962a87d93c00/0xaa253ed19be2105d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.739410:0:17783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117971.739440:0:17783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf05977c-16b5-4df3-81bb-3835e509f77c+24:3645:x1876025593275264:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117971.739447:0:17783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789117971.739480:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbd10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf05977c-16b5-4df3-81bb-3835e509f77c:3645:1876025593275264:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789117971.740562:0:20836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bbbc11800/0xaa253ed19be2102c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2be expref: 12 pid: 17793 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117971.740580:0:20836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a885652c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20836:1876025593274112:192.168.204.30@tcp:104: 00010000:00010000:1.0:1789117971.740594:0:20836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bbbc11400/0xaa253ed19be20fed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f24e expref: 11 pid: 17793 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117971.740603:0:20836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88567480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20836:1876025593274240:192.168.204.30@tcp:104: 00010000:00010000:1.0:1789117971.740614:0:20836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a88d9b000/0xaa253ed19be20ea4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be20e9d expref: 23 pid: 17790 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117971.740623:0:20836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88566d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20836:1876025593274368:0@lo:104: 00010000:00010000:1.0:1789117971.740633:0:20836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813dba00/0xaa253ed19be20d3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be20d38 expref: 22 pid: 17790 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117971.740660:0:20836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a885670c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20836:1876025593274496:0@lo:104: 00010000:00010000:1.0:1789117971.740673:0:20836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b80030800/0xaa253ed19be20d00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be20cf9 expref: 21 pid: 17790 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117971.740683:0:20836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd14000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20836:1876025593274624:0@lo:104: 00010000:00010000:1.0:1789117971.740692:0:20836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962baea9ba00/0xaa253ed19be20cf2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be20ceb expref: 20 pid: 17790 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117971.740700:0:20836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd16580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20836:1876025593274752:0@lo:104: 00010000:00010000:1.0:1789117971.740724:0:20836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962a87d93c00/0xaa253ed19be2105d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.740734:0:20836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962a87d93c00/0xaa253ed19be2105d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.740740:0:20836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962a87d93c00/0xaa253ed19be2105d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117971.740747:0:20836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d93c00/0xaa253ed19be2105d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117971.814638:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbd10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593275392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789117971.814721:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117971.814791:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593275392 00000100:00100000:0.0:1789117971.814800:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593275392 00000100:00100000:0.0:1789117971.814879:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789117971.814891:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593275392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789117971.814949:0:18751:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789117971.815017:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593275392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117971.815026:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789117971.815111:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbd10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593275392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789117971.820530:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593275520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117971.820618:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117971.820716:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593275520 00000100:00100000:2.0:1789117971.820724:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593275520 00000100:00100000:2.0:1789117971.820788:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789117971.820799:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593275520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789117971.820850:0:17804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789117971.820907:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593275520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117971.820915:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789117971.820959:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593275520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117972.325392:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593275648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789117972.325495:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117972.328023:0:19315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593275648 00000100:00100000:2.0:1789117972.328034:0:19315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593275648 00000100:00100000:2.0:1789117972.328137:0:19315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789117972.328149:0:19315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593275648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789117972.328180:0:19315:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789117972.328255:0:19315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593275648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (2762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117972.328263:0:19315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1789117972.328285:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789117972.328823:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593275904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117972.328890:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117972.328941:0:19315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593275904 00000100:00100000:0.0:1789117972.328947:0:19315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593275904 00000100:00100000:0.0:1789117972.328989:0:19315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789117972.328997:0:19315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86818780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593275904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789117972.329020:0:19315:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789117972.329094:0:19315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86818780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593275904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117972.329101:0:19315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1789117972.329120:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117972.329154:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593275904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117972.329279:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbd108780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593276416:0@lo:400:kworker.0 00000100:00100000:0.0:1789117972.329306:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117972.329325:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593276928:0@lo:400:kworker.0 00000100:00100000:0.0:1789117972.329358:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117972.329376:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789117972.329382:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593276032:0@lo:400:kworker.0 00000100:00100000:0.0:1789117972.329409:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117972.329425:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbd10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593276544:0@lo:400:kworker.0 00000100:00100000:0.0:1789117972.329445:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117972.329471:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593276416 00000100:00100000:0.0:1789117972.329475:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593276416 00000100:00100000:0.0:1789117972.329510:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593276928 00000100:00100000:0.0:1789117972.329513:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593276928 00000100:00100000:0.0:1789117972.329528:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593276544 00000100:00100000:0.0:1789117972.329544:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593276544 00000100:00100000:0.0:1789117972.329561:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789117972.329568:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593276416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117972.329604:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593276416:12345-0@lo:400:kworker.0 Request processed in 37us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117972.329611:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789117972.329622:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789117972.329628:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593276928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117972.329662:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593276928:12345-0@lo:400:kworker.0 Request processed in 34us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117972.329668:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789117972.329679:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789117972.329685:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593276544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117972.329709:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593276544:12345-0@lo:400:kworker.0 Request processed in 25us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117972.329715:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789117972.329734:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593276032 00000100:00100000:0.0:1789117972.329737:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593276032 00000100:00100000:0.0:1789117972.329768:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789117972.329775:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed98780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593276032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117972.329809:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed98780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593276032:12345-0@lo:400:kworker.0 Request processed in 35us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117972.329815:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1789117972.329848:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789117972.329852:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789117972.329855:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789117972.329879:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593276032:0@lo:400:kworker.0 00000100:00100000:0.0:1789117972.329891:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbd10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593276544:0@lo:400:kworker.0 00000100:00100000:0.0:1789117972.329900:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbd108780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593276416:0@lo:400:kworker.0 00010000:00080000:0.0:1789117972.329913:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b8ed992c0 x1876025593276928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117972.329924:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593276928:0@lo:400:kworker.0 00000100:00100000:0.0:1789117972.329981:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593275776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117972.330009:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117972.330027:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593276288:0@lo:400:kworker.0 00000100:00100000:0.0:1789117972.330048:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117972.330094:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86809680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593276800:0@lo:400:kworker.0 00000100:00100000:0.0:1789117972.330115:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117972.330132:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789117972.330139:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593276160:0@lo:400:kworker.0 00000100:00100000:0.0:1789117972.330158:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117972.330173:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86808b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593276672:0@lo:400:kworker.0 00000100:00100000:0.0:1789117972.330192:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117972.330214:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593276800 00000100:00100000:0.0:1789117972.330217:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593276800 00000100:00100000:0.0:1789117972.330248:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593276160 00000100:00100000:0.0:1789117972.330251:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593276160 00000100:00100000:0.0:1789117972.330261:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593276672 00000100:00100000:0.0:1789117972.330263:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593276672 00000100:00100000:0.0:1789117972.330275:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789117972.330281:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593276800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117972.330313:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593276800:12345-0@lo:400:kworker.0 Request processed in 32us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117972.330320:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789117972.330331:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789117972.330337:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593276160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117972.330376:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593276160:12345-0@lo:400:kworker.0 Request processed in 39us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117972.330391:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789117972.330402:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789117972.330408:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593276672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117972.330438:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593276672:12345-0@lo:400:kworker.0 Request processed in 29us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117972.330444:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1789117972.330461:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789117972.330465:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117972.330481:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593276160:0@lo:400:kworker.0 00010000:00080000:0.0:1789117972.330492:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a86808b40 x1876025593276672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117972.330501:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86808b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593276672:0@lo:400:kworker.0 00000100:00100000:0.0:1789117972.330511:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86809680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593276800:0@lo:400:kworker.0 00000100:00100000:0.0:1789117972.330533:0:19315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593275776 00000100:00100000:0.0:1789117972.330537:0:19315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593275776 00000100:00100000:0.0:1789117972.330559:0:19315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789117972.330565:0:19315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593275776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789117972.330578:0:19315:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789117972.330612:0:19315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593275776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117972.330617:0:19315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789117972.330645:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593275776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117972.330678:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593276288 00000100:00100000:0.0:1789117972.330681:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593276288 00000100:00100000:0.0:1789117972.330715:0:19311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789117972.330721:0:19311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed99a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593276288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117972.330755:0:19311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed99a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593276288:12345-0@lo:400:kworker.0 Request processed in 35us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117972.330761:0:19311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1789117972.330774:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117972.330790:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593276288:0@lo:400:kworker.0 00000100:00100000:1.0:1789117972.331624:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593275648:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789117972.468528:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789117972.518533:0:18556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789117972.832697:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117972.833839:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572198656 00000100:00100000:2.0:1789117972.833859:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572198656 00000100:00100000:2.0:1789117972.833955:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 152 00000100:00100000:2.0:1789117972.833976:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+11:15173:x1876025572198656:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117972.834012:0:17791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117972.834051:0:17791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d93a00/0xaa253ed19be21064 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f2f6 expref: -99 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117972.834136:0:17791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d93a00/0xaa253ed19be21064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2f6 expref: 12 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117972.834152:0:17791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d93a00/0xaa253ed19be21064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2f6 expref: 12 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117972.834165:0:17791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93a00, rc 0) 00000100:00100000:2.0:1789117972.834269:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+12:15173:x1876025572198656:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 Request processed in 296us (1591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117972.834278:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 152 00000100:00100000:1.0:1789117972.843613:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117972.843708:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572198784 00000100:00100000:2.0:1789117972.843723:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572198784 00000100:00100000:2.0:1789117972.843814:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 153 00000100:00100000:2.0:1789117972.843827:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+12:15173:x1876025572198784:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117972.844111:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+12:15173:x1876025572198784:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 Request processed in 286us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117972.844122:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 153 00000100:00100000:0.0:1789117972.856681:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117972.857001:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572198912 00000100:00100000:1.0:1789117972.857022:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572198912 00000100:00100000:1.0:1789117972.857149:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 154 00000100:00100000:1.0:1789117972.857164:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+12:15173:x1876025572198912:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117972.857461:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+12:15173:x1876025572198912:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 Request processed in 300us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117972.857472:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 154 00000100:00100000:3.0:1789117972.871637:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117972.871751:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572199040 00000100:00100000:3.0:1789117972.871769:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572199040 00000100:00100000:3.0:1789117972.871840:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 155 00000100:00100000:3.0:1789117972.871853:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+12:15173:x1876025572199040:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117972.871878:0:17791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117972.871905:0:17791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a88d9a400/0xaa253ed19be2106b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f2fd expref: -99 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117972.871957:0:17791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a88d9a400/0xaa253ed19be2106b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2fd expref: 13 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117972.871972:0:17791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a88d9a400/0xaa253ed19be2106b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2fd expref: 13 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117972.871985:0:17791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a88d9a400, rc 0) 00000100:00100000:3.0:1789117972.872103:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:15173:x1876025572199040:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 Request processed in 252us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117972.872112:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 155 00000100:00100000:3.0:1789117972.874766:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117972.875239:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572199168 00000100:00100000:3.0:1789117972.875255:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572199168 00000100:00100000:3.0:1789117972.875352:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 156 00000100:00100000:3.0:1789117972.875370:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:15173:x1876025572199168:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117972.875653:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:15173:x1876025572199168:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 Request processed in 287us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117972.875662:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 156 00000100:00100000:0.0:1789117972.892508:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117972.894857:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572199296 00000100:00100000:3.0:1789117972.894882:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572199296 00000100:00100000:3.0:1789117972.894979:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 157 00000100:00100000:3.0:1789117972.894990:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:15173:x1876025572199296:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117972.895261:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:15173:x1876025572199296:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 Request processed in 271us (2782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117972.895269:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 157 00010000:00010000:1.0:1789117973.477582:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789117973.482346:0:17796:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789117973.482354:0:17796:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962a87e28800 from 19 10000000:01000000:0.0:1789117973.482359:0:17796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789117973.482417:0:17796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbbc10400/0xaa253ed19be21072 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117973.482429:0:17796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962bbbc10400/0xaa253ed19be21072 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117973.482441:0:17796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962bbbc10400/0xaa253ed19be21072 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117973.482467:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed98b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593277056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789117973.482572:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117973.482622:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c22d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789117973.482657:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593277056 00000100:00100000:3.0:1789117973.482667:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593277056 00000100:00100000:3.0:1789117973.482733:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789117973.482744:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+20:17796:x1876025593277056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117973.482760:0:17791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117973.482775:0:17791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a88d9a200/0xaa253ed19be21079 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be21072 expref: -99 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117973.482801:0:17791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a88d9a200/0xaa253ed19be21079 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be21072 expref: 21 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117973.482814:0:17791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a88d9a200/0xaa253ed19be21079 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be21072 expref: 21 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117973.482824:0:17791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a88d9a200, rc 0) 00000100:00100000:3.0:1789117973.482883:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+21:17796:x1876025593277056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117973.482890:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789117973.482930:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed98b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593277056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117973.482946:0:17796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962bbbc10400/0xaa253ed19be21072 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21079 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117973.482960:0:17796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962bbbc10400/0xaa253ed19be21072 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be21079 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117973.483023:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88566d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593277184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117973.483048:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117973.483094:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf612840 going to sleep for 11 seconds 00000100:00100000:0.0:1789117973.483121:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593277184 00000100:00100000:0.0:1789117973.483126:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593277184 00000100:00100000:0.0:1789117973.483157:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789117973.483165:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+21:17796:x1876025593277184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117973.483285:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+21:17796:x1876025593277184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117973.483302:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789117973.483364:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88566d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593277184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117973.483388:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88566d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593277312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117973.483427:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117973.483451:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf612840 going to sleep for 11 seconds 00000100:00100000:3.0:1789117973.484938:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593277312 00000100:00100000:3.0:1789117973.484951:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593277312 00000100:00100000:3.0:1789117973.485014:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789117973.485023:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+21:17796:x1876025593277312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117973.485198:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+21:17796:x1876025593277312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (1770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117973.485206:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789117973.486291:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88566d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593277312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789117973.487103:0:20895:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:1.0:1789117973.489395:0:17796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:1.0:1789117973.489462:0:17796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789117973.489480:0:17796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbbc10400/0xaa253ed19be21072 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21079 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117973.489495:0:17796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962bbbc10400/0xaa253ed19be21072 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21079 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117973.489506:0:17796:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789117973.489510:0:17796:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962bc1b5c000 from 19 10000000:01000000:1.0:1789117973.489513:0:17796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789117973.489564:0:17796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be21080 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117973.489573:0:17796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be21080 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117973.489586:0:17796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be21080 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117973.489621:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88566d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593277440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789117973.489714:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117973.489777:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf6126c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117973.489937:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593277440 00000100:00100000:0.0:1789117973.489947:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593277440 00000100:00100000:0.0:1789117973.490015:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789117973.490025:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+21:17796:x1876025593277440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117973.490041:0:17793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117973.490243:0:17793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbbc11a00/0xaa253ed19be21087 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be21080 expref: -99 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117973.490276:0:17793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbbc11a00/0xaa253ed19be21087 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be21080 expref: 22 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117973.490289:0:17793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbbc11a00/0xaa253ed19be21087 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be21080 expref: 22 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117973.490299:0:17793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbbc11a00, rc 0) 00000100:00100000:0.0:1789117973.490479:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+22:17796:x1876025593277440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 455us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117973.490487:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789117973.491619:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88566d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593277440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117973.491645:0:17796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be21080 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21087 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117973.491657:0:17796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be21080 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be21087 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117973.491748:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88566d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593277568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117973.491819:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117973.491908:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf6126c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117973.495461:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593277568 00000100:00100000:0.0:1789117973.495475:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593277568 00000100:00100000:0.0:1789117973.497037:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789117973.497082:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+22:17796:x1876025593277568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117973.497305:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+22:17796:x1876025593277568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (5484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117973.497316:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789117973.497503:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88566d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593277568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117973.497578:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593277696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117973.497638:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117973.501146:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbcdd4780 going to sleep for 11 seconds 00000100:00100000:1.0:1789117973.510246:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593277696 00000100:00100000:1.0:1789117973.510265:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593277696 00000100:00100000:1.0:1789117973.511871:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789117973.511887:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+22:17796:x1876025593277696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117973.512094:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+22:17796:x1876025593277696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 210us (14455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117973.512102:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789117973.512164:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593277696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789117973.516930:0:20898:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:0.0:1789117973.517046:0:17796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:0.0:1789117973.517123:0:17796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789117973.517137:0:17796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be21080 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21087 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117973.517148:0:17796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be21080 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21087 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117973.517159:0:17796:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789117973.517162:0:17796:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962bbf6a1000 from 19 10000000:01000000:0.0:1789117973.517166:0:17796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789117973.517217:0:17796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be2108e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117973.517224:0:17796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be2108e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117973.517235:0:17796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be2108e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117973.517266:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593277824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789117973.517367:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117973.524359:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c22b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789117973.528424:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593277824 00000100:00100000:0.0:1789117973.528441:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593277824 00000100:00100000:0.0:1789117973.528514:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789117973.528525:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+22:17796:x1876025593277824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117973.528543:0:17791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117973.528562:0:17791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbbc10600/0xaa253ed19be21095 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be2108e expref: -99 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117973.528607:0:17791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbbc10600/0xaa253ed19be21095 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be2108e expref: 23 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117973.528618:0:17791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbbc10600/0xaa253ed19be21095 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be2108e expref: 23 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117973.528627:0:17791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbbc10600, rc 0) 00000100:00100000:0.0:1789117973.528714:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+23:17796:x1876025593277824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (11348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117973.528723:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789117973.528755:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593277824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117973.528787:0:17796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be2108e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21095 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117973.528798:0:17796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be2108e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be21095 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117973.528898:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593277952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117973.528941:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117973.528980:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f66540 going to sleep for 11 seconds 00000100:00100000:0.0:1789117973.529047:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593277952 00000100:00100000:0.0:1789117973.529051:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593277952 00000100:00100000:0.0:1789117973.529093:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789117973.529100:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+23:17796:x1876025593277952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117973.529203:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+23:17796:x1876025593277952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117973.529210:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789117973.529679:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593277952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117973.529712:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593278080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117973.529758:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117973.529787:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f66540 going to sleep for 11 seconds 00000100:00100000:0.0:1789117973.544990:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593278080 00000100:00100000:0.0:1789117973.545010:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593278080 00000100:00100000:0.0:1789117973.545100:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789117973.545112:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+23:17796:x1876025593278080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117973.545315:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+23:17796:x1876025593278080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 204us (15555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117973.545335:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789117973.545423:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593278080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789117973.551025:0:20900:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:0.0:1789117973.551161:0:17796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:0.0:1789117973.551207:0:17796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789117973.551227:0:17796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be2108e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21095 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117973.551243:0:17796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be2108e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21095 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117973.551257:0:17796:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789117973.551262:0:17796:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962a88713800 from 19 10000000:01000000:0.0:1789117973.551266:0:17796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789117973.551330:0:17796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbbc10800/0xaa253ed19be2109c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117973.551339:0:17796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962bbbc10800/0xaa253ed19be2109c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117973.551354:0:17796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962bbbc10800/0xaa253ed19be2109c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117973.551390:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593278208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789117973.551489:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117973.551532:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593278208 00000100:00100000:2.0:1789117973.551542:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593278208 00000100:00100000:0.0:1789117973.551543:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86dced80 going to sleep for 11 seconds 00000100:00100000:2.0:1789117973.551606:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789117973.551623:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+23:17796:x1876025593278208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117973.551648:0:17790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117973.551670:0:17790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d92a00/0xaa253ed19be210a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be2109c expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117973.551705:0:17790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d92a00/0xaa253ed19be210a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be2109c expref: 24 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117973.551720:0:17790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d92a00/0xaa253ed19be210a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be2109c expref: 24 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117973.551732:0:17790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92a00, rc 0) 00000100:00100000:2.0:1789117973.551872:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+24:17796:x1876025593278208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 254us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117973.551881:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789117973.555275:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593278208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117973.555354:0:17796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962bbbc10800/0xaa253ed19be2109c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be210a3 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117973.555373:0:17796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962bbbc10800/0xaa253ed19be2109c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be210a3 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117973.555510:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593278336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117973.555601:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117973.555645:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86dced80 going to sleep for 11 seconds 00000100:00100000:0.0:1789117973.555685:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593278336 00000100:00100000:0.0:1789117973.555691:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593278336 00000100:00100000:0.0:1789117973.555739:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789117973.555750:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+24:17796:x1876025593278336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117973.555983:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+24:17796:x1876025593278336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117973.555993:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789117973.556049:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593278336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117973.556206:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593278464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117973.556253:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117973.556281:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86dced80 going to sleep for 11 seconds 00000100:00100000:0.0:1789117973.556300:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593278464 00000100:00100000:0.0:1789117973.556303:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593278464 00000100:00100000:0.0:1789117973.556343:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789117973.556351:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+24:17796:x1876025593278464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117973.556440:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+24:17796:x1876025593278464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117973.556449:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789117973.556498:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf05977c-16b5-4df3-81bb-3835e509f77c:17796:1876025593278464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789117973.560511:0:20901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:0.0:1789117973.560618:0:17796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:0.0:1789117973.560647:0:17796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789117973.560664:0:17796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbbc10800/0xaa253ed19be2109c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be210a3 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117973.560678:0:17796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962bbbc10800/0xaa253ed19be2109c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be210a3 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117974.504387:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117974.879957:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117974.880008:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117974.880082:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117974.880103:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117974.880120:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117974.880134:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117974.880148:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117974.880163:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117974.880180:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117974.881673:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572199680 00000100:00100000:2.0:1789117974.881692:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572199680 00000100:00100000:2.0:1789117974.881776:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572200192 00000100:00100000:2.0:1789117974.881780:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572200192 00000100:00100000:2.0:1789117974.881804:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572199552 00000100:00100000:2.0:1789117974.881807:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572199552 00000100:00100000:2.0:1789117974.881819:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572200064 00000100:00100000:2.0:1789117974.881821:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572200064 00000100:00100000:2.0:1789117974.881843:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00100000:2.0:1789117974.881854:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+5:2404:x1876025572199680:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117974.881951:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+5:2404:x1876025572199680:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 98us (1941us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117974.881960:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00100000:2.0:1789117974.881982:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 68 00000100:00100000:2.0:1789117974.881988:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2404:x1876025572200192:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117974.882014:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2404:x1876025572200192:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 26us (1910us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117974.882021:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 68 00000100:00100000:2.0:1789117974.882032:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 69 00000100:00100000:2.0:1789117974.882038:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+6:2404:x1876025572199552:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117974.882103:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+6:2404:x1876025572199552:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 65us (1967us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117974.882110:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 69 00000100:00100000:2.0:1789117974.882122:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 70 00000100:00100000:2.0:1789117974.882129:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:2404:x1876025572200064:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117974.882152:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:2404:x1876025572200064:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 23us (1987us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117974.882158:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 70 00000100:00100000:0.0:1789117974.882283:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572199424 00000100:00100000:0.0:1789117974.882289:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572199424 00000100:00100000:0.0:1789117974.882341:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 170 00000100:00100000:0.0:1789117974.882349:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:2404:x1876025572199424:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117974.882378:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:2404:x1876025572199424:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 30us (2437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117974.882385:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 170 00000100:00100000:0.0:1789117974.882424:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572199936 00000100:00100000:0.0:1789117974.882429:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572199936 00000100:00100000:0.0:1789117974.882451:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572200448 00000100:00100000:0.0:1789117974.882454:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572200448 00000100:00100000:0.0:1789117974.882466:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572199808 00000100:00100000:0.0:1789117974.882468:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572199808 00000100:00100000:0.0:1789117974.882478:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572200320 00000100:00100000:0.0:1789117974.882480:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572200320 00000100:00100000:0.0:1789117974.882493:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:0.0:1789117974.882498:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+5:2404:x1876025572199936:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117974.882525:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+5:2404:x1876025572199936:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 26us (2471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117974.882531:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:0.0:1789117974.882551:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:0.0:1789117974.882557:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2404:x1876025572200448:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117974.882584:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2404:x1876025572200448:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 27us (2463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117974.882590:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:0.0:1789117974.882600:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:0.0:1789117974.882605:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+5:2404:x1876025572199808:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117974.882667:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+5:2404:x1876025572199808:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 62us (2517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117974.882674:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:0.0:1789117974.882684:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:0.0:1789117974.882689:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2404:x1876025572200320:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117974.882711:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2404:x1876025572200320:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 22us (2531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117974.882717:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00080000:1.0:1789117974.889307:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789117974.889320:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789117974.889324:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789117974.889327:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789117975.397988:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117975.398894:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593278592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789117975.403651:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117975.412159:0:19315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593278592 00000100:00100000:0.0:1789117975.412188:0:19315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593278592 00000100:00100000:0.0:1789117975.412330:0:19315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789117975.412346:0:19315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593278592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789117975.412387:0:19315:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789117975.412496:0:19315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593278592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 156us (8858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117975.412505:0:19315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789117975.413190:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593278592:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789117975.413593:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789117975.525611:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789117975.977719:0:17834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789117976.039683:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117976.039875:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572200576 00000100:00100000:0.0:1789117976.039885:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572200576 00000100:00100000:0.0:1789117976.040034:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:0.0:1789117976.040046:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+6:15842:x1876025572200576:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789117976.040090:0:20601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117976.040112:0:20601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be210aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f304 expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.040244:0:20601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be210b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.040260:0:20601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be210b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.040284:0:20601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be210b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.040301:0:20601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be210b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.040308:0:20601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be210b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.040315:0:20601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be210b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.040794:0:20601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10000/0xaa253ed19be210bf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.040804:0:20601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10000/0xaa253ed19be210bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.040823:0:20601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10000/0xaa253ed19be210bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117976.040859:0:20601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789117976.040863:0:20601:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789117976.040906:0:20601:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10000/0xaa253ed19be210bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.040917:0:20601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be210b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.040923:0:20601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be210b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.040930:0:20601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be210b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.040936:0:20601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc11800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117976.040940:0:20601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be210b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.040948:0:20601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be210b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.040960:0:20601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b832cc200) 00010000:00010000:0.0:1789117976.040973:0:20601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117976.040979:0:20601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be210b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.040986:0:20601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be210b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.041013:0:20601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be210b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.041020:0:20601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be210b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.041026:0:20601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be210b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.041031:0:20601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc11400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117976.041034:0:20601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be210b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.041040:0:20601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be210b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.041048:0:20601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff962b832cc100) 00010000:00010000:0.0:1789117976.041050:0:20601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117976.041099:0:20601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be210b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.041106:0:20601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be210b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.041142:0:20601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be210aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f304 expref: 8 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.041157:0:20601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10000/0xaa253ed19be210bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f304 expref: 7 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.041175:0:20601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff962b832ccb00) 00010000:00010000:0.0:1789117976.041177:0:20601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789117976.041179:0:20601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbbc10000, rc 0) 00000100:00080000:1.0:1789117976.042525:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117976.042578:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+7:15842:x1876025572200576:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 2394us (2767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117976.042589:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:0.0:1789117976.049457:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117976.049657:0:17809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572200704 00000100:00100000:2.0:1789117976.049668:0:17809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572200704 00000100:00100000:2.0:1789117976.049773:0:17809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:2.0:1789117976.049786:0:17809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:369a8077-26bb-4780-baf3-16abc59c8ae5+7:15842:x1876025572200704:12345-192.168.204.30@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789117976.049909:0:17809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:369a8077-26bb-4780-baf3-16abc59c8ae5+7:15842:x1876025572200704:12345-192.168.204.30@tcp:900:lhsmtool_posix.0 Request processed in 125us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117976.049918:0:17809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:2.0:1789117976.052615:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117976.052768:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572200960 00000100:00100000:0.0:1789117976.052783:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572200960 00000100:00100000:0.0:1789117976.052934:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:0.0:1789117976.052952:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+7:15842:x1876025572200960:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789117976.052987:0:17800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117976.053019:0:17800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be210c6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f30b expref: -99 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.053311:0:17800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be210cd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.053347:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be210cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.053365:0:17800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be210cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.053459:0:17800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be210d4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.053468:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be210d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.053475:0:17800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be210d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.053625:0:17800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70de00/0xaa253ed19be210db lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.053634:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70de00/0xaa253ed19be210db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.053642:0:17800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70de00/0xaa253ed19be210db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117976.053653:0:17800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1789117976.053838:0:17800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be210cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.053848:0:17800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be210cd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.053855:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be210cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.053861:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70ca00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117976.053866:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be210cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.053887:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be210cd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.053901:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff962b832ccb00) 00010000:00010000:1.0:1789117976.053904:0:17800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117976.053910:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be210cd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.053916:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70ca00/0xaa253ed19be210cd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.053933:0:17800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be210d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.053938:0:17800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be210d4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.053944:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be210d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.053950:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117976.053952:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be210d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.053958:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be210d4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.053965:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff962b95e52500) 00010000:00010000:1.0:1789117976.053967:0:17800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117976.053970:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be210d4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.053985:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c600/0xaa253ed19be210d4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.058016:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be210c6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f30b expref: 10 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.058099:0:17800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70de00/0xaa253ed19be210db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f30b expref: 9 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.058111:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff962b95e52b00) 00010000:00010000:1.0:1789117976.058114:0:17800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117976.058120:0:17800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70de00, rc 0) 00000100:00100000:1.0:1789117976.058223:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+9:15842:x1876025572200960:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 5276us (5628us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789117976.058231:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:3.0:1789117976.071764:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117976.072163:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572201088 00000100:00100000:2.0:1789117976.072177:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572201088 00000100:00100000:2.0:1789117976.072458:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:2.0:1789117976.072491:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+9:15842:x1876025572201088:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789117976.072687:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+9:15842:x1876025572201088:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 Request processed in 213us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117976.072696:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:0.0:1789117976.091198:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117976.091324:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572201216 00000100:00100000:2.0:1789117976.091342:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572201216 00000100:00100000:2.0:1789117976.091460:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:2.0:1789117976.091476:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+5:15842:x1876025572201216:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1789117976.091602:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1789117976.095033:0:17798:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3496us 00000100:00100000:0.0:1789117976.110642:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117976.111342:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572201344 00000100:00100000:3.0:1789117976.111355:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572201344 00000100:00100000:3.0:1789117976.111432:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00100000:3.0:1789117976.111444:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+9:15848:x1876025572201344:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1789117976.111471:0:20601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117976.111500:0:20601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b200/0xaa253ed19be210e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f312 expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.111574:0:20601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9be00/0xaa253ed19be210f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.111588:0:20601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9be00/0xaa253ed19be210f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.111613:0:20601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9be00/0xaa253ed19be210f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.111629:0:20601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b800/0xaa253ed19be210f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.111636:0:20601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b800/0xaa253ed19be210f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.111643:0:20601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b800/0xaa253ed19be210f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.111687:0:20601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9be00/0xaa253ed19be210f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.111694:0:20601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9be00/0xaa253ed19be210f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.111700:0:20601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9be00/0xaa253ed19be210f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.111707:0:20601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9be00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117976.111711:0:20601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9be00/0xaa253ed19be210f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.111718:0:20601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9be00/0xaa253ed19be210f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.111730:0:20601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b832cc200) 00010000:00010000:3.0:1789117976.111733:0:20601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117976.111738:0:20601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9be00/0xaa253ed19be210f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.111749:0:20601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9be00/0xaa253ed19be210f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.111761:0:20601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b800/0xaa253ed19be210f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.111767:0:20601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b800/0xaa253ed19be210f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.111772:0:20601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b800/0xaa253ed19be210f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.111777:0:20601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9b800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117976.111780:0:20601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b800/0xaa253ed19be210f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.111785:0:20601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b800/0xaa253ed19be210f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.111791:0:20601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff962b8ebd4f00) 00010000:00010000:3.0:1789117976.111794:0:20601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117976.111797:0:20601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b800/0xaa253ed19be210f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.111803:0:20601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b800/0xaa253ed19be210f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.111837:0:20601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b200/0xaa253ed19be210e9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f312 expref: 10 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.111858:0:20601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b832cc200) 00010000:00010000:3.0:1789117976.111860:0:20601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117976.111864:0:20601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b200/0xaa253ed19be210e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f312 expref: 10 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.111873:0:20601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a88d9b200, rc 0) 00000100:00100000:3.0:1789117976.111956:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+9:15848:x1876025572201344:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 513us (1323us total) trans 0 rc 301/301 00000100:00100000:3.0:1789117976.111974:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00100000:0.0:1789117976.123040:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+5:15842:x1876025572201216:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 Request processed in 31555us (31843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117976.123094:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:3.0:1789117976.126471:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117976.127817:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572201472 00000100:00100000:1.0:1789117976.127840:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572201472 00000100:00100000:1.0:1789117976.128090:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:1.0:1789117976.128104:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:369a8077-26bb-4780-baf3-16abc59c8ae5+9:15848:x1876025572201472:12345-192.168.204.30@tcp:700:lfs.0 00000100:00100000:1.0:1789117976.128208:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:369a8077-26bb-4780-baf3-16abc59c8ae5+9:15848:x1876025572201472:12345-192.168.204.30@tcp:700:lfs.0 Request processed in 107us (1748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117976.128216:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:1.0:1789117976.138113:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117976.138240:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572201728 00000100:00100000:0.0:1789117976.138253:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572201728 00000100:00100000:0.0:1789117976.138351:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00100000:0.0:1789117976.138363:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88565e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+9:15848:x1876025572201728:12345-192.168.204.30@tcp:36:lfs.0 00010000:00010000:0.0:1789117976.138447:0:17800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117976.138505:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21017 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f27f expref: 9 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.138529:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b832cc200) 00010000:00010000:0.0:1789117976.138535:0:17800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117976.138611:0:17800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10a00/0xaa253ed19be210fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.138630:0:17800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21056 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2ef expref: 5 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.138639:0:17800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10a00/0xaa253ed19be210fe lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.138678:0:17800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21056 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2ef expref: 5 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.138695:0:17800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21056 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2ef expref: 5 pid: 17798 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117976.138727:0:17800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed9b840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17800:1876025593278720:192.168.204.30@tcp:104: 00000100:00100000:0.0:1789117976.138850:0:17800:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8e9e1000 going to sleep for 11 seconds 00000100:00100000:0.0:1789117976.149610:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117976.149768:0:17785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572201856 00000100:00100000:3.0:1789117976.149778:0:17785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572201856 00010000:00010000:3.0:1789117976.149844:0:17785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21056 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2ef expref: 6 pid: 17798 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117976.149894:0:17785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:3.0:1789117976.149906:0:17785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed9a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:2407:x1876025572201856:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117976.149923:0:17785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117976.149930:0:17785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21056 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2ef expref: 6 pid: 17798 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.149945:0:17785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21056 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2ef expref: 6 pid: 17798 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.149973:0:17785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b832cc200) 00010000:00010000:3.0:1789117976.149994:0:17785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10a00/0xaa253ed19be210fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.150005:0:17785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10a00/0xaa253ed19be210fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.150013:0:17785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10a00/0xaa253ed19be210fe lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.150037:0:17785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117976.150129:0:17785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed9a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:2407:x1876025572201856:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 225us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117976.150138:0:17785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00080000:0.0:1789117976.151538:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789117976.153227:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21056 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2ef expref: 5 pid: 17798 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117976.153298:0:17800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed9b840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17800:1876025593278720:192.168.204.30@tcp:104: 00010000:00010000:1.0:1789117976.153326:0:17800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10a00/0xaa253ed19be210fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.153337:0:17800:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10a00/0xaa253ed19be210fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.153343:0:17800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10a00/0xaa253ed19be210fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.153368:0:17800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70cc00/0xaa253ed19be21105 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.153382:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70cc00/0xaa253ed19be21105 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.153393:0:17800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70cc00/0xaa253ed19be21105 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.158805:0:17800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c000/0xaa253ed19be2110c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.158835:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c000/0xaa253ed19be2110c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.158848:0:17800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c000/0xaa253ed19be2110c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789117976.158867:0:17800:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b0c9f45f reply state 00000000b785eca8 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c000/0xaa253ed19be2110c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.158891:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c000/0xaa253ed19be2110c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.158899:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff962b95e52d00) 00010000:00010000:1.0:1789117976.158902:0:17800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789117976.158907:0:17800:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789117976.158912:0:17800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789117976.158922:0:17800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10a00/0xaa253ed19be210fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.158929:0:17800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10a00/0xaa253ed19be210fe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.158936:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10a00/0xaa253ed19be210fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.158943:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc10a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117976.158948:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10a00/0xaa253ed19be210fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.158955:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10a00/0xaa253ed19be210fe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.158968:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b832cc200) 00010000:00010000:1.0:1789117976.158971:0:17800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117976.158975:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10a00/0xaa253ed19be210fe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.158982:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10a00/0xaa253ed19be210fe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789117976.159017:0:17800:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b0c9f45f reply state 00000000b785eca8 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70cc00/0xaa253ed19be21105 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.159027:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70cc00/0xaa253ed19be21105 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.159034:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff962b95e52500) 00010000:00010000:1.0:1789117976.159036:0:17800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789117976.159038:0:17800:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789117976.162099:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88565e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+10:15848:x1876025572201728:12345-192.168.204.30@tcp:36:lfs.0 Request processed in 23723us (23986us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789117976.162115:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00100000:0.0:1789117976.247475:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117976.248200:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572201984 00000100:00100000:2.0:1789117976.248308:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572201984 00000100:00100000:2.0:1789117976.248538:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00100000:2.0:1789117976.248551:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+10:15856:x1876025572201984:12345-192.168.204.30@tcp:101:lctl.0 00010000:00010000:2.0:1789117976.248585:0:17799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117976.248633:0:17799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21113 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f319 expref: -99 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.249609:0:17799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be2111a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.249630:0:17799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be2111a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.249644:0:17799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be2111a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117976.249698:0:17799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789117976.249703:0:17799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789117976.256012:0:17799:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be2111a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.256097:0:17799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21113 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f319 expref: 12 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.256129:0:17799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be2111a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f319 expref: 11 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.256141:0:17799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962a85f4ba00) 00010000:00010000:2.0:1789117976.256144:0:17799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789117976.256149:0:17799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93200, rc 0) 00000100:00100000:2.0:1789117976.256264:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+11:15856:x1876025572201984:12345-192.168.204.30@tcp:101:lctl.0 Request processed in 7714us (8804us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117976.256283:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00100000:2.0:1789117976.294179:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117976.294613:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572202112 00000100:00100000:1.0:1789117976.294636:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572202112 00000100:00100000:0.0:1789117976.294877:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:0.0:1789117976.294893:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:15857:x1876025572202112:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1789117976.294922:0:17800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117976.294971:0:17800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21121 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f320 expref: -99 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.295158:0:17800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10a00/0xaa253ed19be21128 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.295185:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10a00/0xaa253ed19be21128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.295205:0:17800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10a00/0xaa253ed19be21128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117976.295316:0:17800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789117976.295321:0:17800:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789117976.295358:0:17800:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10a00/0xaa253ed19be21128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.295398:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21121 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f320 expref: 7 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.295431:0:17800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10a00/0xaa253ed19be21128 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f320 expref: 6 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.295443:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962a85f4ba00) 00010000:00010000:0.0:1789117976.295447:0:17800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789117976.295453:0:17800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbbc10a00, rc 0) 00000100:00100000:0.0:1789117976.295587:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:15857:x1876025572202112:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 697us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117976.295596:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:0.0:1789117976.299865:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117976.300035:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572202240 00000100:00100000:2.0:1789117976.300105:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572202240 00000100:00100000:2.0:1789117976.300204:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:2.0:1789117976.300216:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:15857:x1876025572202240:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789117976.300243:0:17798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117976.300282:0:17798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be2112f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f327 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300389:0:17798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21136 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300407:0:17798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21136 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300422:0:17798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21136 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300434:0:17798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2113d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300443:0:17798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2113d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300449:0:17798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2113d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300559:0:17798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be21144 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300568:0:17798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be21144 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300589:0:17798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be21144 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117976.300643:0:17798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789117976.300648:0:17798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789117976.300676:0:17798:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be21144 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300691:0:17798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21136 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300698:0:17798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21136 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300706:0:17798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21136 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300713:0:17798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117976.300718:0:17798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21136 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300725:0:17798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21136 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300739:0:17798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962a85f4ba00) 00010000:00010000:2.0:1789117976.300743:0:17798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117976.300749:0:17798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21136 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300757:0:17798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21136 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300786:0:17798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2113d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300793:0:17798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2113d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300799:0:17798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2113d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300804:0:17798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117976.300807:0:17798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2113d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300814:0:17798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2113d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300822:0:17798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff962b95e52500) 00010000:00010000:2.0:1789117976.300824:0:17798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117976.300827:0:17798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2113d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300834:0:17798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2113d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300865:0:17798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be2112f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f327 expref: 8 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300880:0:17798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be21144 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f327 expref: 7 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.300900:0:17798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff962b95e52d00) 00010000:00010000:2.0:1789117976.300902:0:17798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789117976.300905:0:17798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92200, rc 0) 00000100:00100000:2.0:1789117976.301012:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+7:15857:x1876025572202240:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 796us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117976.301021:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:2.0:1789117976.306295:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117976.306605:0:17810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572202368 00000100:00100000:1.0:1789117976.306623:0:17810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572202368 00000100:00100000:1.0:1789117976.306808:0:17810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:1.0:1789117976.306824:0:17810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:15857:x1876025572202368:12345-192.168.204.30@tcp:900:lfs.0 00000100:00100000:1.0:1789117976.307002:0:17810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:15857:x1876025572202368:12345-192.168.204.30@tcp:900:lfs.0 Request processed in 181us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117976.307013:0:17810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00080000:0.0:1789117976.307193:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789117976.313140:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117976.313751:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572202624 00000100:00100000:0.0:1789117976.313766:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572202624 00000100:00100000:0.0:1789117976.313890:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 32 00000100:00100000:0.0:1789117976.313903:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a40d558-cfad-4484-8c6e-52e7fbfb6447+7:15857:x1876025572202624:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1789117976.313931:0:17800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117976.313962:0:17800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be2114b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f32e expref: -99 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117976.314179:0:17800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789117976.315264:0:17800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be2114b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f32e expref: 9 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.315365:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962a85f4ba00) 00010000:00010000:0.0:1789117976.315370:0:17800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789117976.315378:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be2114b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f32e expref: 9 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.315398:0:17800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbbc11600, rc 0) 00000100:00100000:0.0:1789117976.315559:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a40d558-cfad-4484-8c6e-52e7fbfb6447+8:15857:x1876025572202624:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 1657us (2438us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1789117976.315569:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 32 00000100:00100000:3.0:1789117976.324389:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117976.324617:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572202880 00000100:00100000:2.0:1789117976.324635:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572202880 00000100:00100000:2.0:1789117976.325339:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:2.0:1789117976.325356:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+8:15857:x1876025572202880:12345-192.168.204.30@tcp:36:lfs.0 00010000:00010000:2.0:1789117976.325475:0:17798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117976.325524:0:17798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be21144 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f327 expref: 8 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.325552:0:17798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff962b95e52d00) 00010000:00010000:2.0:1789117976.325559:0:17798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117976.325595:0:17798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21159 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.325613:0:17798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21159 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.325627:0:17798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21159 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789117976.325993:0:17798:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000da462d17 reply state 00000000408a4a7c transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21159 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.326036:0:17798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21159 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.326043:0:17798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff962b95e52d00) 00010000:00010000:2.0:1789117976.326050:0:17798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1789117976.326106:0:17798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789117976.326120:0:17798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789117976.326261:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+9:15857:x1876025572202880:12345-192.168.204.30@tcp:36:lfs.0 Request processed in 908us (2552us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789117976.326282:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:2.0:1789117976.332432:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117976.332515:0:17802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572203136 00000100:00100000:1.0:1789117976.332540:0:17802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572203136 00000100:00100000:1.0:1789117976.332622:0:17802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:1.0:1789117976.332637:0:17802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a886270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a40d558-cfad-4484-8c6e-52e7fbfb6447+9:15857:x1876025572203136:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:1.0:1789117976.333028:0:17802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a886270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a40d558-cfad-4484-8c6e-52e7fbfb6447+10:15857:x1876025572203136:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 392us (609us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789117976.333122:0:17802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:3.0:1789117976.340590:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117976.341042:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572203392 00000100:00100000:1.0:1789117976.341104:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572203392 00000100:00100000:1.0:1789117976.341761:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 34 00000100:00100000:1.0:1789117976.341783:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a40d558-cfad-4484-8c6e-52e7fbfb6447+10:15857:x1876025572203392:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1789117976.341818:0:20601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117976.341869:0:20601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70dc00/0xaa253ed19be21160 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f335 expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.342020:0:20601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be21167 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.342041:0:20601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be21167 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.342102:0:20601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be21167 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.342119:0:20601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be2116e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.342128:0:20601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be2116e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.342138:0:20601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be2116e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117976.342484:0:20601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789117976.342599:0:20601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be21167 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.342630:0:20601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be21167 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.342638:0:20601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be21167 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.342644:0:20601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117976.342650:0:20601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be21167 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.342658:0:20601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be21167 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.342673:0:20601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962a85f4ba00) 00010000:00010000:1.0:1789117976.342677:0:20601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117976.342682:0:20601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be21167 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.342689:0:20601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be21167 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.343170:0:20601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be2116e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.343179:0:20601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be2116e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.343186:0:20601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be2116e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.343192:0:20601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117976.343204:0:20601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be2116e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.343223:0:20601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be2116e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.343233:0:20601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff962b95e52500) 00010000:00010000:1.0:1789117976.343236:0:20601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117976.343239:0:20601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be2116e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.343245:0:20601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be2116e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.343553:0:20601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70dc00/0xaa253ed19be21160 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f335 expref: 12 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.343568:0:20601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962a85f4ba00) 00010000:00010000:1.0:1789117976.343571:0:20601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789117976.343575:0:20601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70dc00/0xaa253ed19be21160 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f335 expref: 12 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.343587:0:20601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70dc00, rc 0) 00000100:00100000:1.0:1789117976.343691:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a40d558-cfad-4484-8c6e-52e7fbfb6447+11:15857:x1876025572203392:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 1914us (3118us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1789117976.351120:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 34 00000100:00100000:2.0:1789117976.351516:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117976.351968:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572203520 00000100:00100000:0.0:1789117976.351982:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572203520 00000100:00100000:2.0:1789117976.352505:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 35 00000100:00100000:2.0:1789117976.352600:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88627840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+11:15857:x1876025572203520:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789117976.352636:0:17798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117976.352668:0:17798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be2117c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f33c expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.355513:0:17798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be21183 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.355548:0:17798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be21183 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.355569:0:17798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be21183 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117976.355631:0:17798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789117976.355658:0:17798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789117976.355696:0:17798:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be21183 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.356097:0:17798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be2117c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f33c expref: 13 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.356126:0:17798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be21183 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f33c expref: 12 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.356139:0:17798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff962b95e52d00) 00010000:00010000:2.0:1789117976.356142:0:17798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789117976.356147:0:17798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93c00, rc 0) 00000100:00100000:2.0:1789117976.356282:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88627840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+12:15857:x1876025572203520:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 3763us (4766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117976.356292:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 35 00000100:00100000:2.0:1789117976.361562:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117976.361768:0:17801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572203648 00000100:00100000:3.0:1789117976.361787:0:17801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572203648 00000100:00100000:3.0:1789117976.361894:0:17801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:3.0:1789117976.361910:0:17801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88624f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+12:15857:x1876025572203648:12345-192.168.204.30@tcp:37:lfs.0 00000100:00100000:2.0:1789117976.369853:0:17801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88624f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+12:15857:x1876025572203648:12345-192.168.204.30@tcp:37:lfs.0 Request processed in 7925us (8288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117976.369876:0:17801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:2.0:1789117976.374686:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117976.374818:0:17802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572203904 00000100:00100000:1.0:1789117976.374845:0:17802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572203904 00000100:00100000:1.0:1789117976.374922:0:17802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:1.0:1789117976.374936:0:17802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86d94450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a40d558-cfad-4484-8c6e-52e7fbfb6447+12:15857:x1876025572203904:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:1.0:1789117976.375589:0:17802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86d94450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a40d558-cfad-4484-8c6e-52e7fbfb6447+13:15857:x1876025572203904:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 651us (916us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789117976.375600:0:17802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:0.0:1789117976.439349:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117976.439544:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572204032 00000100:00100000:1.0:1789117976.439561:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572204032 00000100:00100000:1.0:1789117976.439660:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:1.0:1789117976.439673:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+11:15863:x1876025572204032:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:1.0:1789117976.439714:0:17800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117976.439743:0:17800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70dc00/0xaa253ed19be2118a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f343 expref: -99 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.439857:0:17800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be21191 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.439878:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be21191 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.439894:0:17800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be21191 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.439909:0:17800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be21198 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.439917:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be21198 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.439923:0:17800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be21198 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.440040:0:17800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d600/0xaa253ed19be2119f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.440122:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d600/0xaa253ed19be2119f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.440129:0:17800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d600/0xaa253ed19be2119f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117976.440183:0:17800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789117976.440189:0:17800:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789117976.440253:0:17800:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d600/0xaa253ed19be2119f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.440280:0:17800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be21191 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.440289:0:17800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be21191 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.440305:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be21191 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.440312:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117976.440319:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be21191 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.440329:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be21191 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.440347:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962a85f4ba00) 00010000:00010000:1.0:1789117976.440351:0:17800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117976.440358:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be21191 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.440377:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be21191 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.440395:0:17800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be21198 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.440401:0:17800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be21198 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.440407:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be21198 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.440414:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117976.440417:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be21198 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.440424:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be21198 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.440431:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff962b95e52500) 00010000:00010000:1.0:1789117976.440434:0:17800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117976.440437:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be21198 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.440443:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be21198 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.440480:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70dc00/0xaa253ed19be2118a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f343 expref: 13 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.440508:0:17800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d600/0xaa253ed19be2119f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f343 expref: 12 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.440517:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff962b95e52d00) 00010000:00010000:1.0:1789117976.440519:0:17800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789117976.440522:0:17800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70d600, rc 0) 00000100:00100000:1.0:1789117976.440632:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+12:15863:x1876025572204032:12345-192.168.204.30@tcp:101:bash.0 Request processed in 960us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117976.440642:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:3.0:1789117976.445558:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117976.446686:0:17810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572204160 00000100:00100000:1.0:1789117976.446704:0:17810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572204160 00000100:00100000:1.0:1789117976.447121:0:17810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:1.0:1789117976.447138:0:17810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:369a8077-26bb-4780-baf3-16abc59c8ae5+5:15863:x1876025572204160:12345-192.168.204.30@tcp:900:bash.0 00000100:00100000:1.0:1789117976.447569:0:17810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:369a8077-26bb-4780-baf3-16abc59c8ae5+5:15863:x1876025572204160:12345-192.168.204.30@tcp:900:bash.0 Request processed in 432us (2027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117976.447580:0:17810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:3.0:1789117976.451246:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117976.451544:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572204416 00000100:00100000:0.0:1789117976.451561:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572204416 00000100:00100000:0.0:1789117976.451670:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00100000:0.0:1789117976.451684:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+12:15863:x1876025572204416:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:0.0:1789117976.451740:0:17799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117976.451771:0:17799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be211a6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f34a expref: -99 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.451966:0:17799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be211ad lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.451987:0:17799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be21183 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f33c expref: 12 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.451996:0:17799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be211ad lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.452045:0:17799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be21183 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f33c expref: 12 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117976.452090:0:17799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be21183 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f33c expref: 12 pid: 17798 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117976.452108:0:17799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed98b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17799:1876025593278848:192.168.204.30@tcp:104: 00000100:00100000:0.0:1789117976.453665:0:17799:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8e9e1900 going to sleep for 11 seconds 00000100:00100000:2.0:1789117976.458417:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117976.458553:0:17799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed98b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17799:1876025593278848:192.168.204.30@tcp:104: 00010000:00010000:1.0:1789117976.458600:0:17799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be211ad lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117976.459098:0:17784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572204544 00000100:00100000:3.0:1789117976.459115:0:17784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572204544 00010000:00010000:3.0:1789117976.459184:0:17784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be21183 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f33c expref: 13 pid: 17798 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117976.459235:0:17784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:3.0:1789117976.459247:0:17784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88626580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a40d558-cfad-4484-8c6e-52e7fbfb6447+13:2406:x1876025572204544:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117976.459316:0:17784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117976.459325:0:17784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be21183 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f33c expref: 13 pid: 17798 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.459340:0:17784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be21183 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f33c expref: 13 pid: 17798 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.459367:0:17784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be21183 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f33c expref: 13 pid: 17798 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.459388:0:17784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff962b95e52d00) 00010000:00010000:3.0:1789117976.459394:0:17784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be211ad lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.459406:0:17784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be211ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.459416:0:17784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be211ad lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.459444:0:17784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789117976.459564:0:17799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be211ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.459572:0:17799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be211ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.459611:0:17799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70dc00/0xaa253ed19be211b4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.459621:0:17799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70dc00/0xaa253ed19be211b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.459629:0:17799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70dc00/0xaa253ed19be211b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.460457:0:17799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be211bb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.460473:0:17799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be211bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.460482:0:17799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be211bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117976.460495:0:17799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789117976.460528:0:17799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be211ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.460536:0:17799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be211ad lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.460544:0:17799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be211ad lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.460551:0:17799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc10e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117976.460556:0:17799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be211ad lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.460579:0:17799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be211ad lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.460593:0:17799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff962b95e52d00) 00010000:00010000:1.0:1789117976.460596:0:17799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117976.460602:0:17799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be211ad lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.460609:0:17799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be211ad lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789117976.460624:0:17799:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004f1ff535 reply state 00000000e1e8dae0 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70dc00/0xaa253ed19be211b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.460637:0:17799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70dc00/0xaa253ed19be211b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.460644:0:17799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff962b95e52200) 00010000:00010000:1.0:1789117976.460647:0:17799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789117976.460650:0:17799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789117976.460696:0:17799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be211a6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f34a expref: 15 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.460712:0:17799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be211bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f34a expref: 14 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.460720:0:17799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:1.0:1789117976.460722:0:17799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789117976.460725:0:17799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70d800, rc 0) 00000100:00100000:3.0:1789117976.462287:0:17784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88626580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a40d558-cfad-4484-8c6e-52e7fbfb6447+12:2406:x1876025572204544:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 3005us (3850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117976.462315:0:17784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:1.0:1789117976.462986:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+15:15863:x1876025572204416:12345-192.168.204.30@tcp:101:bash.0 Request processed in 11294us (11746us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1789117976.463000:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00100000:2.0:1789117976.479978:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117976.480428:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572204672 00000100:00100000:1.0:1789117976.480444:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572204672 00000100:00100000:1.0:1789117976.480556:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 38 00000100:00100000:1.0:1789117976.480570:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88626940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+15:15863:x1876025572204672:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:1.0:1789117976.480612:0:17800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117976.480646:0:17800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be211c9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f351 expref: -99 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.481001:0:17800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d400/0xaa253ed19be211d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.481024:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d400/0xaa253ed19be211d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.481040:0:17800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d400/0xaa253ed19be211d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117976.481167:0:17800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789117976.481173:0:17800:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789117976.481199:0:17800:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d400/0xaa253ed19be211d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.481212:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d400/0xaa253ed19be211d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.481247:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be211c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f351 expref: 17 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.481392:0:17800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d400/0xaa253ed19be211d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f351 expref: 16 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.481403:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:1.0:1789117976.481407:0:17800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117976.481412:0:17800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70d400, rc 0) 00000100:00100000:1.0:1789117976.481640:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88626940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+16:15863:x1876025572204672:12345-192.168.204.30@tcp:101:bash.0 Request processed in 1071us (1678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117976.481650:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 38 00000100:00100000:0.0:1789117976.490433:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117976.490657:0:17801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572204928 00000100:00100000:2.0:1789117976.490675:0:17801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572204928 00000100:00100000:2.0:1789117976.490785:0:17801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:2.0:1789117976.490800:0:17801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+16:15863:x1876025572204928:12345-192.168.204.30@tcp:35:bash.0 00000100:00100000:2.0:1789117976.491804:0:17801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+17:15863:x1876025572204928:12345-192.168.204.30@tcp:35:bash.0 Request processed in 1000us (1384us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789117976.491850:0:17801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 5 00010000:00010000:1.0:1789117976.549672:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117976.587164:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117976.587364:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572205184 00000100:00100000:3.0:1789117976.587385:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572205184 00000100:00100000:3.0:1789117976.587801:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:3.0:1789117976.587818:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a886261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+17:15873:x1876025572205184:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1789117976.587951:0:17798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117976.588095:0:17798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b200/0xaa253ed19be211d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f358 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117976.588272:0:17798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789117976.588413:0:17798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b200/0xaa253ed19be211d7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f358 expref: 19 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.588430:0:17798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962a85f4ba00) 00010000:00010000:3.0:1789117976.588434:0:17798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789117976.588440:0:17798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b200/0xaa253ed19be211d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f358 expref: 19 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117976.588458:0:17798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a88d9b200, rc 0) 00000100:00100000:3.0:1789117976.588610:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a886261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+18:15873:x1876025572205184:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 796us (1469us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1789117976.588619:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:0.0:1789117976.593496:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117976.593594:0:17802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572205440 00000100:00100000:1.0:1789117976.593613:0:17802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572205440 00000100:00100000:1.0:1789117976.593712:0:17802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:1.0:1789117976.593726:0:17802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86809680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+18:15873:x1876025572205440:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:1.0:1789117976.594356:0:17802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86809680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+19:15873:x1876025572205440:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 629us (876us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1789117976.594367:0:17802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 6 00000040:00080000:3.0:1789117976.617213:0:18556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789117976.660953:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117976.661453:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572205696 00000100:00100000:3.0:1789117976.661469:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572205696 00000100:00100000:3.0:1789117976.661629:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 40 00000100:00100000:3.0:1789117976.661642:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86808b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+19:15876:x1876025572205696:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1789117976.661685:0:20601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117976.661946:0:20601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b800/0xaa253ed19be211e5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f35f expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.664128:0:20601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be211ec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.664165:0:20601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be211ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.664186:0:20601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be211ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117976.664378:0:20601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789117976.664662:0:20601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b800/0xaa253ed19be211e5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f35f expref: 22 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.664693:0:20601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be211ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f35f expref: 21 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.664863:0:20601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:2.0:1789117976.664867:0:20601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789117976.664873:0:20601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93000, rc 0) 00000100:00100000:2.0:1789117976.664982:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86808b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+21:15876:x1876025572205696:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 3342us (4049us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789117976.664994:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 40 00000100:00100000:3.0:1789117976.668873:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117976.669084:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572205824 00000100:00100000:2.0:1789117976.669101:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572205824 00000100:00100000:2.0:1789117976.669237:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 41 00000100:00100000:2.0:1789117976.669267:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+21:15876:x1876025572205824:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:2.0:1789117976.669409:0:17799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be211fa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.669435:0:17799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be211fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.669451:0:17799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be211fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.669631:0:17799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be211fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.669640:0:17799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be211fa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.669648:0:17799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be211fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.669655:0:17799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117976.669661:0:17799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be211fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.669670:0:17799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be211fa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.669687:0:17799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:2.0:1789117976.669692:0:17799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789117976.669698:0:17799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be211fa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117976.669705:0:17799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be211fa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117976.669841:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+21:15876:x1876025572205824:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 591us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117976.669850:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 41 00000100:00100000:0.0:1789117976.671031:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117976.674766:0:17783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572205952 00000100:00100000:1.0:1789117976.674794:0:17783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572205952 00000100:00100000:1.0:1789117976.674920:0:17783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:1.0:1789117976.674933:0:17783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd1092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+21:2407:x1876025572205952:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117976.674960:0:17783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117976.675004:0:17783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be211ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f35f expref: 21 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117976.675094:0:17783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:1.0:1789117976.675104:0:17783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117976.677119:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117976.677329:0:17802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572206208 00000100:00100000:3.0:1789117976.677343:0:17802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572206208 00000100:00100000:3.0:1789117976.677422:0:17802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:3.0:1789117976.677436:0:17802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a886243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+21:15876:x1876025572206208:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:1.0:1789117976.677967:0:17783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd1092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+21:2407:x1876025572205952:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 3031us (6940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117976.677982:0:17783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:3.0:1789117976.681787:0:17802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a886243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+21:15876:x1876025572206208:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 4337us (4670us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1789117976.681807:0:17802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:1.0:1789117976.935276:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbd108780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593279104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789117976.935557:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88625e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593278976:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789117976.935829:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117976.935977:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593278976 00000100:00100000:2.0:1789117976.935989:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593278976 00000100:00100000:2.0:1789117976.940888:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789117976.940928:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593278976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789117976.940999:0:17803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789117976.945222:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593278976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4303us (9385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117976.945241:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789117976.948505:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117976.948923:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593279104 00000100:00100000:0.0:1789117976.948944:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593279104 00000100:00100000:0.0:1789117976.949047:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789117976.949130:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593279104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789117976.949205:0:18751:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789117976.953189:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88625e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593278976:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117976.957764:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593279104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8621us (9251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117976.957784:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789117976.957994:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbd108780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593279104:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1789117977.000290:0:17834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789117977.028478:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117977.029492:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572206464 00000100:00100000:2.0:1789117977.029504:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572206464 00000100:00100000:2.0:1789117977.029631:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 42 00000100:00100000:2.0:1789117977.029641:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd10b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+21:15907:x1876025572206464:12345-192.168.204.30@tcp:101:cat.0 00010000:00010000:2.0:1789117977.029666:0:17800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117977.029687:0:17800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be21201 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f366 expref: -99 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117977.030263:0:17800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21208 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117977.030282:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21208 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117977.030298:0:17800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21208 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117977.030329:0:17800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789117977.030473:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be21201 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f366 expref: 24 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117977.030492:0:17800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21208 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f366 expref: 23 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117977.030501:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:2.0:1789117977.030503:0:17800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789117977.030508:0:17800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93000, rc 0) 00000100:00100000:2.0:1789117977.030648:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd10b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+23:15907:x1876025572206464:12345-192.168.204.30@tcp:101:cat.0 Request processed in 1007us (2180us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789117977.030657:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 42 00000100:00100000:2.0:1789117977.045051:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117977.047003:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117977.047101:0:17801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572206848 00000100:00100000:0.0:1789117977.047111:0:17801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572206848 00000100:00100000:0.0:1789117977.047168:0:17801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:0.0:1789117977.047178:0:17801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a886270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+23:15907:x1876025572206848:12345-192.168.204.30@tcp:35:cat.0 00000100:00100000:0.0:1789117977.047468:0:17801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a886270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+24:15907:x1876025572206848:12345-192.168.204.30@tcp:35:cat.0 Request processed in 292us (472us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1789117977.047475:0:17801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:3.0:1789117977.058400:0:17784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572206592 00000100:00100000:3.0:1789117977.058427:0:17784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572206592 00000100:00100000:3.0:1789117977.058628:0:17784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00100000:3.0:1789117977.058642:0:17784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88625e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+24:2406:x1876025572206592:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117977.058662:0:17784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117977.058932:0:17784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21208 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f366 expref: 24 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.058955:0:17784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:3.0:1789117977.058961:0:17784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117977.059102:0:17784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88625e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+23:2406:x1876025572206592:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 414us (14011us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117977.059113:0:17784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00100000:2.0:1789117977.147329:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117977.148041:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572207104 00000100:00100000:3.0:1789117977.148102:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572207104 00000100:00100000:3.0:1789117977.148186:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 43 00000100:00100000:3.0:1789117977.148209:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88624f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+23:15913:x1876025572207104:12345-192.168.204.30@tcp:101:dd.0 00010000:00010000:3.0:1789117977.148237:0:17798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117977.148270:0:17798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b200/0xaa253ed19be21216 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f36d expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.148411:0:17798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9be00/0xaa253ed19be2121d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.148425:0:17798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9be00/0xaa253ed19be2121d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.148436:0:17798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9be00/0xaa253ed19be2121d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117977.148449:0:17798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789117977.148588:0:17798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b200/0xaa253ed19be21216 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f36d expref: 26 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.148608:0:17798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9be00/0xaa253ed19be2121d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f36d expref: 25 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.148617:0:17798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:3.0:1789117977.148619:0:17798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789117977.148624:0:17798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a88d9be00, rc 0) 00000100:00100000:3.0:1789117977.149161:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88624f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+25:15913:x1876025572207104:12345-192.168.204.30@tcp:101:dd.0 Request processed in 842us (1746us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1789117977.149172:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 43 00000100:00100000:0.0:1789117977.157551:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117977.158103:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572207232 00000100:00100000:1.0:1789117977.158119:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572207232 00000100:00100000:1.0:1789117977.158211:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 44 00000100:00100000:1.0:1789117977.158222:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd108780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+25:15913:x1876025572207232:12345-192.168.204.30@tcp:101:dd.0 00010000:00010000:1.0:1789117977.158264:0:20601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117977.158294:0:20601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be2122b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f374 expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117977.158557:0:20601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c400/0xaa253ed19be21232 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117977.158573:0:20601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c400/0xaa253ed19be21232 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117977.158584:0:20601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c400/0xaa253ed19be21232 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117977.158959:0:20601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d000/0xaa253ed19be2122b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f374 expref: 27 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117977.158995:0:20601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c400/0xaa253ed19be21232 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f374 expref: 26 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117977.159007:0:20601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:1.0:1789117977.159011:0:20601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789117977.159014:0:20601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70c400, rc 0) 00000100:00100000:1.0:1789117977.159220:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd108780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+26:15913:x1876025572207232:12345-192.168.204.30@tcp:101:dd.0 Request processed in 999us (1679us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117977.159229:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 44 00000100:00100000:2.0:1789117977.169321:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117977.169991:0:17783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572207360 00000100:00100000:1.0:1789117977.170003:0:17783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572207360 00000100:00100000:1.0:1789117977.170111:0:17783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:1.0:1789117977.170123:0:17783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+26:2407:x1876025572207360:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117977.170143:0:17783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117977.170179:0:17783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9be00/0xaa253ed19be2121d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f36d expref: 26 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117977.170202:0:17783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:1.0:1789117977.170208:0:17783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117977.170289:0:17783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+25:2407:x1876025572207360:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 167us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117977.170297:0:17783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:0.0:1789117977.179100:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117977.179288:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572207616 00000100:00100000:3.0:1789117977.179299:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572207616 00000100:00100000:3.0:1789117977.179425:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 45 00000100:00100000:3.0:1789117977.179436:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+25:15913:x1876025572207616:12345-192.168.204.30@tcp:36:dd.0 00010000:00010000:3.0:1789117977.179530:0:17798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117977.179569:0:17798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d400/0xaa253ed19be211d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f351 expref: 25 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.179596:0:17798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:3.0:1789117977.179603:0:17798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789117977.180037:0:17798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b200/0xaa253ed19be21239 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.180211:0:17798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b200/0xaa253ed19be21239 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.180223:0:17798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b200/0xaa253ed19be21239 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789117977.180291:0:17798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1789117977.180319:0:17798:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000028527052 reply state 00000000b5cd7ac8 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b200/0xaa253ed19be21239 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.180331:0:17798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b200/0xaa253ed19be21239 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.180338:0:17798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:3.0:1789117977.180341:0:17798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789117977.180344:0:17798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789117977.180478:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+27:15913:x1876025572207616:12345-192.168.204.30@tcp:36:dd.0 Request processed in 1042us (1427us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1789117977.180487:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 45 00000020:00080000:3.0:1789117977.180507:0:17798:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789117977.326993:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117977.327243:0:17801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572207872 00000100:00100000:0.0:1789117977.327268:0:17801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572207872 00000100:00100000:0.0:1789117977.327361:0:17801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:0.0:1789117977.327375:0:17801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+27:15913:x1876025572207872:12345-192.168.204.30@tcp:35:dd.0 00000100:00100000:0.0:1789117977.327890:0:17801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+28:15913:x1876025572207872:12345-192.168.204.30@tcp:35:dd.0 Request processed in 518us (923us total) trans 8589934611 rc 0/0 00000100:00100000:0.0:1789117977.327899:0:17801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:3.0:1789117977.446014:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a885652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593279232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117977.446141:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117977.446379:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a8681bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593279360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117977.446434:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117977.446909:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593279232 00000100:00100000:2.0:1789117977.446918:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593279232 00000100:00100000:2.0:1789117977.446971:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593279360 00000100:00100000:2.0:1789117977.446974:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593279360 00000100:00100000:2.0:1789117977.446996:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789117977.447005:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593279232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789117977.447038:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789117977.447119:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593279232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117977.447134:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789117977.447151:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789117977.447157:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593279360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789117977.447172:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789117977.447204:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593279360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117977.447211:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1789117977.447399:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789117977.447404:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789117977.447548:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789117977.447560:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593279488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117977.447593:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117977.447786:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a8681bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593279360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117977.448045:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a81aafc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593279744:0@lo:400:kworker.0 00000100:00100000:3.0:1789117977.448101:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117977.448122:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a81aac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593280256:0@lo:400:kworker.0 00000100:00100000:3.0:1789117977.448144:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117977.448177:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a885652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593279232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117977.448190:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789117977.448195:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a81aad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593279872:0@lo:400:kworker.0 00000100:00100000:3.0:1789117977.448218:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117977.448232:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a81aad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593280384:0@lo:400:kworker.0 00000100:00100000:3.0:1789117977.448265:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117977.448291:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593279744 00000100:00100000:3.0:1789117977.448296:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593279744 00000100:00100000:1.0:1789117977.448625:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a81aae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf05977c-16b5-4df3-81bb-3835e509f77c:3645:1876025593279616:0@lo:400:kworker.0 00000100:00100000:1.0:1789117977.448662:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117977.448699:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a81aaf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593280128:0@lo:400:kworker.0 00000100:00100000:1.0:1789117977.448786:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117977.448807:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789117977.448814:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a81aae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593280000:0@lo:400:kworker.0 00000100:00100000:1.0:1789117977.448837:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117977.448846:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a81aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593280512:0@lo:400:kworker.0 00000100:00100000:1.0:1789117977.448886:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117977.448935:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593280256 00000100:00100000:1.0:1789117977.448939:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593280256 00000100:00100000:1.0:1789117977.448970:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593280384 00000100:00100000:1.0:1789117977.448973:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593280384 00000100:00100000:1.0:1789117977.448986:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593280128 00000100:00100000:1.0:1789117977.448988:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593280128 00000100:00100000:1.0:1789117977.449000:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593280000 00000100:00100000:1.0:1789117977.449003:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593280000 00000100:00100000:1.0:1789117977.449014:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593280512 00000100:00100000:1.0:1789117977.449016:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593280512 00000100:00100000:1.0:1789117977.449031:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789117977.449039:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81aade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593280256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117977.449114:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81aade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593280256:12345-0@lo:400:kworker.0 Request processed in 75us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117977.449122:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789117977.449139:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789117977.449145:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81aacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593280384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117977.449172:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81aacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593280384:12345-0@lo:400:kworker.0 Request processed in 28us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117977.449189:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789117977.449200:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789117977.449206:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593280128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117977.449237:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876025593280128:12345-0@lo:400:kworker.0 Request processed in 32us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117977.449243:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789117977.449286:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a81aaf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593280128:0@lo:400:kworker.0 00000100:00100000:1.0:1789117977.449311:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789117977.449317:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593280000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117977.449363:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593280000:12345-0@lo:400:kworker.0 Request processed in 47us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117977.449369:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789117977.449391:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a81aae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593280000:0@lo:400:kworker.0 00000100:00100000:1.0:1789117977.449406:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789117977.449412:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593280512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117977.449443:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593280512:12345-0@lo:400:kworker.0 Request processed in 31us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117977.450000:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789117977.450015:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81aaed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593279744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117977.450079:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81aaed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593279744:12345-0@lo:400:kworker.0 Request processed in 70us (1977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117977.450086:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789117977.450134:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a81aad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593280384:0@lo:400:kworker.0 00000100:00100000:3.0:1789117977.450146:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a81aafc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593279744:0@lo:400:kworker.0 00010000:00080000:3.0:1789117977.450160:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a81aac780 x1876025593280256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117977.450188:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a81aac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593280256:0@lo:400:kworker.0 00010000:00080000:3.0:1789117977.450267:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a81aada40 x1876025593280512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117977.450278:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a81aada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593280512:0@lo:400:kworker.0 00000100:00100000:0.0:1789117977.450709:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593279872 00000100:00100000:0.0:1789117977.450718:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593279872 00000100:00100000:0.0:1789117977.450792:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789117977.450801:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81aae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593279872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117977.450870:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81aae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593279872:12345-0@lo:400:kworker.0 Request processed in 70us (2649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117977.450877:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789117977.450900:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593279616 00000100:00100000:0.0:1789117977.450904:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593279616 00000100:00100000:0.0:1789117977.450933:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789117977.450939:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+24:3645:x1876025593279616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117977.450974:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+24:3645:x1876025593279616:12345-0@lo:400:kworker.0 Request processed in 36us (2311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117977.450981:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:0.0:1789117977.451017:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789117977.451023:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789117977.451026:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789117977.451087:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a81aad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593279872:0@lo:400:kworker.0 00000100:00100000:2.0:1789117977.451279:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593279488 00000100:00100000:2.0:1789117977.451284:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593279488 00000100:00100000:2.0:1789117977.451348:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789117977.451357:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88566d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593279488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789117977.451379:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789117977.451424:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88566d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593279488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (3830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117977.451429:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1789117977.452877:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789117977.453416:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789117977.453543:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a81aae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf05977c-16b5-4df3-81bb-3835e509f77c:3645:1876025593279616:0@lo:400:kworker.0 00000100:00100000:3.0:1789117977.453574:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593279488:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789117977.593587:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117977.643134:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117977.644211:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572208000 00000100:00100000:3.0:1789117977.644232:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572208000 00000100:00100000:3.0:1789117977.644369:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 46 00000100:00100000:3.0:1789117977.644383:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a8681bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+28:15927:x1876025572208000:12345-192.168.204.30@tcp:101:stat.0 00010000:00010000:3.0:1789117977.644415:0:20601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117977.644445:0:20601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be21240 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f37b expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.644537:0:20601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be21247 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.644558:0:20601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be21247 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.644576:0:20601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be21247 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.644590:0:20601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be2124e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.644625:0:20601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be2124e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.644633:0:20601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be2124e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.644771:0:20601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9ae00/0xaa253ed19be21255 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.644781:0:20601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9ae00/0xaa253ed19be21255 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.644788:0:20601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9ae00/0xaa253ed19be21255 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117977.644842:0:20601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789117977.644848:0:20601:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789117977.644907:0:20601:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9ae00/0xaa253ed19be21255 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.644925:0:20601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9ae00/0xaa253ed19be21255 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.644936:0:20601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be21247 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.646383:0:20601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be21247 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.646409:0:20601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be21247 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.646440:0:20601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9a000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117977.646945:0:20601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be21247 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.646959:0:20601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be21247 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.647335:0:20601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff962b95e52d00) 00010000:00010000:3.0:1789117977.647339:0:20601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117977.647345:0:20601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be21247 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.647354:0:20601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be21247 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.647378:0:20601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be2124e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.647385:0:20601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be2124e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.647391:0:20601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be2124e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.647397:0:20601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9a800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117977.647399:0:20601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be2124e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.647406:0:20601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be2124e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.647430:0:20601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff962b95e52200) 00010000:00010000:3.0:1789117977.647433:0:20601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117977.647436:0:20601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be2124e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.648826:0:20601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be2124e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.648922:0:20601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be21240 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f37b expref: 30 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.648942:0:20601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9ae00/0xaa253ed19be21255 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f37b expref: 29 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117977.648952:0:20601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:3.0:1789117977.648955:0:20601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789117977.648959:0:20601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a88d9ae00, rc 0) 00000100:00100000:3.0:1789117977.649125:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a8681bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+29:15927:x1876025572208000:12345-192.168.204.30@tcp:101:stat.0 Request processed in 4743us (6012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117977.649140:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 46 00000100:00100000:2.0:1789117977.772313:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117977.772686:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572208256 00000100:00100000:0.0:1789117977.772697:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572208256 00000100:00100000:0.0:1789117977.772787:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 47 00000100:00100000:0.0:1789117977.772798:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+29:15933:x1876025572208256:12345-192.168.204.30@tcp:36:truncate.0 00010000:00010000:0.0:1789117977.772872:0:17800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117977.772904:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9ae00/0xaa253ed19be21255 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f37b expref: 29 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.772928:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:0.0:1789117977.772933:0:17800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117977.773233:0:17800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be2125c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.773261:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be2125c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.773273:0:17800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be2125c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789117977.773323:0:17800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:0.0:1789117977.773348:0:17800:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f6a7778f reply state 00000000baebca10 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be2125c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.773373:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be2125c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.773380:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:0.0:1789117977.773383:0:17800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789117977.773386:0:17800:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789117977.775586:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+31:15933:x1876025572208256:12345-192.168.204.30@tcp:36:truncate.0 Request processed in 2778us (3278us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1789117977.775598:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 47 00000020:00080000:0.0:1789117977.775605:0:17800:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789117977.988284:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117977.988433:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572208384 00000100:00100000:0.0:1789117977.988472:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572208384 00000100:00100000:0.0:1789117977.988577:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 48 00000100:00100000:0.0:1789117977.988589:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+31:15947:x1876025572208384:12345-192.168.204.30@tcp:101:stat.0 00010000:00010000:0.0:1789117977.988628:0:17799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117977.988659:0:17799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be21263 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f382 expref: -99 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.988781:0:17799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be2126a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.988809:0:17799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be2126a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.988824:0:17799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be2126a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.988837:0:17799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21271 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.988845:0:17799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21271 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.988857:0:17799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21271 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.988965:0:17799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21278 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.988976:0:17799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21278 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.988984:0:17799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21278 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117977.989123:0:17799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1789117977.989130:0:17799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789117977.989167:0:17799:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21278 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.989184:0:17799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21278 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.989194:0:17799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be2126a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.989201:0:17799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be2126a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.989209:0:17799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be2126a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.989216:0:17799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc10e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117977.989221:0:17799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be2126a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.989230:0:17799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be2126a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.989256:0:17799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff962b95e52d00) 00010000:00010000:0.0:1789117977.989260:0:17799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117977.989266:0:17799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be2126a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.989273:0:17799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10e00/0xaa253ed19be2126a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.989317:0:17799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21271 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.989323:0:17799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21271 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.989328:0:17799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21271 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.989332:0:17799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc11e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789117977.989335:0:17799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21271 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.989341:0:17799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21271 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.989349:0:17799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff962b95e52200) 00010000:00010000:0.0:1789117977.989351:0:17799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117977.989354:0:17799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21271 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.989360:0:17799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21271 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.989398:0:17799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be21263 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f382 expref: 33 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.990012:0:17799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21278 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f382 expref: 32 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117977.990038:0:17799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:0.0:1789117977.990040:0:17799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117977.990045:0:17799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbbc11600, rc 0) 00000100:00100000:0.0:1789117977.990212:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+32:15947:x1876025572208384:12345-192.168.204.30@tcp:101:stat.0 Request processed in 1624us (1946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117977.990223:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 48 00000100:00100000:1.0:1789117978.068422:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117978.068890:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572208640 00000100:00100000:3.0:1789117978.068910:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572208640 00000100:00100000:3.0:1789117978.069150:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 49 00000100:00100000:3.0:1789117978.069168:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+32:15957:x1876025572208640:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1789117978.069205:0:17798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117978.069247:0:17798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be2127f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f389 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117978.069447:0:17798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789117978.069610:0:17798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be2127f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f389 expref: 34 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117978.069632:0:17798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962a85f4ba00) 00010000:00010000:3.0:1789117978.069636:0:17798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789117978.069642:0:17798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be2127f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f389 expref: 34 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117978.069659:0:17798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a88d9b400, rc 0) 00000100:00100000:3.0:1789117978.069860:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+33:15957:x1876025572208640:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 698us (1456us total) trans 8589934614 rc 301/301 00000100:00100000:3.0:1789117978.069870:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 49 00000100:00080000:0.0:1789117978.073109:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117978.074318:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117978.074399:0:17802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572208896 00000100:00100000:3.0:1789117978.074411:0:17802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572208896 00000100:00100000:3.0:1789117978.074470:0:17802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:3.0:1789117978.074479:0:17802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86d97c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+33:15957:x1876025572208896:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:3.0:1789117978.074986:0:17802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86d97c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+34:15957:x1876025572208896:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 505us (684us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1789117978.074998:0:17802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:1.0:1789117978.130390:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117978.130604:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572209152 00000100:00100000:0.0:1789117978.130619:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572209152 00000100:00100000:0.0:1789117978.130940:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 50 00000100:00100000:0.0:1789117978.130959:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+34:15963:x1876025572209152:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:0.0:1789117978.131010:0:17799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117978.131099:0:17799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be2128d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f390 expref: -99 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117978.131329:0:17799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21294 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117978.131351:0:17799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be211bb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f34a expref: 35 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117978.131361:0:17799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21278 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f382 expref: 35 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117978.131371:0:17799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21294 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117978.131474:0:17799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21278 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f382 expref: 35 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117978.131492:0:17799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21278 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f382 expref: 35 pid: 17799 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117978.131511:0:17799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86bbfc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17799:1876025593280640:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117978.131645:0:17799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be211bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f34a expref: 35 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117978.131654:0:17799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be211bb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f34a expref: 35 pid: 17799 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117978.131663:0:17799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86bbd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17799:1876025593280768:192.168.204.30@tcp:104: 00000100:00100000:0.0:1789117978.131698:0:17799:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bae40fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789117978.136552:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117978.136711:0:17799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86bbfc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17799:1876025593280640:192.168.204.30@tcp:104: 00000100:00100000:0.0:1789117978.136725:0:17799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86bbd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17799:1876025593280768:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117978.137087:0:17799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21294 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117978.137204:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117978.137630:0:17784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572209408 00000100:00100000:3.0:1789117978.137643:0:17784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572209408 00010000:00010000:3.0:1789117978.137704:0:17784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be211bb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f34a expref: 36 pid: 17799 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117978.137856:0:17784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572209280 00000100:00100000:3.0:1789117978.137872:0:17784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572209280 00010000:00010000:3.0:1789117978.137890:0:17784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21278 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f382 expref: 37 pid: 17799 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117978.137930:0:17785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:1.0:1789117978.137946:0:17785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81e72050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+37:2407:x1876025572209408:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117978.137969:0:17785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117978.137980:0:17785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be211bb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f34a expref: 37 pid: 17799 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117978.137994:0:17785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be211bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f34a expref: 37 pid: 17799 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117978.138030:0:17785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d800/0xaa253ed19be211bb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f34a expref: 37 pid: 17799 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117978.138120:0:17785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:1.0:1789117978.138128:0:17785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21294 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117978.138140:0:17785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21294 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117978.138148:0:17785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117978.138245:0:17785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81e72050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+36:2407:x1876025572209408:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 292us (1699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117978.138255:0:17785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:2.0:1789117978.139118:0:17783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:2.0:1789117978.139139:0:17783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+35:2407:x1876025572209280:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117978.139154:0:17783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117978.139868:0:17783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21278 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f382 expref: 35 pid: 17799 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117978.139894:0:17783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21278 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f382 expref: 35 pid: 17799 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117978.139949:0:17783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21278 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f382 expref: 35 pid: 17799 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117978.139976:0:17783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:2.0:1789117978.139981:0:17783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21294 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117978.139994:0:17783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21294 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117978.140004:0:17783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21294 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117978.140051:0:17783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117978.140139:0:17783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+34:2407:x1876025572209280:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 1007us (2934us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117978.140149:0:17783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 18 00010000:00010000:2.0:1789117978.140483:0:17799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21294 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117978.140493:0:17799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21294 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117978.140523:0:17799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1789117978.140730:0:17799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be2128d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f390 expref: 35 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117978.140749:0:17799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21294 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f390 expref: 34 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117978.140773:0:17799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:2.0:1789117978.140776:0:17799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789117978.140779:0:17799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbbc11e00, rc 0) 00000100:00100000:2.0:1789117978.147337:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+34:15963:x1876025572209152:12345-192.168.204.30@tcp:101:bash.0 Request processed in 16363us (16944us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1789117978.147354:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 50 00000100:00100000:1.0:1789117978.152024:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117978.152179:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572209664 00000100:00100000:3.0:1789117978.152197:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572209664 00000100:00100000:3.0:1789117978.152323:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00100000:3.0:1789117978.152337:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+34:15963:x1876025572209664:12345-192.168.204.30@tcp:36:bash.0 00010000:00010000:3.0:1789117978.152929:0:17798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be212a2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117978.152962:0:17798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be212a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117978.152978:0:17798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be212a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789117978.153044:0:17798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:3.0:1789117978.153469:0:17798:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000773bd098 reply state 00000000037cee70 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be212a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117978.153489:0:17798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be212a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117978.153499:0:17798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:3.0:1789117978.153502:0:17798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789117978.153507:0:17798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789117978.153700:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+37:15963:x1876025572209664:12345-192.168.204.30@tcp:36:bash.0 Request processed in 1362us (1690us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1789117978.153719:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 51 00000020:00080000:3.0:1789117978.153728:0:17798:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789117978.157128:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117978.157254:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572209792 00000100:00100000:3.0:1789117978.157273:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572209792 00000100:00100000:3.0:1789117978.157391:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 52 00000100:00100000:3.0:1789117978.157405:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86bbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+37:15963:x1876025572209792:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:3.0:1789117978.157444:0:20601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117978.157477:0:20601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be212a9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f397 expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117978.157581:0:20601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be212a9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f397 expref: 38 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117978.157599:0:20601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be212a9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f397 expref: 38 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117978.157627:0:20601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:3.0:1789117978.157630:0:20601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789117978.157636:0:20601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a88d9a800, rc 0) 00000100:00100000:3.0:1789117978.157729:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86bbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+38:15963:x1876025572209792:12345-192.168.204.30@tcp:101:bash.0 Request processed in 326us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117978.157737:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 52 00000100:00100000:0.0:1789117978.165684:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117978.165843:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572209920 00000100:00100000:2.0:1789117978.165856:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572209920 00000100:00100000:2.0:1789117978.165963:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 53 00000100:00100000:2.0:1789117978.165977:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86bbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+38:15963:x1876025572209920:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1789117978.166010:0:17800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117978.166041:0:17800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be212b0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f39e expref: -99 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117978.166244:0:17800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be212b7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117978.166264:0:17800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21294 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f390 expref: 39 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117978.166275:0:17800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be212b7 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117978.166338:0:17800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21294 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f390 expref: 39 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117978.166355:0:17800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21294 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f390 expref: 39 pid: 17799 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117978.166395:0:17800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887fad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17800:1876025593280896:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789117978.166510:0:17800:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f66780 going to sleep for 11 seconds 00000100:00100000:1.0:1789117978.172974:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117978.173157:0:17800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887fad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17800:1876025593280896:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789117978.173199:0:17800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be212b7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117978.175606:0:17784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572210048 00000100:00100000:3.0:1789117978.175631:0:17784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572210048 00010000:00010000:3.0:1789117978.176963:0:17784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21294 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f390 expref: 40 pid: 17799 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117978.177047:0:17784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:3.0:1789117978.177099:0:17784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+40:2407:x1876025572210048:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117978.177124:0:17784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117978.177153:0:17784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21294 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f390 expref: 40 pid: 17799 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117978.177170:0:17784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21294 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f390 expref: 40 pid: 17799 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117978.177201:0:17784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21294 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f390 expref: 40 pid: 17799 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117978.177224:0:17784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:3.0:1789117978.177238:0:17784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be212b7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117978.177262:0:17784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be212b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117978.177271:0:17784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be212b7 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117978.177309:0:17784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117978.177391:0:17784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+39:2407:x1876025572210048:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 306us (4437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117978.177399:0:17784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 19 00010000:00010000:2.0:1789117978.177482:0:17800:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be212b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117978.177492:0:17800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be212b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117978.177577:0:17800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789117978.177584:0:17800:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789117978.177613:0:17800:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be212b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117978.177657:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be212b0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f39e expref: 39 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117978.177673:0:17800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be212b7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f39e expref: 38 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117978.177681:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:2.0:1789117978.177684:0:17800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789117978.177686:0:17800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93000, rc 0) 00000100:00100000:2.0:1789117978.177717:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86bbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+38:15963:x1876025572209920:12345-192.168.204.30@tcp:101:bash.0 Request processed in 11743us (12050us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117978.177733:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 53 00000100:00100000:0.0:1789117978.185824:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117978.185977:0:17785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572210304 00000100:00100000:1.0:1789117978.185991:0:17785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572210304 00000100:00100000:1.0:1789117978.186113:0:17785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:1.0:1789117978.186216:0:17785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86bbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+38:15963:x1876025572210304:12345-192.168.204.30@tcp:103:bash.0 00010000:00010000:1.0:1789117978.186251:0:17785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789117978.186290:0:17785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be212a9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f397 expref: 38 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117978.186317:0:17785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be212b7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f39e expref: 37 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117978.186330:0:17785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:1.0:1789117978.186337:0:17785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117978.186418:0:17785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86bbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+36:15963:x1876025572210304:12345-192.168.204.30@tcp:103:bash.0 Request processed in 205us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117978.191246:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117978.191304:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572210432 00000100:00100000:3.0:1789117978.191327:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572210432 00000100:00100000:3.0:1789117978.191415:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 54 00000100:00100000:3.0:1789117978.191427:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81aae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+37:15963:x1876025572210432:12345-192.168.204.30@tcp:58:bash.0 00010000:00010000:3.0:1789117978.191619:0:20601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be212be lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117978.191652:0:20601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be212be lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117978.191670:0:20601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be212be lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117978.192184:0:17785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 3 00000040:00080000:3.0:1789117978.193565:0:20601:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789117978.193892:0:20601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1789117978.194044:0:20601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1789117978.194217:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81aae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+36:15963:x1876025572210432:12345-192.168.204.30@tcp:58:bash.0 Request processed in 2785us (2989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117978.194229:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 54 00000100:00100000:0.0:1789117978.197589:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117978.197832:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572210560 00000100:00100000:3.0:1789117978.197850:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572210560 00000100:00100000:3.0:1789117978.198102:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 55 00000100:00100000:3.0:1789117978.198121:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86bbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+36:15963:x1876025572210560:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:3.0:1789117978.198165:0:17798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117978.198206:0:17798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9ba00/0xaa253ed19be212c5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f3a5 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117978.198534:0:17798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be212be lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117978.198550:0:17798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9ba00/0xaa253ed19be212c5 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3a5 expref: 37 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117978.198580:0:17798:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be212be lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117978.198624:0:17798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9ba00/0xaa253ed19be212c5 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3a5 expref: 37 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117978.198646:0:17798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:3.0:1789117978.198651:0:17798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789117978.198655:0:17798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9ba00/0xaa253ed19be212c5 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3a5 expref: 37 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117978.198664:0:17798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a88d9ba00, rc 0) 00000100:00100000:3.0:1789117978.198786:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86bbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+37:15963:x1876025572210560:12345-192.168.204.30@tcp:101:bash.0 Request processed in 668us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117978.198794:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 55 00010000:00010000:3.0:1789117978.600286:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789117979.045318:0:17834:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789117979.045334:0:17834:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789117979.045365:0:17834:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789117979.045389:0:17834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789117979.045547:0:17834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86bbc780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17834:1876025593281024:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789117979.045674:0:17834:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bae40f600 going to sleep for 11 seconds 00000100:00100000:1.0:1789117979.050024:0:17834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86bbc780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17834:1876025593281024:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789117979.050560:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117979.052174:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572210688 00000100:00100000:3.0:1789117979.052191:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572210688 00000100:00100000:3.0:1789117979.052323:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 56 00000100:00100000:3.0:1789117979.052549:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86bbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+37:15964:x1876025572210688:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789117979.052597:0:17799:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789117979.052898:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86bbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+37:15964:x1876025572210688:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 563us (2338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117979.052908:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 56 00000100:00100000:1.0:1789117979.066853:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117979.069224:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572210816 00000100:00100000:2.0:1789117979.069249:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572210816 00000100:00100000:2.0:1789117979.069387:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 57 00000100:00100000:2.0:1789117979.069403:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+37:15964:x1876025572210816:12345-192.168.204.30@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789117979.069959:0:17800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be212cc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.069984:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be212cc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070004:0:17800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be212cc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070303:0:17800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be212d3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070330:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be212d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070343:0:17800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be212d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070380:0:17800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be212da lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070390:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be212da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070396:0:17800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be212da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117979.070473:0:17800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789117979.070478:0:17800:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789117979.070496:0:17800:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be212da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070507:0:17800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be212cc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070514:0:17800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be212cc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070520:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be212cc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070526:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117979.070530:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be212cc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070538:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be212cc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070551:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff962b95e52b00) 00010000:00010000:2.0:1789117979.070554:0:17800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117979.070559:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be212cc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070565:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be212cc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070579:0:17800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be212d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070596:0:17800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be212d3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070602:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be212d3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070606:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117979.070609:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be212d3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070616:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be212d3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070625:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff962a85f4b400) 00010000:00010000:2.0:1789117979.070627:0:17800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117979.070630:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be212d3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070636:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be212d3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070903:0:17800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be212da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070912:0:17800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be212da lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070919:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be212da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070924:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117979.070935:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be212da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070943:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be212da lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070953:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:2.0:1789117979.070956:0:17800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117979.070959:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be212da lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.070965:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be212da lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117979.071116:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+37:15964:x1876025572210816:12345-192.168.204.30@tcp:34:lhsmtool_posix.0 Request processed in 1711us (4277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117979.071133:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 57 00000100:00100000:3.0:1789117979.077553:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117979.077921:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572211072 00000100:00100000:2.0:1789117979.077941:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572211072 00000100:00100000:2.0:1789117979.078050:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 58 00000100:00100000:2.0:1789117979.078116:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81aada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+37:15964:x1876025572211072:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117979.078156:0:17799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117979.078191:0:17799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be212e1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f3ac expref: -99 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.079718:0:17799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be212e8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.079759:0:17799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be212e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.081235:0:17799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be212e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117979.081896:0:17799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789117979.082092:0:17799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be212e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.082103:0:17799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be212e8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.082113:0:17799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be212e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.082120:0:17799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117979.082124:0:17799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be212e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.082134:0:17799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be212e8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.082153:0:17799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:2.0:1789117979.082156:0:17799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789117979.082162:0:17799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be212e8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.082168:0:17799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be212e8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.082264:0:17799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be212e1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3ac expref: 39 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.082297:0:17799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff962b95e52b00) 00010000:00010000:2.0:1789117979.082299:0:17799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789117979.082304:0:17799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be212e1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3ac expref: 39 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.082316:0:17799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93000, rc 0) 00000100:00100000:2.0:1789117979.084637:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81aada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+38:15964:x1876025572211072:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 6508us (7086us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1789117979.084666:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 58 00000100:00100000:0.0:1789117979.098071:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117979.098859:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572211200 00000100:00100000:3.0:1789117979.098876:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572211200 00000100:00100000:3.0:1789117979.099270:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 59 00000100:00100000:3.0:1789117979.099285:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86bbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+38:15964:x1876025572211200:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789117979.099376:0:17798:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789117979.099579:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86bbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+38:15964:x1876025572211200:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 298us (1538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117979.099587:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 59 00000100:00100000:0.0:1789117979.112778:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117979.113984:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572211456 00000100:00100000:3.0:1789117979.114003:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572211456 00000100:00100000:3.0:1789117979.114173:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00100000:3.0:1789117979.114191:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86bbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+38:15964:x1876025572211456:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789117979.114238:0:20601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117979.114270:0:20601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be212f6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f3b3 expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789117979.119636:0:20601:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:3.0:1789117979.119664:0:20601:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:3.0:1789117979.120920:0:20601:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:3.0:1789117979.123936:0:20601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9ae00/0xaa253ed19be212fd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.124002:0:20601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9ae00/0xaa253ed19be212fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.124027:0:20601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9ae00/0xaa253ed19be212fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.124258:0:20601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be212f6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3b3 expref: 41 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.124293:0:20601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9ae00/0xaa253ed19be212fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3b3 expref: 40 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.124328:0:20601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff962b8ebd4f00) 00010000:00010000:3.0:1789117979.124332:0:20601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789117979.124337:0:20601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a88d9ae00, rc 0) 00000100:00100000:3.0:1789117979.124463:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86bbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+40:15964:x1876025572211456:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 10276us (11966us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1789117979.124477:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00100000:0.0:1789117979.137671:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117979.146283:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572211712 00000100:00100000:2.0:1789117979.146315:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572211712 00000100:00100000:2.0:1789117979.146475:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 61 00000100:00100000:2.0:1789117979.146490:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86bbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+40:15964:x1876025572211712:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789117979.146592:0:17800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117979.146637:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9ae00/0xaa253ed19be212fd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3b3 expref: 40 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.146668:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff962b8ebd4f00) 00010000:00010000:2.0:1789117979.146686:0:17800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117979.146732:0:17800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be2130b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.146751:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be2130b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.146764:0:17800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be2130b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.146806:0:17800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be21312 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc71bde5f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.146815:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be21312 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc71bde5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.146823:0:17800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be21312 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc71bde5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.146898:0:17800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be2130b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.146907:0:17800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be2130b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.146915:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be2130b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.146923:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117979.146929:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be2130b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.146940:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be2130b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.147354:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff962b95e52d00) 00010000:00010000:2.0:1789117979.147358:0:17800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117979.147365:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be2130b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.147374:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be2130b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.147402:0:17800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be21312 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc71bde5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.147409:0:17800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be21312 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc71bde5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.147415:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be21312 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc71bde5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.147421:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117979.147424:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be21312 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc71bde5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.147430:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be21312 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc71bde5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.147439:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xc71bde5f (ffff962a85f4b400) 00010000:00010000:2.0:1789117979.147441:0:17800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117979.147445:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be21312 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc71bde5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.147451:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be21312 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc71bde5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117979.147837:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86bbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+39:15964:x1876025572211712:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 1341us (10181us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789117979.147850:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 61 00000100:00100000:0.0:1789117979.154995:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117979.155152:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572211840 00000100:00100000:2.0:1789117979.155166:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572211840 00000100:00100000:2.0:1789117979.155272:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 62 00000100:00100000:2.0:1789117979.155308:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86bbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+39:15964:x1876025572211840:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117979.155337:0:17799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117979.155372:0:17799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be21319 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f3ba expref: -99 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.155424:0:17799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21320 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.155442:0:17799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21320 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.155456:0:17799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21320 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.155624:0:17799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be21319 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3ba expref: 41 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.155651:0:17799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21320 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3ba expref: 40 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.155661:0:17799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff962a85f4bf00) 00010000:00010000:2.0:1789117979.155663:0:17799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789117979.155668:0:17799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92000, rc 0) 00000100:00100000:2.0:1789117979.155750:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86bbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+40:15964:x1876025572211840:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 445us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117979.155759:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 62 00000100:00100000:0.0:1789117979.160473:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117979.160942:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572212096 00000100:00100000:3.0:1789117979.161209:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572212096 00000100:00100000:3.0:1789117979.161361:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 63 00000100:00100000:3.0:1789117979.161376:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86bbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+40:15964:x1876025572212096:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789117979.161538:0:17798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be21327 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.161566:0:17798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be21327 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.161585:0:17798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be21327 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789117979.161895:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1789117979.161910:0:17798:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631444855056ns, next at 632444849610ns, rc = 0 00000004:00010000:3.0:1789117979.162002:0:17798:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000b687187 reply state 00000000272dad78 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be21327 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.162022:0:17798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be21327 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.162031:0:17798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff962a85f4bf00) 00010000:00010000:3.0:1789117979.162092:0:17798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789117979.162098:0:17798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789117979.162289:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86bbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+42:15964:x1876025572212096:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 913us (1830us total) trans 8589934621 rc 0/0 00000100:00100000:3.0:1789117979.162301:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 63 00000100:00100000:0.0:1789117979.186998:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117979.187299:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572212224 00000100:00100000:2.0:1789117979.187314:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572212224 00000100:00100000:2.0:1789117979.187426:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 64 00000100:00100000:2.0:1789117979.187463:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+42:15964:x1876025572212224:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117979.187506:0:17799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117979.187547:0:17799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be2132e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f3c1 expref: -99 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.187636:0:17799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be2132e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3c1 expref: 43 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.187656:0:17799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be2132e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3c1 expref: 43 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.187684:0:17799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff962a85f4bf00) 00010000:00010000:2.0:1789117979.187688:0:17799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789117979.187704:0:17799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93c00, rc 0) 00000100:00100000:2.0:1789117979.187796:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+43:15964:x1876025572212224:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 336us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117979.187803:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 64 00000100:00100000:0.0:1789117979.195948:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117979.196230:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572212352 00000100:00100000:2.0:1789117979.196246:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572212352 00000100:00100000:1.0:1789117979.198582:0:19312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00100000:1.0:1789117979.198622:0:19312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86bbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+5:2406:x1876025572212352:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789117979.199162:0:19312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86bbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+6:2406:x1876025572212352:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 Request processed in 558us (3233us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789117979.199173:0:19312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00080000:0.0:1789117979.205597:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117979.206935:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117979.210177:0:17801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572212608 00000100:00100000:2.0:1789117979.210203:0:17801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572212608 00000100:00100000:2.0:1789117979.210417:0:17801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:2.0:1789117979.210433:0:17801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86bbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+43:15964:x1876025572212608:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789117979.210774:0:17801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86bbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+44:15964:x1876025572212608:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 344us (3850us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789117979.210784:0:17801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:3.0:1789117979.218804:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117979.219251:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572212864 00000100:00100000:0.0:1789117979.219266:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572212864 00000100:00100000:0.0:1789117979.219378:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 65 00000100:00100000:0.0:1789117979.219392:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81aac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+44:15964:x1876025572212864:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789117979.219698:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81aac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+44:15964:x1876025572212864:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 306us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117979.219707:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 65 00000100:00100000:0.0:1789117979.232635:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117979.232785:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572212992 00000100:00100000:3.0:1789117979.232801:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572212992 00000100:00100000:3.0:1789117979.232893:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 66 00000100:00100000:3.0:1789117979.232905:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+44:15964:x1876025572212992:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789117979.232935:0:17799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117979.232965:0:17799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9be00/0xaa253ed19be21335 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f3c8 expref: -99 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.233112:0:17799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b800/0xaa253ed19be2133c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.233324:0:17799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b800/0xaa253ed19be2133c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.233344:0:17799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b800/0xaa253ed19be2133c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117979.233425:0:17799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789117979.233457:0:17799:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b800/0xaa253ed19be2133c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.233503:0:17799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9be00/0xaa253ed19be21335 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3c8 expref: 46 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.233557:0:17799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b800/0xaa253ed19be2133c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3c8 expref: 45 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.233568:0:17799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff962a85f4bf00) 00010000:00010000:3.0:1789117979.233572:0:17799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789117979.233576:0:17799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a88d9b800, rc 0) 00000100:00100000:3.0:1789117979.233769:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+45:15964:x1876025572212992:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 864us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117979.233779:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 66 00000100:00100000:1.0:1789117979.243678:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117979.243846:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572213120 00000100:00100000:0.0:1789117979.243862:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572213120 00000100:00100000:0.0:1789117979.243952:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00100000:0.0:1789117979.243965:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd1092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+6:2404:x1876025572213120:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789117979.244016:0:19313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117979.244085:0:19313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e4e3919/0xaa253ed19be21343 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f3cf expref: -99 pid: 19313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789117979.244135:0:19313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3c61b, blocks: 0x0 00010000:00010000:0.0:1789117979.244173:0:19313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=631s v=(0 0) 00010000:00010000:0.0:1789117979.244179:0:19313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117979.244192:0:19313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e4e3919/0xaa253ed19be21343 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3cf expref: 7 pid: 19313 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117979.244238:0:19313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e4e3919/0xaa253ed19be21343 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3cf expref: 7 pid: 19313 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117979.244256:0:19313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b8ee64c00, rc 0) 00000100:00100000:0.0:1789117979.244344:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd1092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+7:2404:x1876025572213120:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 382us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117979.244353:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00100000:0.0:1789117979.259123:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117979.263006:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572213376 00000100:00100000:3.0:1789117979.263035:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572213376 00000100:00100000:3.0:1789117979.263300:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00100000:3.0:1789117979.263316:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86bbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+45:15964:x1876025572213376:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789117979.263511:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86bbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+45:15964:x1876025572213376:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 198us (4405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117979.263520:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00100000:1.0:1789117979.269947:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117979.270124:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572213504 00000100:00100000:0.0:1789117979.270139:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572213504 00000100:00100000:0.0:1789117979.270524:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 68 00000100:00100000:0.0:1789117979.270540:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0719680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+45:15964:x1876025572213504:12345-192.168.204.30@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789117979.291558:0:17778:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:0.0:1789117979.291594:0:17778:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789117979.291697:0:17778:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1789117979.291987:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0719680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+20:15964:x1876025572213504:12345-192.168.204.30@tcp:44:lhsmtool_posix.0 Request processed in 21439us (22045us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117979.292028:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 68 00010000:00010000:2.0:1789117979.292101:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21159 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.292128:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21159 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.292137:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21159 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.292143:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117979.292148:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21159 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.292158:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21159 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.292181:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff962b95e52d00) 00010000:00010000:2.0:1789117979.292185:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789117979.292190:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21159 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.292197:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21159 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292641:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70cc00/0xaa253ed19be21105 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292658:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70cc00/0xaa253ed19be21105 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292667:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70cc00/0xaa253ed19be21105 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292674:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70cc00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117979.292695:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70cc00/0xaa253ed19be21105 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292706:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70cc00/0xaa253ed19be21105 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292724:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff962b95e52500) 00010000:00010000:3.0:1789117979.292728:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117979.292734:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70cc00/0xaa253ed19be21105 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292741:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70cc00/0xaa253ed19be21105 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292770:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c000/0xaa253ed19be2110c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292776:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c000/0xaa253ed19be2110c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292782:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c000/0xaa253ed19be2110c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292787:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117979.292791:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c000/0xaa253ed19be2110c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292797:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c000/0xaa253ed19be2110c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292805:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff962b95e52d00) 00010000:00010000:3.0:1789117979.292808:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117979.292817:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c000/0xaa253ed19be2110c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292824:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c000/0xaa253ed19be2110c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292843:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70dc00/0xaa253ed19be211b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292851:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70dc00/0xaa253ed19be211b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292857:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70dc00/0xaa253ed19be211b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292863:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70dc00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117979.292867:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70dc00/0xaa253ed19be211b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292873:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70dc00/0xaa253ed19be211b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292884:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff962b95e52200) 00010000:00010000:3.0:1789117979.292887:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117979.292890:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70dc00/0xaa253ed19be211b4 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292897:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70dc00/0xaa253ed19be211b4 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292917:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b200/0xaa253ed19be21239 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292941:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b200/0xaa253ed19be21239 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292948:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b200/0xaa253ed19be21239 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292954:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9b200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117979.292958:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b200/0xaa253ed19be21239 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292965:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b200/0xaa253ed19be21239 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292977:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:3.0:1789117979.292979:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117979.292983:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b200/0xaa253ed19be21239 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.292988:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b200/0xaa253ed19be21239 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.293002:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be2125c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.293008:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be2125c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.293015:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be2125c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.293020:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc11800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117979.293029:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be2125c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.293036:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be2125c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.293044:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:3.0:1789117979.293047:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117979.293050:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be2125c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.293120:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be2125c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.293140:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be212a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.293149:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be212a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.293155:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be212a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.293161:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9b400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117979.293164:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be212a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.293171:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be212a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.293181:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:3.0:1789117979.293184:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117979.293198:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be212a2 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.293228:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be212a2 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.293244:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be21327 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.293251:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be21327 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.293257:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be21327 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.293262:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9a800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117979.293265:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be21327 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.293271:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be21327 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.293281:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff962a85f4bf00) 00010000:00010000:3.0:1789117979.293284:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789117979.293288:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be21327 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.293294:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be21327 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117979.293930:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789117979.293961:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0719a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593281152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789117979.294089:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117979.294174:0:19312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593281152 00000100:00100000:1.0:1789117979.294185:0:19312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593281152 00000100:00100000:1.0:1789117979.294441:0:19312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789117979.294457:0:19312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593281152:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789117979.294677:0:19312:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789117979.294683:0:19312:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789117979.294686:0:19312:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789117979.298196:0:19312:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789117979 -> 1789117979 00002000:00010000:1.0:1789117979.298274:0:19312:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789117979.298488:0:19312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876025593281152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4025us (4423us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789117979.298507:0:19312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789117979.298588:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789117979.298606:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff962ba0719a40/2, rc 0, transno 8589934596 00000100:00100000:2.0:1789117979.298629:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0719a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593281152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789117979.300268:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117979.306378:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572213632 00000100:00100000:0.0:1789117979.306405:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572213632 00000100:00100000:0.0:1789117979.306524:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:0.0:1789117979.306539:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd0052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+7:2404:x1876025572213632:12345-192.168.204.30@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789117979.306734:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd0052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+7:2404:x1876025572213632:12345-192.168.204.30@tcp:16:lhsmtool_posix.0 Request processed in 198us (6487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117979.306743:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:0.0:1789117979.313522:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117979.313708:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572213888 00000100:00100000:2.0:1789117979.313726:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572213888 00000100:00100000:2.0:1789117979.313833:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 69 00000100:00100000:2.0:1789117979.313846:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86bbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+14:15964:x1876025572213888:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789117979.313929:0:17800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117979.313970:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b800/0xaa253ed19be2133c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3c8 expref: 14 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.314018:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff962a85f4bf00) 00010000:00010000:2.0:1789117979.314025:0:17800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117979.314123:0:17800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2134a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.314141:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2134a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.314153:0:17800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2134a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789117979.318663:0:17800:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003191ff3f reply state 000000001a3d28ba transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2134a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.318705:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2134a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.318717:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff962a85f4bf00) 00010000:00010000:2.0:1789117979.318720:0:17800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789117979.318727:0:17800:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789117979.318917:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86bbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+15:15964:x1876025572213888:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 5068us (5408us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1789117979.318929:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 69 00000100:00100000:1.0:1789117979.339685:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117979.339926:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572214016 00000100:00100000:2.0:1789117979.339941:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572214016 00000100:00100000:2.0:1789117979.340038:0:19311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:2.0:1789117979.340104:0:19311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd0061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+7:15964:x1876025572214016:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117979.340136:0:19311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117979.340198:0:19311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ad08759/0xaa253ed19be21351 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f3d6 expref: -99 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.340266:0:19311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e4e3919/0xaa253ed19be21343 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3cf expref: 8 pid: 19313 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.340279:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117979.340285:0:19311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117979.340290:0:19311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ad08759/0xaa253ed19be21351 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3d6 expref: 8 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.340340:0:19311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e4e3919/0xaa253ed19be21343 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3cf expref: 8 pid: 19313 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.340359:0:19311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e4e3919/0xaa253ed19be21343 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3cf expref: 8 pid: 19313 timeout: 731 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117979.340381:0:19311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887fad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:19311:1876025593281280:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789117979.340506:0:19311:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f66600 going to sleep for 11 seconds 00000100:00100000:2.0:1789117979.347716:0:19311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887fad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:19311:1876025593281280:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789117979.347803:0:19311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003ad08759/0xaa253ed19be21351 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3d6 expref: 8 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.347845:0:19311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92200, rc 0) 00000100:00100000:2.0:1789117979.348025:0:19311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd0061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+8:15964:x1876025572214016:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 7974us (8355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117979.348127:0:19311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:1.0:1789117979.357071:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117979.359329:0:17784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572214144 00000100:00100000:2.0:1789117979.359353:0:17784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572214144 00010000:00010000:2.0:1789117979.359428:0:17784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e4e3919/0xaa253ed19be21343 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3cf expref: 8 pid: 19313 timeout: 731 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117979.359481:0:17784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:2.0:1789117979.359494:0:17784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd0070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+8:2407:x1876025572214144:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117979.359516:0:17784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117979.359546:0:17784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e4e3919/0xaa253ed19be21343 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3cf expref: 8 pid: 19313 timeout: 731 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.359562:0:17784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e4e3919/0xaa253ed19be21343 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3cf expref: 8 pid: 19313 timeout: 731 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.359596:0:17784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e4e3919/0xaa253ed19be21343 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3cf expref: 8 pid: 19313 timeout: 731 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.359619:0:17784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117979.359626:0:17784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117979.359635:0:17784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003ad08759/0xaa253ed19be21351 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3d6 expref: 7 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.359647:0:17784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ad08759/0xaa253ed19be21351 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3d6 expref: 7 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.359741:0:17784:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003ad08759/0xaa253ed19be21351 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3d6 expref: 7 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117979.359768:0:17784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887fad00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17784:1876025593281408:192.168.204.30@tcp:105: 00000100:00100000:2.0:1789117979.359882:0:17784:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f66600 going to sleep for 11 seconds 00000100:00100000:3.0:1789117979.364478:0:17784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887fad00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17784:1876025593281408:192.168.204.30@tcp:105: 00010000:00010000:3.0:1789117979.364519:0:17784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117979.364627:0:17784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd0070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+7:2407:x1876025572214144:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 5132us (7585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117979.364642:0:17784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:1.0:1789117979.367590:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117979.367844:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572214272 00000100:00100000:2.0:1789117979.367863:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572214272 00000100:00100000:2.0:1789117979.368282:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 32 00000100:00100000:2.0:1789117979.368298:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd004780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+7:2407:x1876025572214272:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789117979.368563:0:19313:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789117979.368567:0:19313:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789117978 00002000:00010000:2.0:1789117979.368570:0:19313:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789117977 00002000:00010000:2.0:1789117979.368573:0:19313:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789117979 -> 1789117978 00002000:00010000:2.0:1789117979.368575:0:19313:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789117979.368664:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd004780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+8:2407:x1876025572214272:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 Request processed in 369us (1093us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789117979.368674:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 32 00000100:00100000:1.0:1789117979.377459:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117979.377556:0:19312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572214400 00000100:00100000:2.0:1789117979.377573:0:19312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572214400 00000100:00100000:2.0:1789117979.377665:0:19312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:2.0:1789117979.377679:0:19312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd005680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+8:2406:x1876025572214400:12345-192.168.204.30@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789117979.377776:0:19312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c3b5ea2/0xaa253ed19be21358 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.377825:0:19312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003ad08759/0xaa253ed19be21351 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3d6 expref: 8 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.377834:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117979.377839:0:19312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789117979.377845:0:19312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c3b5ea2/0xaa253ed19be21358 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.377891:0:19312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003ad08759/0xaa253ed19be21351 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3d6 expref: 8 pid: 19311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.377907:0:19312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003ad08759/0xaa253ed19be21351 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3d6 expref: 8 pid: 19311 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117979.377925:0:19312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887f9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:19312:1876025593281536:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789117979.378051:0:19312:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f660c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117979.381737:0:19312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887f9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:19312:1876025593281536:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789117979.381813:0:19312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c3b5ea2/0xaa253ed19be21358 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117979.394286:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117979.394569:0:17785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572214528 00000100:00100000:3.0:1789117979.394584:0:17785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572214528 00010000:00010000:3.0:1789117979.394651:0:17785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003ad08759/0xaa253ed19be21351 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3d6 expref: 9 pid: 19311 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117979.394721:0:17785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:3.0:1789117979.394737:0:17785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd005a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+9:2406:x1876025572214528:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117979.394773:0:17785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117979.394806:0:17785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003ad08759/0xaa253ed19be21351 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3d6 expref: 9 pid: 19311 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.394826:0:17785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003ad08759/0xaa253ed19be21351 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3d6 expref: 9 pid: 19311 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.394863:0:17785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ad08759/0xaa253ed19be21351 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3d6 expref: 9 pid: 19311 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.394889:0:17785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789117979.394896:0:17785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789117979.394904:0:17785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c3b5ea2/0xaa253ed19be21358 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.394918:0:17785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c3b5ea2/0xaa253ed19be21358 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.394997:0:17785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117979.395152:0:17785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd005a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+8:2406:x1876025572214528:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 417us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117979.395162:0:17785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 21 00010000:00010000:1.0:1789117979.395580:0:19312:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c3b5ea2/0xaa253ed19be21358 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117979.395594:0:19312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c3b5ea2/0xaa253ed19be21358 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117979.395627:0:19312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c3b5ea2/0xaa253ed19be21358 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117979.395652:0:19312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c3b5ea2/0xaa253ed19be21358 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117979.395661:0:19312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c3b5ea2/0xaa253ed19be21358 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117979.395670:0:19312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93000 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789117979.395675:0:19312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c3b5ea2/0xaa253ed19be21358 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117979.395698:0:19312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c3b5ea2/0xaa253ed19be21358 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117979.395715:0:19312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c3b5ea2/0xaa253ed19be21358 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117979.395724:0:19312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c3b5ea2/0xaa253ed19be21358 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117979.395804:0:19312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd005680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+7:2406:x1876025572214400:12345-192.168.204.30@tcp:1:lhsmtool_posix.0 Request processed in 18127us (18359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117979.395813:0:19312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:0.0:1789117979.398470:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117979.398600:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572214784 00000100:00100000:3.0:1789117979.398612:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572214784 00000100:00100000:3.0:1789117979.398702:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 70 00000100:00100000:3.0:1789117979.398713:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86bbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+15:15964:x1876025572214784:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789117979.398837:0:17799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be2135f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.398858:0:17799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c400/0xaa253ed19be21232 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f374 expref: 15 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.398870:0:17799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be2135f lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.398910:0:17799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c400/0xaa253ed19be21232 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f374 expref: 15 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.398927:0:17799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c400/0xaa253ed19be21232 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f374 expref: 15 pid: 20601 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117979.398946:0:17799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a81aafc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17799:1876025593281664:192.168.204.30@tcp:104: 00000100:00100000:3.0:1789117979.399111:0:17799:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b88605600 going to sleep for 11 seconds 00000100:00100000:1.0:1789117979.411247:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117979.411614:0:17784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572214912 00000100:00100000:0.0:1789117979.411630:0:17784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572214912 00010000:00010000:0.0:1789117979.411719:0:17784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c400/0xaa253ed19be21232 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f374 expref: 16 pid: 20601 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117979.411921:0:17784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:0.0:1789117979.411951:0:17784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd006d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+16:2407:x1876025572214912:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117979.411982:0:17784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117979.411993:0:17784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c400/0xaa253ed19be21232 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f374 expref: 16 pid: 20601 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117979.412013:0:17784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c400/0xaa253ed19be21232 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f374 expref: 16 pid: 20601 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117979.412318:0:17799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a81aafc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17799:1876025593281664:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789117979.412426:0:17784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c400/0xaa253ed19be21232 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f374 expref: 16 pid: 20601 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.419004:0:17799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be2135f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117979.421647:0:17784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:0.0:1789117979.421678:0:17784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9ba00/0xaa253ed19be212c5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3a5 expref: 15 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117979.421766:0:17784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be2135f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117979.421777:0:17784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be2135f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117979.421786:0:17784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be2135f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.425969:0:17784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117979.426136:0:17784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd006d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+15:2407:x1876025572214912:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 14177us (14891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117979.426156:0:17784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 22 00010000:00010000:3.0:1789117979.426157:0:17799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be2135f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.426171:0:17799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be2135f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.426611:0:17799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be21366 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.426631:0:17799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be2132e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3c1 expref: 16 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.426642:0:17799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be21366 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.426781:0:17799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be2132e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3c1 expref: 15 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.426804:0:17799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be2132e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3c1 expref: 15 pid: 17799 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117979.426827:0:17799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a81aafc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17799:1876025593281792:192.168.204.30@tcp:104: 00000100:00100000:3.0:1789117979.426938:0:17799:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b886050c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117979.435927:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117979.436313:0:17799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a81aafc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17799:1876025593281792:192.168.204.30@tcp:104: 00010000:00010000:3.0:1789117979.436354:0:17799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be21366 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117979.437823:0:17783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572215040 00000100:00100000:2.0:1789117979.437842:0:17783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572215040 00010000:00010000:2.0:1789117979.437916:0:17783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be2132e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3c1 expref: 16 pid: 17799 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117979.437973:0:17783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:2.0:1789117979.437986:0:17783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81e73450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+16:2406:x1876025572215040:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117979.438007:0:17783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117979.438130:0:17783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be2132e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3c1 expref: 16 pid: 17799 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.438145:0:17783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be2132e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3c1 expref: 16 pid: 17799 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.439465:0:17783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be2132e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3c1 expref: 16 pid: 17799 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.439501:0:17783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff962a85f4bf00) 00010000:00010000:2.0:1789117979.439508:0:17783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be21366 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.439521:0:17783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be21366 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.439531:0:17783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be21366 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.439592:0:17783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117979.439703:0:17783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81e73450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+15:2406:x1876025572215040:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 1716us (3793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117979.439736:0:17783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 23 00010000:00010000:3.0:1789117979.441575:0:17799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be21366 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.441599:0:17799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be21366 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789117979.441819:0:17799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1789117979.442003:0:17799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:3.0:1789117979.442047:0:17799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1789117979.444645:0:17799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887f9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17799:1876025593281920:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789117979.444783:0:17799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117979.444914:0:17799:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f66780 going to sleep for 11 seconds 00000100:00100000:0.0:1789117979.450136:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593281920 00000100:00100000:0.0:1789117979.450168:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593281920 00000100:00100000:0.0:1789117979.450336:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789117979.450358:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17799:x1876025593281920:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789117979.450657:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17799:x1876025593281920:12345-0@lo:1000:mdt00_001.0 Request processed in 305us (5873us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117979.450667:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789117979.450915:0:17799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887f9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17799:1876025593281920:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789117979.451316:0:17799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:3.0:1789117979.451428:0:17799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a81aafc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17799:1876025593282048:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789117979.451494:0:17799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117979.451536:0:17799:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84c5dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789117979.451722:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593282048 00000100:00100000:0.0:1789117979.451730:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593282048 00000100:00100000:0.0:1789117979.451791:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789117979.451803:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81aad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17799:x1876025593282048:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789117979.451999:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81aad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17799:x1876025593282048:12345-0@lo:1000:mdt00_001.0 Request processed in 198us (505us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789117979.452009:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789117979.452458:0:17799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a81aafc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17799:1876025593282048:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789117979.452527:0:17799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be21366 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.452541:0:17799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be21366 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.452549:0:17799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be21366 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.452557:0:17799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9b400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117979.452563:0:17799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be21366 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.452572:0:17799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be21366 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.452605:0:17799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff962a85f4bf00) 00010000:00010000:3.0:1789117979.452609:0:17799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789117979.452616:0:17799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be21366 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.452623:0:17799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be21366 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.452668:0:17799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be212be lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.452675:0:17799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be212be lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.452681:0:17799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be212be lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.452686:0:17799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9a000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117979.452689:0:17799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be212be lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.452696:0:17799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be212be lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.452706:0:17799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:3.0:1789117979.452709:0:17799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789117979.452718:0:17799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9ba00/0xaa253ed19be212c5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3a5 expref: 18 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.452732:0:17799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9ba00/0xaa253ed19be212c5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3a5 expref: 18 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.452751:0:17799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9ba00/0xaa253ed19be212c5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3a5 expref: 18 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.452835:0:17799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9ba00/0xaa253ed19be212c5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3a5 expref: 18 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117979.452851:0:17799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a81aaf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17799:1876025593282176:192.168.204.30@tcp:105: 00000100:00100000:3.0:1789117979.452951:0:17799:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a88434240 going to sleep for 11 seconds 00000100:00100000:1.0:1789117979.459815:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117979.460085:0:17799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a81aaf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17799:1876025593282176:192.168.204.30@tcp:105: 00010000:00010000:3.0:1789117979.460129:0:17799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be212be lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.460144:0:17799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be212be lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.460193:0:17799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be2136d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.460224:0:17799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be2136d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.460240:0:17799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be2136d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.460254:0:17799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be2136d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.460261:0:17799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be2136d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.460278:0:17799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be2136d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.460285:0:17799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9b400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117979.460290:0:17799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be2136d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.460299:0:17799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be2136d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.460314:0:17799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:3.0:1789117979.460318:0:17799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117979.460322:0:17799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be2136d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.460328:0:17799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be2136d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.460338:0:17799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be2135f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.460344:0:17799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be2135f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.460349:0:17799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be2135f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.460353:0:17799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9a800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789117979.460355:0:17799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be2135f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.460371:0:17799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be2135f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.460381:0:17799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:3.0:1789117979.460465:0:17799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789117979.460470:0:17799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be2135f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.460476:0:17799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a800/0xaa253ed19be2135f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117979.460713:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86bbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+18:15964:x1876025572214784:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 62000us (62255us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1789117979.460727:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 70 00000020:00080000:3.0:1789117979.460735:0:17799:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789117979.461259:0:17834:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789117979.461266:0:17834:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789117979.461297:0:17834:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789117979.461304:0:17834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789117979.461422:0:17802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572215168 00000100:00100000:2.0:1789117979.461433:0:17802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572215168 00000100:00100000:2.0:1789117979.461495:0:17802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:2.0:1789117979.461507:0:17802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd005e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+19:15963:x1876025572215168:12345-192.168.204.30@tcp:49:bash.0 00000100:00100000:2.0:1789117979.461664:0:17802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd005e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+18:15963:x1876025572215168:12345-192.168.204.30@tcp:49:bash.0 Request processed in 158us (1867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117979.461671:0:17802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:0.0:1789117979.468791:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117979.468893:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117979.468978:0:20393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572215296 00000100:00100000:3.0:1789117979.468992:0:20393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572215296 00000100:00100000:1.0:1789117979.469102:0:17802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572215552 00000100:00100000:3.0:1789117979.469105:0:20393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 34 00000100:00100000:1.0:1789117979.469106:0:17802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572215552 00000100:00100000:3.0:1789117979.469116:0:20393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86bbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+7:15963:x1876025572215296:12345-192.168.204.30@tcp:101:bash.0 00000100:00100000:1.0:1789117979.469139:0:17802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 13 00010000:00010000:3.0:1789117979.469142:0:20393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1789117979.469145:0:17802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+18:15964:x1876025572215552:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00010000:00010000:3.0:1789117979.469355:0:20393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002215c160/0xaa253ed19be21374 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f3dd expref: -99 pid: 20393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789117979.469391:0:20393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aa3c61a, atime: 0x6aa3c619, ctime: 0x6aa3c61a, blocks: 0x0 00010000:00010000:3.0:1789117979.469417:0:20393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=631s v=(0 0) 00010000:00010000:3.0:1789117979.469422:0:20393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117979.469435:0:20393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002215c160/0xaa253ed19be21374 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3dd expref: 8 pid: 20393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.469466:0:20393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002215c160/0xaa253ed19be21374 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3dd expref: 8 pid: 20393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.469483:0:20393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a88d9a800, rc 0) 00000004:00080000:1.0:1789117979.469534:0:17802:0:(mdd_object.c:4024:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:3.0:1789117979.469560:0:20393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86bbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+8:15963:x1876025572215296:12345-192.168.204.30@tcp:101:bash.0 Request processed in 447us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117979.469569:0:20393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 34 00000001:00080000:1.0:1789117979.469577:0:17802:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:1.0:1789117979.469614:0:17802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c000/0xaa253ed19be2137b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117979.469630:0:17802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c000/0xaa253ed19be2137b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117979.469640:0:17802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c000/0xaa253ed19be2137b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117979.469650:0:17802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c000/0xaa253ed19be2137b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117979.469658:0:17802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c000/0xaa253ed19be2137b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117979.469664:0:17802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c000/0xaa253ed19be2137b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117979.469690:0:17802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789117979.469759:0:17802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+20:15964:x1876025572215552:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 613us (864us total) trans 8589934630 rc 0/0 00000100:00100000:1.0:1789117979.469780:0:17802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 13 00000020:00080000:1.0:1789117979.469784:0:17802:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789117979.469818:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117979.469828:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c000/0xaa253ed19be2137b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.469836:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c000 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789117979.469841:0:17787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c000/0xaa253ed19be2137b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.469851:0:17787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c000/0xaa253ed19be2137b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.469867:0:17787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff962a85f4bf00) 00010000:00010000:2.0:1789117979.469870:0:17787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789117979.469876:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c000/0xaa253ed19be2137b lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.469882:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70c000/0xaa253ed19be2137b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.469909:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117979.469911:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117979.469913:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117979.475859:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117979.476419:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572215680 00000100:00100000:3.0:1789117979.476444:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572215680 00000100:00100000:3.0:1789117979.476586:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 71 00000100:00100000:3.0:1789117979.476604:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+20:15963:x1876025572215680:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:3.0:1789117979.476663:0:17798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117979.476946:0:17798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be21382 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f3e4 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.477004:0:17798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be21389 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.477024:0:17798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be21389 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.477043:0:17798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be21389 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117979.478941:0:17798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b400/0xaa253ed19be21382 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3e4 expref: 22 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117979.478982:0:17798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be21389 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3e4 expref: 21 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117979.478995:0:17798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:0.0:1789117979.478998:0:17798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789117979.479004:0:17798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a88d9a000, rc 0) 00000100:00100000:0.0:1789117979.479178:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+21:15963:x1876025572215680:12345-192.168.204.30@tcp:101:bash.0 Request processed in 2576us (3330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117979.479190:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 71 00000100:00100000:1.0:1789117979.489574:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117979.489742:0:17802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572215936 00000100:00100000:2.0:1789117979.489757:0:17802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572215936 00000100:00100000:2.0:1789117979.489840:0:17802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:2.0:1789117979.489853:0:17802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd006940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+21:15963:x1876025572215936:12345-192.168.204.30@tcp:35:bash.0 00000001:00080000:2.0:1789117979.491715:0:17802:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:2.0:1789117979.492045:0:17802:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:2.0:1789117979.492381:0:17802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd006940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+24:15963:x1876025572215936:12345-192.168.204.30@tcp:35:bash.0 Request processed in 2525us (2818us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1789117979.492395:0:17802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 14 00000020:00080000:2.0:1789117979.492402:0:17802:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789117979.623479:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117979.626376:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572216192 00000100:00100000:3.0:1789117979.626404:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572216192 00000100:00100000:3.0:1789117979.626573:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 72 00000100:00100000:3.0:1789117979.626617:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd004b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+24:15974:x1876025572216192:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1789117979.626671:0:20601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117979.626711:0:20601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b200/0xaa253ed19be21390 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f3eb expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117979.626937:0:20601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789117979.627406:0:20601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b200/0xaa253ed19be21390 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3eb expref: 26 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.627435:0:20601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962a85f4ba00) 00010000:00010000:3.0:1789117979.627440:0:20601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789117979.627447:0:20601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9b200/0xaa253ed19be21390 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3eb expref: 26 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117979.627474:0:20601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a88d9b200, rc 0) 00000100:00100000:3.0:1789117979.627606:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd004b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+25:15974:x1876025572216192:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 990us (4140us total) trans 8589934634 rc 301/301 00000100:00100000:3.0:1789117979.627619:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 72 00010000:00010000:2.0:1789117979.629373:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117979.635975:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117979.637375:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572216320 00000100:00100000:2.0:1789117979.637393:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572216320 00000100:00100000:2.0:1789117979.637510:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 73 00000100:00100000:2.0:1789117979.637524:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+25:15974:x1876025572216320:12345-192.168.204.30@tcp:34:lfs.0 00010000:00010000:2.0:1789117979.637658:0:17800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be2139e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.637686:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be2139e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.637705:0:17800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be2139e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.637726:0:17800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be213a5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.637760:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be213a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.637767:0:17800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be213a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.638113:0:17800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be213ac lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.638126:0:17800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be213ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.638133:0:17800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be213ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789117979.638201:0:17800:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be213ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.638232:0:17800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be2139e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.638240:0:17800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be2139e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.638247:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be2139e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.638254:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117979.638260:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be2139e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.638269:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be2139e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.638295:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff962b95e52d00) 00010000:00010000:2.0:1789117979.638299:0:17800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117979.638307:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be2139e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.638314:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93c00/0xaa253ed19be2139e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.638330:0:17800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be213a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.638337:0:17800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be213a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.638343:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be213a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.638349:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117979.638352:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be213a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.638358:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be213a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.638366:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff962a85f4b600) 00010000:00010000:2.0:1789117979.638368:0:17800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117979.638371:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be213a5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.638377:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be213a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.638403:0:17800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be213ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.638410:0:17800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be213ac lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.638416:0:17800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be213ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.638421:0:17800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789117979.638424:0:17800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be213ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.638430:0:17800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be213ac lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.638438:0:17800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:2.0:1789117979.638441:0:17800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117979.638444:0:17800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be213ac lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117979.638450:0:17800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92200/0xaa253ed19be213ac lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117979.639224:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+25:15974:x1876025572216320:12345-192.168.204.30@tcp:34:lfs.0 Request processed in 1683us (3256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117979.639237:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 73 00000100:00100000:1.0:1789117979.647704:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117979.648315:0:17801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572216576 00000100:00100000:0.0:1789117979.648331:0:17801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572216576 00000100:00100000:0.0:1789117979.648412:0:17801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:0.0:1789117979.648425:0:17801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+25:15974:x1876025572216576:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:0.0:1789117979.648770:0:17801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+26:15974:x1876025572216576:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 344us (1081us total) trans 8589934635 rc 0/0 00000100:00100000:0.0:1789117979.648779:0:17801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:1.0:1789117980.000992:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117980.001047:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117980.001131:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117980.001151:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117980.001307:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572216960 00000100:00100000:0.0:1789117980.001324:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572216960 00000100:00100000:0.0:1789117980.001413:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572217472 00000100:00100000:0.0:1789117980.001417:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572217472 00000100:00100000:0.0:1789117980.001468:0:19311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:0.0:1789117980.001508:0:19311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd004f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+8:2405:x1876025572216960:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117980.001647:0:19311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd004f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+8:2405:x1876025572216960:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 128us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117980.001657:0:19311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:0.0:1789117980.001683:0:19311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:0.0:1789117980.001690:0:19311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2405:x1876025572217472:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117980.001721:0:19311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2405:x1876025572217472:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 31us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117980.001727:0:19311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:0.0:1789117980.001787:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117980.001880:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572217216 00000100:00100000:0.0:1789117980.001880:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117980.001885:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572217216 00000100:00100000:0.0:1789117980.001894:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572217088 00000100:00100000:0.0:1789117980.001897:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572217088 00000100:00100000:0.0:1789117980.001922:0:19311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:0.0:1789117980.001929:0:19311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+5:2405:x1876025572217088:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117980.001940:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572216832 00000100:00100000:3.0:1789117980.001943:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572216832 00000100:00100000:0.0:1789117980.001957:0:19311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+5:2405:x1876025572217088:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 29us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117980.001964:0:19311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:3.0:1789117980.001968:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 77 00000100:00100000:3.0:1789117980.001976:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd0043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:2405:x1876025572217216:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117980.001986:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 78 00000100:00100000:0.0:1789117980.001992:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+5:2405:x1876025572216832:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117980.002016:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd0043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:2405:x1876025572217216:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 42us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117980.002016:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+5:2405:x1876025572216832:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 24us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117980.002023:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 78 00000100:00100000:3.0:1789117980.003091:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 77 00000100:00100000:3.0:1789117980.004928:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117980.004991:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572217344 00000100:00100000:3.0:1789117980.005003:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572217344 00000100:00100000:3.0:1789117980.005079:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 79 00000100:00100000:3.0:1789117980.005091:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2405:x1876025572217344:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117980.005092:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572216704 00000100:00100000:2.0:1789117980.005097:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572216704 00000100:00100000:2.0:1789117980.005137:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 172 00000100:00100000:2.0:1789117980.005162:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfb9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:2405:x1876025572216704:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117980.005357:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00080000:0.0:1789117980.005405:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789117980.005413:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789117980.005417:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789117980.005421:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117980.005444:0:20393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572217600 00000100:00100000:0.0:1789117980.005447:0:20393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572217600 00000100:00100000:0.0:1789117980.005482:0:20393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:0.0:1789117980.005489:0:20393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2405:x1876025572217600:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117980.005549:0:20393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2405:x1876025572217600:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 60us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117980.005556:0:20393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00080000:0.0:1789117980.005574:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117980.006694:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfb9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:2405:x1876025572216704:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 1519us (5707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117980.006711:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 172 00000100:00100000:3.0:1789117980.007498:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2405:x1876025572217344:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 2400us (2570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117980.007511:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 79 00000100:00100000:1.0:1789117980.518506:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789117980.518544:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593282304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789117980.518708:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117980.519779:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593282304 00000100:00100000:2.0:1789117980.519795:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593282304 00000100:00100000:2.0:1789117980.519918:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789117980.519935:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd007840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593282304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789117980.519989:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789117980.520241:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd007840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593282304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 311us (1535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117980.520250:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1789117980.520820:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789117980.522823:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593282304:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789117980.645564:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117981.671210:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789117981.948553:0:20987:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:2.0:1789117982.056472:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593282432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117982.056586:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117982.058301:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593282432 00000100:00100000:0.0:1789117982.058318:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593282432 00000100:00100000:0.0:1789117982.058403:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789117982.058416:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593282432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789117982.058467:0:18751:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1789117982.058547:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593282432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (1961us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117982.058555:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789117982.060012:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593282432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117982.061009:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789117982.061032:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593282560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789117982.061147:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117982.061359:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593282560 00000100:00100000:0.0:1789117982.061366:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593282560 00000100:00100000:0.0:1789117982.061421:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789117982.061433:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd007c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593282560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789117982.061477:0:17804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789117982.061579:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd007c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593282560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117982.061612:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789117982.071242:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593282560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789117982.565382:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593282688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117982.565502:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117982.572457:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593282688 00000100:00100000:3.0:1789117982.572488:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593282688 00000100:00100000:3.0:1789117982.572636:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789117982.572649:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876025593282688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789117982.572685:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789117982.572780:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876025593282688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (7278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117982.572788:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1789117982.572836:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789117982.572888:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593282688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117982.573036:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789117982.573090:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593282816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117982.573136:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117982.573181:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593282816 00000100:00100000:2.0:1789117982.573200:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593282816 00000100:00100000:2.0:1789117982.573230:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789117982.573238:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593282816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789117982.573266:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789117982.573298:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593282816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117982.573305:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1789117982.573318:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117982.573354:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593282816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117982.573997:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117982.574112:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117982.574455:0:19316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572217728 00000100:00100000:1.0:1789117982.574462:0:19316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572217728 00002000:00100000:1.0:1789117982.574521:0:19316:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff962a87d9fc00 x1876025572217728/t0(0) o4->369a8077-26bb-4780-baf3-16abc59c8ae5@192.168.204.30@tcp:533/0 lens 504/0 e 0 to 0 dl 1789117993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1789117982.574533:0:19316:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962a87d9fc00 with x1876025572217728 ext(0->8) 00002000:00010000:1.0:1789117982.574539:0:19316:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962a87d9fc00 00000100:00100000:1.0:1789117982.574579:0:19316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:1.0:1789117982.574588:0:19316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+8:2407:x1876025572217728:12345-192.168.204.30@tcp:4:bash.0 00000100:00100000:3.0:1789117982.574710:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593283328:0@lo:400:kworker.0 00000100:00100000:3.0:1789117982.574759:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117982.574790:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593283840:0@lo:400:kworker.0 00000100:00100000:3.0:1789117982.574816:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117982.574836:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789117982.574851:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593282944:0@lo:400:kworker.0 00000100:00100000:3.0:1789117982.574887:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117982.574920:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593283456:0@lo:400:kworker.0 00000100:00100000:3.0:1789117982.574944:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117982.574964:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593283968:0@lo:400:kworker.0 00000100:00100000:3.0:1789117982.574991:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117982.575023:0:20393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572217856 00000100:00100000:3.0:1789117982.575028:0:20393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572217856 00000100:00100000:3.0:1789117982.575091:0:20393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593283328 00000100:00100000:3.0:1789117982.575096:0:20393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593283328 00000100:00100000:3.0:1789117982.575126:0:20393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789117982.575134:0:20393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81aacf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593283328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117982.575189:0:20393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81aacf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593283328:12345-0@lo:400:kworker.0 Request processed in 56us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117982.575197:0:20393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789117982.575218:0:20393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 35 00000100:00100000:3.0:1789117982.575226:0:20393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+11:2407:x1876025572217856:12345-192.168.204.30@tcp:16:kworker.0 00000100:00100000:1.0:1789117982.575248:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593283072:0@lo:400:kworker.0 00000100:00100000:3.0:1789117982.575273:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593282944 00000100:00100000:3.0:1789117982.575277:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593282944 00000100:00100000:1.0:1789117982.575285:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117982.575303:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789117982.575312:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+24:3646:x1876025593282944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117982.575322:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593283584:0@lo:400:kworker.0 00000100:00100000:1.0:1789117982.575351:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117982.575367:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+24:3646:x1876025593282944:12345-0@lo:400:kworker.0 Request processed in 56us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117982.575371:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbd006580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593284096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789117982.575380:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789117982.575399:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117982.575416:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593283840 00000100:00100000:3.0:1789117982.575421:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593283840 00000100:00100000:1.0:1789117982.575422:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789117982.575429:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593283200:0@lo:400:kworker.0 00000100:00100000:3.0:1789117982.575465:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593283456 00000100:00100000:3.0:1789117982.575469:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593283456 00000100:00100000:1.0:1789117982.575474:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117982.575488:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593283968 00000100:00100000:3.0:1789117982.575492:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593283968 00000100:00100000:1.0:1789117982.575496:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593283712:0@lo:400:kworker.0 00000100:00100000:3.0:1789117982.575506:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593283072 00000100:00100000:3.0:1789117982.575510:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593283072 00000100:00100000:3.0:1789117982.575525:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593283584 00000100:00100000:1.0:1789117982.575526:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117982.575529:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593283584 00000100:00100000:3.0:1789117982.575549:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593283712 00000100:00100000:3.0:1789117982.575552:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593283712 00000100:00100000:1.0:1789117982.575558:0:19312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593283200 00000100:00100000:1.0:1789117982.575564:0:19312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593283200 00000100:00100000:3.0:1789117982.575575:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789117982.575585:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81aac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593283840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117982.575593:0:19312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789117982.575603:0:19312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81a0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593283200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117982.575624:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81aac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593283840:12345-0@lo:400:kworker.0 Request processed in 41us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117982.575631:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789117982.575649:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789117982.575651:0:19312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81a0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593283200:12345-0@lo:400:kworker.0 Request processed in 48us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117982.575659:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593283456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117982.575662:0:19312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789117982.575755:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789117982.575765:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81aaf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593283968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117982.576380:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593283456:12345-0@lo:400:kworker.0 Request processed in 720us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117982.576388:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789117982.576410:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789117982.576420:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd0070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593283072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117982.576463:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd0070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593283072:12345-0@lo:400:kworker.0 Request processed in 46us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117982.576469:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789117982.576481:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789117982.576487:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd005a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593283584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117982.576513:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd005a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593283584:12345-0@lo:400:kworker.0 Request processed in 27us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117982.576529:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789117982.576544:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789117982.576550:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81a0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593283712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117982.576583:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81a0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593283712:12345-0@lo:400:kworker.0 Request processed in 34us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117982.576589:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789117982.576658:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593283200:0@lo:400:kworker.0 00010000:00080000:1.0:1789117982.576677:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87d9f840 x1876025593283712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117982.576688:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593283712:0@lo:400:kworker.0 00000100:00100000:1.0:1789117982.576699:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593283072:0@lo:400:kworker.0 00000100:00100000:1.0:1789117982.576710:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593283584:0@lo:400:kworker.0 00000100:00100000:1.0:1789117982.576830:0:19316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+11:2407:x1876025572217728:12345-192.168.204.30@tcp:4:bash.0 Request processed in 2240us (2714us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789117982.576850:0:19316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 0 00002000:00100000:1.0:1789117982.576862:0:19316:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff962a87d9fc00 x1876025572217728/t8589934599(0) o4->369a8077-26bb-4780-baf3-16abc59c8ae5@192.168.204.30@tcp:533/0 lens 504/448 e 0 to 0 dl 1789117993 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1789117982.576873:0:19316:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff962a87d9fc00 with x1876025572217728 ext(0->8) 00002000:00010000:1.0:1789117982.576880:0:19316:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962a87d9fc00 00000100:00080000:1.0:1789117982.577050:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789117982.577079:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789117982.577082:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789117982.577084:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789117982.577773:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593284096 00000100:00100000:2.0:1789117982.577786:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593284096 00000100:00100000:2.0:1789117982.577857:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789117982.577866:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd006d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593284096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789117982.577894:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789117982.578014:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd006d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593284096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 149us (2615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117982.578022:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789117982.578259:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbd006580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593284096:0@lo:13:osp-pre-1-1.0 00000001:00080000:2.0:1789117982.579638:0:19307:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1789117982.579667:0:19307:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000100:00100000:3.0:1789117982.581066:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593282944:0@lo:400:kworker.0 00000100:00100000:1.0:1789117982.581273:0:20393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+6:2407:x1876025572217856:12345-192.168.204.30@tcp:16:kworker.0 Request processed in 6042us (7273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117982.581288:0:20393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 35 00000100:00100000:0.0:1789117982.584956:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81aaf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593283968:12345-0@lo:400:kworker.0 Request processed in 9179us (9950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117982.584972:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789117982.585780:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593283456:0@lo:400:kworker.0 00010000:00080000:2.0:1789117982.585803:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87d9c3c0 x1876025593283968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117982.585816:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593283968:0@lo:400:kworker.0 00000100:00100000:2.0:1789117982.585831:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593283328:0@lo:400:kworker.0 00000100:00100000:2.0:1789117982.585877:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593283840:0@lo:400:kworker.0 00010000:00010000:2.0:1789117982.702040:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789117982.759328:0:18556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 Debug log: 46531 lines, 46531 kept, 0 dropped, 0 bad.